ByteDance·Machine Learning Engineer·Technical Phone Screen
- Walk through how Flash Attention works, including the tiling mechanism and why it reduces memory bandwidth overhead.
- Explain KV Cache: what gets stored, how memory usage scales, and what trade-offs come with it during autoregressive decoding.
- Describe how RoPE encodes position information and why rotating query and key vectors achieves relative position awareness.
“I knew the high-level pitch but stumbled when they pushed on the tiling math specifically.”