Uber·Machine Learning Engineer·Technical Phone Screen
Jun 2026
ML Engineer interview at Uber focused almost entirely on inference optimization and ML infra depth. They started with modeling fundamentals to warm up, then went hard on concrete work you've done, specific techniques, and measurable results. Pretty technical throughout.
- Walk me through your hands-on experience with ML inference optimization. What models or workloads have you worked on and what techniques did you apply?
- What bottlenecks did you identify in your inference pipeline, and how did you measure them?
- What end-to-end latency and throughput improvements did you deliver, and what were the trade-offs involved?
- How does your ML optimization work intersect with infrastructure concerns like scheduling, autoscaling, and accelerator selection?
- Which serving stacks have you worked with, like vLLM, TensorRT-LLM, or Triton, and what drove your choice between them?
- What are the fundamentals of how a transformer model runs at inference time, and where are the common performance failure points?
“This was basically the whole interview compressed into one question.” The rest of the author's notes on Machine Learning Engineer interview at Uber, Technical Phone Screen round, covers how they worked through the question, what the panel pushed back on, and what they would do differently.
View Post