Snap·Machine Learning Engineer·Onsite - System Design / Architecture
Jun 2026
Snapchat ML Engineer system design round, basically a single massive question about building a trustworthy ranking system end to end. Dense, no warmup, they went straight into the hardest parts. Felt like they really wanted to see if you'd thought about the messy real-world stuff, not just the textbook pipeline.
- Design a ranking system (recommendation, search, or feed) where model trustworthiness is critical and ground-truth labels like conversions or retention only arrive days or weeks after the fact. Walk through the full system: feature pipeline, feature store, candidate generation, ranker model, online serving, and how you handle delayed labels in training.
- How do you use surrogate or proxy labels to get fast feedback when your real labels are delayed, and how do you prevent those proxies from leaking future information into your training data?
- How would you run A/B tests for a ranking model when your primary success metric depends on outcomes that take days or weeks to observe?
- How do you handle position bias and selection bias in a learned ranking model, and what does your debiasing approach look like in practice?
- What does your monitoring setup look like for a ranking system, specifically around data drift, model drift, and fairness across different user segments?
- If a deployed ranking model starts behaving badly, what's your rollback strategy and how quickly can you execute it?
- How do you calibrate model output scores and handle uncertainty estimation in a ranking context where you need the scores to be meaningful, not just relatively ordered?
“This is basically five questions rolled into one.” The rest of the author's notes on Machine Learning Engineer interview at Snap, Onsite - System Design / Architecture round, covers how they worked through the question, what the panel pushed back on, and what they would do differently.
View Post