Pinterest·Machine Learning Engineer·Onsite - System Design / Architecture
Jul 2026
Pinterest ML Engineer interview focused entirely on designing an ad ranking system for a personalized feed. The session was deep and technical, with the interviewer pushing hard on training data construction, bias handling, and embedding strategies. Not a casual screen.
- Design an ML system to increase click-through rate for ads shown in a personalized social media feed. Walk through how you'd frame the problem, build and train the model, serve it, and operate it end to end.
- What metrics would you track for this system, both online and offline? How do you prevent CTR optimization from degrading user experience or long-term engagement?
- How do you construct training data for the CTR model? What are your positive and negative examples, and what logs do you need?
- How would you build user and ad embeddings? Describe both a two-tower retrieval approach and a graph-based approach, including what features go into each and how you'd keep them fresh.
- How do you handle position bias and selection bias in your training data, and what's your approach to calibration given that the model output feeds directly into auction scoring?
- Your model shows strong offline AUC improvements but the A/B test comes back flat or negative. What are the most likely causes and how do you diagnose them?
- How would you jointly optimize for CTR and post-click conversions without one signal cannibalizing the other? How does the auction score change in that setup?
- A brand-new advertiser campaign launches with zero history. Trace exactly how it gets retrieved, ranked, and given a fair opportunity to accumulate signal without burning through budget.
- How do delayed conversions break a naive training pipeline, and what changes would you make to handle them properly?
“This is the main question and it's basically a full system design session disguised as one prompt.” The rest of the author's notes on Machine Learning Engineer interview at Pinterest, Onsite - System Design / Architecture round, covers how they worked through the question, what the panel pushed back on, and what they would do differently.
View Post