Tubitv·Machine Learning Engineer·Onsite - System Design / Architecture
- Design an end-to-end ML system that selects which thumbnail to show each user for a given streaming title, with the goal of maximizing engagement. Cover problem framing, data, modeling, offline and online evaluation, serving, and production monitoring.
- Your training data only has feedback for thumbnails that were actually shown. How do you reason about thumbnails that were never shown to a given user, and how do you evaluate a model that needs to compare all candidates?
- If a click-maximizing model starts surfacing sensational or slightly misleading thumbnails that get clicks but result in low watch completion, how do you detect that and adjust the objective?
- A brand-new title enters the catalog with five thumbnails and zero engagement history. Walk through exactly what the system does for that title over the first hours and days.
- How would you determine whether personalizing thumbnail selection per user is actually worth the added complexity compared to just picking one globally best thumbnail per title? What experiment would you run?
“This was the main question and it ate up most of the session.”