TikTok·Machine Learning Engineer·Onsite - System Design / Architecture
- Design an end-to-end system to deploy a multimodal video captioning model under hard compute and GPU memory constraints. How do you reduce input cost, fit the model in memory, structure the serving path, and monitor the whole thing?
- For the captioning system, what levers do you have to reduce GPU memory usage, and what does each one cost you?
- Design a retrieval pipeline that lets a brand advertiser find relevant videos from a corpus of hundreds of millions to billions of videos using a text or creative query, then watermark the matched videos at scale.
- How do you keep the ANN index fresh as new videos are continuously ingested without doing a full rebuild every time, and what staleness would an advertiser actually see?
- If a 4-bit quantized captioning model produces noticeably worse captions for a subset of videos, how would you detect those cases and route them to a higher-quality path?
- Pick one ML fundamentals topic (dropout, normalization variants, or RL in LLM post-training) and explain how it connects to deploying or fine-tuning the captioning model.
“This is the kind of question where you can spiral if you start with the model instead of the input.”