Intuit·Machine Learning Engineer·Technical Phone Screen
- Your model performs well on offline evaluation but degrades in production. How do you debug that?
- Walk me through how you'd investigate training-serving skew in a deployed model.
- If online feature distributions are diverging from what the model saw during training, where do you look first?
- Which architectural components do you inspect when tracking down a feature skew issue?
“This is the kind of question that sounds straightforward until you're actually in it.”