Databricks·Data Scientist·Technical Phone Screen
- You've trained a binary classifier that outputs predicted probabilities. Walk through ROC-AUC vs PR-AUC: what each curve actually plots, how class imbalance affects them, when they disagree, which you'd prefer for model selection, how you'd think about it if the business goal is catching as many positives as possible within a fixed review budget, and what practical pitfalls exist with either metric.
“This is the kind of question where you think you know it and then halfway through you realize you're just reciting things you memorized.”