Pinterest·Data Scientist·Technical Phone Screen
- A new horizontal recommendations carousel was launched on the home page. Post-launch, the treatment group shows a drop in home-page CTR while app-wide DAU and total time spent stay flat. How would you define success metrics and guardrails for this surface?
- Walk through a step-by-step diagnosis plan for why home-page CTR dropped while DAU and time spent remained unchanged. What logs or queries would you actually run?
- What segmentation cuts would you use to localize the CTR drop? Name at least several specific dimensions.
- Based on your diagnosis, what would you recommend as next steps? How do you decide between rolling back the feature versus iterating on it?
“I jumped straight to CTR and kind of forgot to think about what 'good' CTR even means for a carousel.”