Yahoo·Data Scientist·Technical Phone Screen·Senior

Senior

Jun 2026

Summary

Data scientist interview at Yahoo, one case-style question about diagnosing a DAU drop in Yahoo Mail. Pretty open-ended, which sounds fine until you're actually sitting there trying to structure your thoughts on the fly.

Questions Asked (1)

Yahoo Mail's daily active users dropped by 10% suddenly. How would you go about finding the root cause? Walk through what data you'd look at, which segments or funnels you'd dig into, and how you'd figure out whether this is something internal or something external.

Root Cause AnalysisProduct Analytics & MetricsAdaptability & Ambiguity

Author's notes

I started with the obvious stuff, platform breakdown, geography, recent releases, and that part felt okay.

Create a free account to read the full note

AI HintsAI Generated

Suggested Approach

Start by validating the metric and confirming the drop is real, then systematically segment the data across dimensions like platform, geography, and user cohorts to localize the issue. Finally, investigate external factors and internal changes to determine the root cause and recommend next steps.

Pro tip: Always check if the drop is due to a data pipeline issue or a change in metric definition before diving into product analytics—many 'sudden drops' are actually measurement artifacts. Also, compare with industry trends and competitor data to quickly rule out external shocks.

1. Validate the Metric and Data Pipeline

Confirm the 10% drop is real by checking data freshness, pipeline health, and any recent changes to logging or metric definitions. Cross-validate with other sources if possible.

2. Segment the Drop

Break down DAU by dimensions such as platform (iOS, Android, web), geography, user tenure, acquisition channel, and app version to identify which segments are most affected.

3. Analyze Funnel and Engagement Metrics

Examine the user journey—login, inbox load, email send/receive, and session duration—to pinpoint where users are dropping off. Look at retention and churn rates for affected cohorts.

4. Investigate Internal and External Factors

Check for recent product releases, infrastructure changes, or marketing campaigns internally. Externally, look at competitor actions, seasonality, holidays, or major events that could impact email usage.

5. Synthesize Findings and Recommend Actions

Correlate the timing of the drop with any changes, quantify the impact, and propose hypotheses for the root cause. Suggest immediate fixes and long-term monitoring.

Key Points to Mention

Metric validation: ensure the drop isn't due to data collection errors or definition changes.
Segmentation: analyze by platform, geography, user demographics, and acquisition cohorts to localize the issue.
Funnel analysis: track login success rates, page load times, and core actions like sending/receiving emails.
Internal factors: recent app updates, server outages, A/B tests, or changes in authentication flows.
External factors: competitor launches, email provider outages, seasonal trends, or global events.
Statistical significance: use hypothesis testing to confirm the drop is not random noise.

AI-generated suggestions, not part of the candidate's original notes. May be inaccurate — verify before relying on them.