Meta·Data Scientist·Technical Phone Screen
- Using only a provided SQL dataset, how would you determine whether users actually need or want a new video-calling feature before it launches?
- If you had access to all internal data sources beyond just SQL, what additional analyses would you run to measure demand for the video-calling feature?
- After the video-calling feature is released, how would you evaluate its quality and overall success?
- If your primary success metric improves but a guardrail metric declines, how do you proceed and how do you communicate that decision to stakeholders?
“I started talking about usage frequency and message volume as proxies for engagement, then pivoted to looking at things like group chat size or call-adjacent behaviors in the data.”