Coinbase·Data Scientist·Technical Phone Screen
- You're running an online experiment comparing conversion rates between a treatment and control group. Walk through how you'd compute a 95% confidence interval for the treatment effect by hand, covering the point estimate for absolute lift, the standard error derivation, the CI formula itself, how things change if they ask for relative lift instead, and when the normal approximation breaks down versus when you'd reach for something like a bootstrap or score-based interval.
“This looked like a clean textbook question at first and I thought I had it.”