Gemini·Data Scientist·Technical Phone Screen
- Given a proposed ACH fraud detection rule with known recall and false positive rate, compute the monthly gross fraud loss without the rule, the loss remaining after the rule is applied, and the net savings once false-positive operational costs are factored in. Show all formulas and units.
- Design a two-arm online A/B test to detect a 15% relative reduction in fraud loss per 1,000 credits at 5% significance (two-sided) and 80% power. State your distributional assumptions, derive the per-arm sample size, and justify your modeling choice.
- A control arm observes 240,000 credits with a 0.12% fraud prevalence. Compute a 95% Wilson confidence interval for that prevalence and explain what it means for a go/no-go decision.
- If you're reviewing A/B test results daily over 14 days, how do you control Type I error? Propose a sequential testing plan with stopping rules and explain how early stopping affects your primary metric.
“This part I actually felt okay about.”