Roblox·Data Scientist·Technical Phone Screen
- You're launching a feature that boosts feed content when friends interact with it. Because interactions spread through the social graph, standard user-level A/B randomization breaks down. How would you design an experiment that actually gives you a credible causal estimate? Walk through your randomization strategy, metrics, power calculations, analysis approach, and what you'd do if contamination gets out of hand mid-test.
“This is a five-part question dressed up as one question, which I did not fully appreciate until I was three minutes into talking about Louvain clustering and realized I hadn't even touched metrics yet.”