Waymo·Data Scientist·Technical Phone Screen
- Write Python code to filter ride data to San Francisco in July 2024, join it to experiment assignments, run a Welch two-sample t-test comparing treatment vs. control time-to-pickup, and return the p-value.
- Given a returned p-value, how would you decide whether the result is statistically significant?
- Is a statistically significant p-value conclusive proof that the new routing algorithm is better? If not, what are the main threats to validity?
- Propose a stronger experiment design and analysis plan for this routing algorithm.
“Felt okay about the pandas part but I second-guessed myself on why Welch specifically versus a standard t-test.”