Attentive·Data Scientist·Technical Phone Screen
- US SMS delivery rates dropped ~6.5 percentage points starting at a specific time window, affecting two major carriers but not Canada or UK. A new link-shortener domain and updated carrier registrations had just rolled out. Walk through how you'd triage this.
- How would you slice the data to isolate where the delivery drop is coming from?
- What artifact or system-level checks would you do before jumping to statistical analysis?
- How would you design an experiment to test whether the new link-shortener domain caused the drop?
- What would your rollback plan look like, and what evidence threshold would you need before declaring the incident resolved?
“This was the whole interview basically.”