Datadog·Machine Learning Engineer·Onsite - System Design / Architecture
May 2026
Datadog ML engineer interview that went deep into monitoring system design, specifically around alerting pipelines for web server latency. The question was meaty and I don't think I fully nailed the on-call policy portion, but the technical detection side felt okay.
- Design a pipeline to monitor latency across dozens of web servers (each reporting average response time per second), including algorithms to detect degraded performance and a paging policy for on-call engineers that handles ack, snooze, and re-page intervals to reduce alert fatigue without missing real regressions.
“This is basically two questions stitched together and I treated them separately which I think hurt me.” The rest of the author's notes on Machine Learning Engineer interview at Datadog, Onsite - System Design / Architecture round, covers how they worked through the question, what the panel pushed back on, and what they would do differently.
View Post