Anthropic·Software Engineer·Onsite - System Design / Architecture
May 2026
System design round at Anthropic for a software engineering role. The whole thing was one big question about designing an async inference API, and it went pretty deep into queuing, scaling, and observability. Dense but fair.
- Design an async inference service where clients submit jobs via POST and poll for results. Cover the request/response schemas, idempotency, job statuses, timeouts, retries, and rate limiting.
- How would you design the job queue, worker pool, and storage for intermediate and final results for this inference service?
- How would you scale workers efficiently, handle batching of inputs, and make use of hardware accelerators for inference?
- How would you implement observability, error handling, and partial failure recovery for batch jobs in this service?
“I started with the polling contract because that felt like the core of it.” The rest of the author's notes on Software Engineer interview at Anthropic, Onsite - System Design / Architecture round, covers how they worked through the question, what the panel pushed back on, and what they would do differently.
View Post