OpenAI·Software Engineer·Onsite - System Design / Architecture
- Design a text-to-video generation platform similar to Sora, covering the user-facing API, job lifecycle, GPU worker scheduling, failure handling, artifact storage, safety enforcement, and observability.
- A worker gets network-partitioned, the system declares it dead and retries the job elsewhere, the retry completes successfully, and then the original worker comes back online and tries to publish its result. How does your design prevent a double publish or double billing?
- If 80% of a long-running GPU job completes and then the spot instance gets preempted, how do you avoid restarting the entire computation from scratch?
- Inference finished but the post-processing stage (encoding, upscaling, watermarking) crashed. What do you re-run and what must you absolutely not re-run?
- A single prompt consistently crashes every worker that picks it up. How does the system protect the rest of the fleet, and how do you handle billing for that job?
- GPU utilization is sitting at 60% while job queues are full and wait times are rising. What are the likely causes and how does your monitoring help you figure out if the bottleneck is scheduling, the model, or hardware?
- How would you make the job submission API idempotent so that a client retry on a timeout never creates a duplicate GPU job or triggers a double charge?
- How do you enforce safety at both the prompt level and the generated frame level, and how do you handle watermarking and content provenance?
“This is the kind of question where you can spend 45 minutes and still feel like you only scratched the surface.”