Expedia·Machine Learning Engineer·Onsite - System Design / Architecture
- Design a text-to-image generation service similar to DALL-E or Midjourney. Walk through the full system from user prompt submission to returned images.
- How would you design the async API for image generation, including how clients know when their job is done?
- How would you manage and scale a GPU inference fleet to handle diffusion model workloads efficiently?
- How would you handle model versioning and run A/B tests across different versions of a diffusion model?
- What does a safety pipeline look like for a system like this, covering both prompt filtering and output moderation?
- How would you optimize costs in this system, especially given the expense of GPU inference at scale?
- How would you handle abuse prevention and rate limiting for a public-facing image generation API?
“I started with the API layer and worked outward, which in retrospect was fine but I spent too long on the happy path.”