Google·Software Engineer·Onsite - System Design / Architecture
- You're building an AI product where each request can be routed to either a high-cost low-latency inference option or a low-cost high-latency one. How do you decide which to use, and how do you think about the trade-offs across user experience, quality, reliability, and cost? What metrics would you track, how would you segment workloads, and would you build a dynamic routing layer or just pick one globally?
“This question kept expanding on me.”