Plaid·Software Engineer·Onsite - System Design / Architecture
- Design a conversational AI assistant similar to ChatGPT. Your design should support multi-turn conversations with history, token-by-token streaming responses, high availability under peak load, safety controls like toxicity filtering and PII handling, and optional tool use such as calling a search API or calculator. Walk through the high-level architecture, key components, storage choices, scaling strategy, and how you'd evaluate quality and safety in production.
“I started with the happy path, which in hindsight was the wrong move.”