Databricks·AI Engineer·Onsite - System Design / Architecture
Jun 2026
System design round at Databricks for an AI Engineer role. The whole thing was basically one big deep-dive into cache design, which sounds manageable until they start layering in hit counting with time windows and thread safety and suddenly you're juggling four different problems at once.
- Design a key-value cache that supports get and put operations with optional TTL, an LRU eviction policy, and an efficient hit-count query that returns cache hits overall and per key within a recent time window.
“I started with the hash map plus doubly linked list for LRU, which felt solid, but the hit-count-with-time-window part is where I fumbled.” The rest of the author's notes on AI Engineer interview at Databricks, Onsite - System Design / Architecture round, covers how they worked through the question, what the panel pushed back on, and what they would do differently.
View Post