Rippling·Software Engineer·Onsite - System Design / Architecture
- Design a logging system that supports real-time traffic monitoring, data enrichment on ingested records, and offline analytics over historical logs.
- How would you guarantee no data loss end-to-end in this pipeline?
- How do you keep data consistent across the real-time monitoring path and the offline analytics path when they're reading from the same source?
- Walk me through how you'd handle reliability. What happens when parts of the pipeline fail?
- How would you handle schema evolution and backfilling historical data when the log format changes?
“The scope of this thing is wide.”