Salesforce·AI Engineer·Technical Phone Screen
- How do you choose between precision, recall, F1-score, and AUC when evaluating a classification model?
- How do you decide whether a problem should be framed as classification versus regression?
- How do you set up a proper benchmarking methodology when comparing ML models?
- What techniques do you use to optimize model inference for latency and throughput in production?
- How would you architect an AI agent as a production service?
- Can you explain how the Transformer attention mechanism works and why it matters for LLMs?
- How do you manage context windows effectively when working with LLMs in production?
- How does retrieval-augmented generation work, and how do you ground LLM outputs to reduce hallucinations?
“This came down to knowing your use case.”