OpenAI·Research Engineer·Technical Phone Screen
- How is a text embedding model trained? Walk me through the contrastive learning setup.
- What loss function is used in contrastive learning for embeddings, and can you write it out?
- How do you select positive and negative samples for contrastive training, and how many negatives do you use?
- What happens to the contrastive loss when you double the batch size, or when you inject hard negatives?
- Describe the retrieval flow in a RAG system, including hybrid retrieval and ranking.
“This was the core of the whole round.”