Amazon·Research Scientist·Technical Phone Screen
Jul 2026
Deep-dive technical screen for an Applied Scientist role at Amazon, focused almost entirely on RLHF training methods. The whole thing was basically a live interrogation on PPO, GRPO, and GSPO with follow-ups that kept going deeper into production realities like rollout cost and reward hacking.
- Compare PPO, GRPO, and GSPO. When would you choose one over the others?
- How is the advantage estimated in GRPO, and why doesn't it need a value network?
- What are the failure modes of reward hacking when fine-tuning a reasoning model, and how do you mitigate them?
- Walk me through the rollout cost in RLHF and how you'd handle distributed training topology for GRPO at scale.
- Explain the PPO clipped surrogate loss and the role of the KL penalty against a reference policy.
“This was the anchor question and it went longer than I expected.” The rest of the author's notes on Research Scientist interview at Amazon, Technical Phone Screen round, covers how they worked through the question, what the panel pushed back on, and what they would do differently.
View Post