Tesla·Machine Learning Engineer·Technical Phone Screen
- Walk me through the differences between GRPO and PPO, covering how each estimates advantages, handles clipping, uses (or avoids) a value function, and when you'd pick one over the other.
- How do you decide between designing a reward function by hand versus training a reward model, and what factors push you toward one or the other?
“This is where I spent most of my mental energy.”