Microsoft·Software Engineer·Technical Phone Screen
- Implement greedy decoding for a language model. At each step you receive a logit vector over the vocabulary, pick the argmax token, append it to the sequence, and feed it back as input. Stop at an end-of-sequence token or after N tokens. Also discuss numerical stability, tie-breaking, and how this compares to sampling-based approaches.
“I knew greedy decoding conceptually but writing it out cleanly under pressure was a different story.”