IMC·Machine Learning Engineer·Technical Phone Screen
May 2026
Conceptual ML interview at IMC for a machine learning engineer role. Two main topics came up: linear regression fundamentals and transformer architecture. Pretty theory-heavy, no coding, just talking through derivations and design decisions.
- Derive the closed-form solution for ordinary least squares linear regression and walk through the assumptions behind it.
- How do L1 and L2 regularization change the linear regression objective, and what are the practical differences in the solutions they produce?
- Explain the bias-variance trade-off in the context of linear regression.
- Walk through how self-attention works in a transformer, including the roles of queries, keys, and values.
- Why is the computational cost of self-attention quadratic in sequence length, and how does that compare to RNNs for long contexts?
- What are the main transformer variants (encoder-only, decoder-only, encoder-decoder) and when would you use each?
- What is the purpose of positional encodings in a transformer, and how do residual connections and layer normalization contribute to training stability?
“I got through the normal equations fine but stumbled a bit explaining exogeneity vs homoscedasticity in plain terms.” The rest of the author's notes on Machine Learning Engineer interview at IMC, Technical Phone Screen round, covers how they worked through the question, what the panel pushed back on, and what they would do differently.
View Post