← Bank of America Interview Insights
This was basically three questions in one and I didn't pace myself well.
Start by explaining PCA as a dimensionality reduction technique that finds new orthogonal axes (principal components) maximizing variance. Then describe the math: eigenvectors of the covariance matrix give the directions of the components, and eigenvalues give the amount of variance each component captures. Finally, discuss limitations such as linearity, sensitivity to scaling, and interpretability challenges, tying them to practical trade-offs in software engineering.
Pro tip: Emphasize that PCA assumes linear relationships and that the components are often hard to interpret, which matters in regulated industries like banking where explainability is crucial. Mention that you would standardize features before PCA and consider alternatives like autoencoders for non-linear data.
Explain that PCA is a dimensionality reduction technique that transforms data into a new coordinate system where the greatest variance lies on the first axis, the second greatest on the second, etc. It is used for visualization, noise reduction, and speeding up other algorithms.
Describe how PCA computes the covariance matrix of the standardized data, then finds its eigenvectors and eigenvalues. Eigenvectors represent the directions of the new axes (principal components), and eigenvalues represent the magnitude of variance along each eigenvector.
Explain that data is projected onto the eigenvectors, and components are selected based on eigenvalues (e.g., keep components that explain 95% of variance). This yields a lower-dimensional representation.
Highlight that PCA assumes linearity, is sensitive to feature scaling, can be affected by outliers, and the resulting components are often difficult to interpret. Also note that it may discard information useful for specific tasks if variance is not the right criterion.
Connect to practical considerations: when to use PCA (e.g., preprocessing for ML models, reducing storage), when to avoid it (e.g., when interpretability is key), and alternatives like t-SNE, autoencoders, or feature selection methods.
AI-generated suggestions, not part of the candidate's original notes. May be inaccurate — verify before relying on them.