What are eigenvalues and eigenvectors?hard

Type
conceptual
Topic
decomposition
Frequency
common
Tags
decomposition
Answer

An eigenvector of matrix A is a non-zero vector v where Av = λv - multiplying by A only scales v, not rotates it. λ is the eigenvalue, the scaling factor.

Explanation

Eigenvectors reveal the "natural axes" of a transformation - directions that stay fixed. Eigenvalues tell you how much stretching happens along those axes. In PCA, the eigenvectors of the covariance matrix are the principal components (directions of maximum variance), and eigenvalues indicate how much variance each explains. In graph neural networks and spectral methods, eigenvalues of the graph Laplacian encode structural properties of the graph.

Follow-upWhat is the relationship between eigenvalues and matrix rank?