Proof: The Spectral Theorem
We prove that every real symmetric matrix can be orthogonally diagonalized, establishing the spectral theorem through induction on dimension.
Theorem: Let be a real symmetric matrix. Then has an orthonormal basis of eigenvectors and can be written as where is orthogonal.
Proof by induction on :
Base case (): Any matrix is already diagonal with eigenvector .
Inductive step: Assume the theorem holds for symmetric matrices. Let be symmetric.
Step 1: Existence of a real eigenvalue and eigenvector.
Since is real and symmetric, the characteristic polynomial has real coefficients. Over , it has at least one root .
We showed earlier that this eigenvalue is real (for symmetric matrices). Let be a corresponding eigenvector with .
Step 2: Extend to orthonormal basis.
Extend to an orthonormal basis of using Gram-Schmidt.
Form orthogonal matrix .
Step 3: Block structure in new basis.
Compute . The first column of is:
Therefore, the first column of is:
By symmetry of (since ), the first row is also .
Thus:
where is and symmetric (as a submatrix of a symmetric matrix).
Step 4: Apply induction to .
By the inductive hypothesis, has an orthonormal eigenvector basis. There exists orthogonal matrix such that:
Step 5: Combine the transformations.
Define orthogonal matrix:
Then:
Step 6: Construct the full orthogonal diagonalization.
Let . Then is orthogonal (product of orthogonal matrices), and:
Thus .
Step 7: Orthonormality of eigenvectors.
The columns of are orthonormal (since is orthogonal) and are eigenvectors of with eigenvalues (the diagonal entries of ).
By induction, the spectral theorem holds for all . ∎
This proof elegantly uses induction: we peel off one eigenvector at a time, reducing to a smaller problem. The key insight is that the orthogonal complement of an eigenvector is -invariant for symmetric matrices, allowing us to apply induction to a submatrix. This recursive structure reveals why orthonormal eigenvector bases exist: each eigenvector can be chosen orthogonal to previous ones.