Proof of the Replacement Theorem
We prove the Replacement Theorem: if is spanned by a set with , and is linearly independent, then and there exists with such that .
Proof by induction on
We induct on .
Base case (): , and we take . Then and .
Inductive step: Assume the result holds for independent vectors. Suppose is linearly independent.
By the inductive hypothesis applied to , there exist elements of that can be "replaced," leaving a subset with such that
Write .
Since , we can write
Claim: At least one .
Proof of claim: If all , then , contradicting the linear independence of .
So some . Without loss of generality, say . Then we can solve for :
This shows .
Therefore:
Set with . Then .
Bounding : We need , i.e., . If , then at the step where becomes , we would have , and would be a linear combination of , contradicting independence.
Worked examples illustrating the proof
spans , . Let with , .
Step 1 (): We write . The coefficient of is , so replace :
Step 2 (): We write in terms of :
We need a nonzero coefficient on or . The coefficient of is , so replace :
Result: , .
spans , . Let , so .
. All coefficients are nonzero. Choose to replace :
Indeed: .
, .
Try to find 4 independent vectors in . Say are independent. After replacing 3 vectors from :
Then , contradicting independence of .
In the proof, when , we can replace any with . For and :
All three coefficients are nonzero, so we could replace any one of , , or . Each choice gives a valid spanning set.
Unlike many existence proofs in mathematics, the Replacement Theorem's proof is fully constructive: it provides an explicit algorithm to find . Process one at a time, each time replacing one element of based on a nonzero coefficient. This algorithm is essentially Gaussian elimination.
If and are two bases for , then is independent and is spanning, so by the Replacement Theorem. By symmetry, . Hence .
This is the most important consequence: the number does not depend on the choice of basis.
An independent set with is a basis. The Replacement Theorem gives with , so .
A spanning set with is a basis. If were dependent, we could remove an element and still span, giving a spanning set of size . But any independent subset (e.g., a basis) has elements, contradicting .
If is independent and , then there exist such that is a basis for .
The Replacement Theorem can be seen as a statement about the lattice of subspaces: any maximal chain from to (a composition series) has the same length, . This is a special case of the Jordan-Holder theorem in group theory.
In infinite-dimensional spaces, the analogous theorem holds with Zorn's lemma replacing induction. Any linearly independent set can be extended to a (Hamel) basis, and all bases have the same cardinality.
If is a subspace of a finite-dimensional space , then . Any basis of is an independent set in , and by the Replacement Theorem, its size cannot exceed . Moreover, implies (extend a basis of -- but no extension is needed since it already has vectors, so it spans ).
The Replacement Theorem is the cornerstone of finite-dimensional linear algebra. It ensures:
- Dimension is well-defined.
- Independent sets are "small" ( elements).
- Spanning sets are "large" ( elements).
- Bases are precisely the independent sets (or spanning sets) of size .