Linear Independence
Linear independence captures the idea that no vector in a set is redundant -- none can be written as a linear combination of the others.
Definition
A set of vectors in a vector space over is linearly independent if the equation
implies .
A set that is not linearly independent is called linearly dependent.
is linearly dependent if and only if some can be written as a linear combination of the other vectors. That is, there exists an index such that
for some scalars .
- The empty set is linearly independent (vacuously).
- is linearly independent if and only if . (If and , then .)
Examples
In , the standard basis vectors , , , are linearly independent.
If , then .
is linearly independent. Suppose :
From the first equation, . Substituting: , so and .
is linearly dependent because
Equivalently, , a nontrivial relation.
is linearly independent in . If as a polynomial function, then all coefficients must be zero (when is infinite, or by comparing coefficients formally).
is linearly independent in . If for all :
- Setting : .
- Setting : .
is linearly independent in . If for all , then dividing by gives for all , which forces (let ) and then .
More generally, is linearly independent whenever are distinct.
In , the matrices
are linearly independent: implies .
is linearly independent in . If for all :
- : .
- : .
If , the set is linearly dependent. Say . Then is a nontrivial relation.
If is linearly dependent and , then is also linearly dependent: the existing nontrivial relation extends with coefficient for .
If is linearly independent, then every nonempty subset is linearly independent. (Any nontrivial relation in the subset would extend to a nontrivial relation in the full set.)
is linearly independent in viewed as a vector space over , but linearly dependent in over (since ). The field matters.
For times differentiable functions , the Wronskian is
If at some point, then are linearly independent.
For example, .
Key properties
Let be linearly dependent and . If is a vector that can be expressed as a linear combination of the preceding vectors , then
In other words, removing a "redundant" vector does not change the span.
Linear independence and spanning are dual requirements. A set that is both linearly independent and spanning is a basis, the central concept that connects the algebraic structure of a vector space to its "size" (dimension).