Inner Product
An inner product endows a vector space with geometric structure: lengths, angles, and distances. While a bare vector space only has addition and scalar multiplication, an inner product space can measure the "size" of vectors and the "angle" between them, connecting algebra to geometry.
Definition
Let be a real vector space. An inner product on is a function satisfying:
- Linearity in the first argument: .
- Symmetry: .
- Positive definiteness: , with equality if and only if .
A real vector space equipped with an inner product is called a real inner product space (or Euclidean space when finite-dimensional).
Let be a complex vector space. An inner product on is a function satisfying:
- Linearity in the first argument: .
- Conjugate symmetry: .
- Positive definiteness: (it is real by conjugate symmetry), with equality iff .
A complex vector space with an inner product is called a unitary space (or pre-Hilbert space).
In the complex case, conjugate symmetry together with linearity in the first argument implies conjugate-linearity in the second:
Some references (especially in physics) use the opposite convention: linear in the second argument, conjugate-linear in the first.
Standard examples
The standard inner product on is the dot product:
For and : .
This satisfies all three axioms: linearity is clear, symmetry gives , and with equality iff .
On :
where is the conjugate transpose.
For and : .
Note: , so positive definiteness holds.
On with positive weights :
For on : .
The vectors and are orthogonal in the standard inner product () but not in this weighted one.
On the space of continuous functions :
For and on : .
For and on : (orthogonality of Fourier modes).
Norm and distance
The norm (or length) of a vector in an inner product space is:
The distance between and is .
For with the standard inner product:
.
, .
With :
.
.
.
Properties of the norm
For all and :
- , with iff .
- (homogeneity).
- (triangle inequality).
- (Cauchy--Schwarz inequality).
, : . The inequality is strict because and are not parallel.
, : and . Equality holds because (they are parallel).
Angles
In a real inner product space, the angle between nonzero vectors is defined by:
This is well-defined by the Cauchy--Schwarz inequality, which guarantees .
, : , so .
, : , so (perpendicular).
, : , so (anti-parallel).
With , the angle between and :
, so .
Inner products via matrices
Every inner product on has the form for a unique symmetric positive definite matrix . Conversely, every symmetric positive definite defines an inner product this way.
is positive definite (eigenvalues ).
. For , : .
, . The standard basis vectors are not unit vectors in this inner product.
has eigenvalues and . Since , is not positive definite.
.
This fails positive definiteness, so it is not an inner product.
Parallelogram law and polarization
In any inner product space: .
This characterizes inner product spaces among normed spaces: a norm satisfies the parallelogram law if and only if it comes from an inner product.
, in :
. ✓.
The inner product can be recovered from the norm:
Summary
An inner product transforms a bare vector space into a geometric space:
- Norm: measures length, .
- Distance: gives metric space structure.
- Angle: .
- Orthogonality: iff .
- Every inner product on arises from a symmetric positive definite matrix.
- The Cauchy--Schwarz inequality is the fundamental inequality governing the interaction between the inner product and the norm.