TheoremComplete

Normed and Banach Spaces - Main Theorem

One of the most fundamental results in functional analysis establishes that all finite-dimensional normed spaces share the same topological properties, regardless of the choice of norm.

TheoremEquivalence of Norms in Finite Dimensions

Let XX be a finite-dimensional vector space over K\mathbb{K}. Then all norms on XX are equivalent.

This remarkable theorem has far-reaching consequences. It tells us that in finite dimensions, the choice of norm is largely a matter of convenienceβ€”topological properties such as convergence, continuity, compactness, and completeness are independent of which norm we use.

Proof

It suffices to show that any norm βˆ₯β‹…βˆ₯\|\cdot\| on XX is equivalent to a fixed reference norm. Let dim⁑X=n\dim X = n and choose a basis {e1,…,en}\{e_1, \ldots, e_n\} for XX. Define the reference norm by βˆ₯βˆ‘i=1nΞ±ieiβˆ₯1=βˆ‘i=1n∣αi∣\left\|\sum_{i=1}^n \alpha_i e_i\right\|_1 = \sum_{i=1}^n |\alpha_i|

For any x=βˆ‘i=1nΞ±iei∈Xx = \sum_{i=1}^n \alpha_i e_i \in X, by the triangle inequality: βˆ₯xβˆ₯=βˆ₯βˆ‘i=1nΞ±ieiβˆ₯β‰€βˆ‘i=1n∣αi∣βˆ₯eiβˆ₯≀Cβˆ₯xβˆ₯1\|x\| = \left\|\sum_{i=1}^n \alpha_i e_i\right\| \leq \sum_{i=1}^n |\alpha_i| \|e_i\| \leq C \|x\|_1 where C=max⁑1≀i≀nβˆ₯eiβˆ₯C = \max_{1 \leq i \leq n} \|e_i\|.

For the reverse inequality, define f:Knβ†’Rf: \mathbb{K}^n \to \mathbb{R} by f(Ξ±1,…,Ξ±n)=βˆ₯βˆ‘i=1nΞ±ieiβˆ₯f(\alpha_1, \ldots, \alpha_n) = \|\sum_{i=1}^n \alpha_i e_i\|. This function is continuous with respect to the standard topology on Kn\mathbb{K}^n. The unit sphere S={(Ξ±1,…,Ξ±n):βˆ‘i∣αi∣=1}S = \{(\alpha_1, \ldots, \alpha_n) : \sum_i |\alpha_i| = 1\} is compact, so ff attains its minimum on SS. Since f>0f > 0 on SS (by positivity of the norm), we have c=min⁑Sf>0c = \min_{S} f > 0.

For any nonzero x=βˆ‘i=1nΞ±ieix = \sum_{i=1}^n \alpha_i e_i, we can normalize to get a point in SS, yielding βˆ₯xβˆ₯β‰₯cβˆ₯xβˆ₯1\|x\| \geq c \|x\|_1.

β– 
ExampleConsequences of the Theorem
  1. All Banach: Every finite-dimensional normed space is a Banach space (complete)
  2. Compactness: A subset of Rn\mathbb{R}^n is compact if and only if it is closed and bounded, regardless of the norm used
  3. Continuity: A linear map between finite-dimensional normed spaces is always continuous
  4. Dimension Formula: If XX is a finite-dimensional normed space and YβŠ‚XY \subset X is a closed subspace, then dim⁑X=dim⁑Y+dim⁑(X/Y)\dim X = \dim Y + \dim(X/Y)
Remark

This theorem fails dramatically in infinite dimensions. Different norms on an infinite-dimensional space can induce completely different topologies, lead to different notions of convergence, and result in spaces with vastly different completeness properties. This is why the study of Banach spaces requires such careful attention to the choice of norm.

The theorem also explains why linear algebra in finite dimensions is so well-behaved compared to infinite-dimensional analysis. Many pathological phenomena in functional analysis simply cannot occur in finite dimensions.