ProofComplete

Proof of Von Neumann Stability Analysis

Von Neumann stability analysis is the standard tool for determining stability of finite difference schemes for linear PDEs with constant coefficients. The method uses Fourier analysis to decompose the error into independent modes.


Statement

Theorem8.3Von Neumann Stability Criterion

Consider a finite difference scheme for a linear PDE with constant coefficients on a uniform grid, with periodic boundary conditions. The scheme is stable (in the ℓ2\ell^2 norm) if and only if the amplification factor g(ξ)g(\xi) satisfies ∣g(ξ)∣≤1+CΔt|g(\xi)| \leq 1 + C\Delta t for all frequencies ξ∈[−π,π]\xi \in [-\pi, \pi] and some constant CC independent of Δt\Delta t and Δx\Delta x. For practical purposes, the condition ∣g(ξ)∣≤1|g(\xi)| \leq 1 for all ξ\xi (the von Neumann condition) is equivalent to stability for dissipative schemes.


Proof

Proof

Fourier decomposition. On a periodic grid with NN points and spacing Δx\Delta x, any grid function ujnu_j^n can be written as a discrete Fourier series: ujn=∑k=−N/2N/2−1u^kneiξkjΔxu_j^n = \sum_{k=-N/2}^{N/2-1} \hat{u}_k^n e^{i\xi_k j\Delta x} where ξk=2πk/(NΔx)\xi_k = 2\pi k/(N\Delta x).

Linearity and constant coefficients. For a linear scheme with constant coefficients, Fourier modes decouple: if uj0=eiξjΔxu_j^0 = e^{i\xi j\Delta x}, then ujn=g(ξ)neiξjΔxu_j^n = g(\xi)^n e^{i\xi j\Delta x} where g(ξ)g(\xi) is the amplification factor, obtained by substituting ujn=gneiξjΔxu_j^n = g^n e^{i\xi j\Delta x} into the scheme.

Stability ⇔\Leftrightarrow bounded amplification. By Parseval's theorem: ∥un∥ℓ22=NΔx∑k∣u^kn∣2=NΔx∑k∣g(ξk)∣2n∣u^k0∣2\|u^n\|_{\ell^2}^2 = N\Delta x \sum_k |\hat{u}_k^n|^2 = N\Delta x \sum_k |g(\xi_k)|^{2n}|\hat{u}_k^0|^2.

(i) Necessity. If ∣g(ξ0)∣>1+CΔt|g(\xi_0)| > 1 + C\Delta t for some ξ0\xi_0, choose u0=eiξ0jhu_0 = e^{i\xi_0 jh}. Then ∥un∥ℓ2=∣g(ξ0)∣n∥u0∥ℓ2\|u^n\|_{\ell^2} = |g(\xi_0)|^n \|u^0\|_{\ell^2}. For n=T/Δtn = T/\Delta t: ∣g(ξ0)∣n>(1+CΔt)T/Δt→eCT|g(\xi_0)|^n > (1 + C\Delta t)^{T/\Delta t} \to e^{CT}, which is bounded. But if ∣g(ξ0)∣>1+CΔt|g(\xi_0)| > 1 + C\Delta t with CC growing as Δt→0\Delta t \to 0, the bound diverges. Specifically, if ∣g(ξ0)∣≥1+α/Δt|g(\xi_0)| \geq 1 + \alpha/\Delta t for some α>0\alpha > 0, then ∣g∣n∼eαn/Δt=eαT/(Δt)2→∞|g|^n \sim e^{\alpha n/\Delta t} = e^{\alpha T/(\Delta t)^2} \to \infty, violating stability.

(ii) Sufficiency. If ∣g(ξ)∣≤1+CΔt|g(\xi)| \leq 1 + C\Delta t for all ξ\xi, then ∣g(ξ)∣n≤(1+CΔt)T/Δt≤eCT|g(\xi)|^n \leq (1 + C\Delta t)^{T/\Delta t} \leq e^{CT} for nΔt≤Tn\Delta t \leq T. By Parseval: ∥un∥ℓ2≤eCT∥u0∥ℓ2\|u^n\|_{\ell^2} \leq e^{CT}\|u^0\|_{\ell^2}, confirming ℓ2\ell^2 stability.

Example: FTCS for heat equation. Substituting ujn=gneiξjΔxu_j^n = g^n e^{i\xi j\Delta x}: g=1+r(eiξΔx−2+e−iξΔx)=1−4rsin⁡2(ξΔx/2)g = 1 + r(e^{i\xi\Delta x} - 2 + e^{-i\xi\Delta x}) = 1 - 4r\sin^2(\xi\Delta x/2). For ∣g∣≤1|g| \leq 1: we need −1≤1−4rsin⁡2(ξΔx/2)≤1-1 \leq 1 - 4r\sin^2(\xi\Delta x/2) \leq 1. The right inequality is automatic. The left requires 4rsin⁡2(ξΔx/2)≤24r\sin^2(\xi\Delta x/2) \leq 2 for all ξ\xi, i.e., 4r≤24r \leq 2, giving r≤1/2r \leq 1/2. □\square

■

ExampleStability of Advection Schemes

For ut+aux=0u_t + au_x = 0 (a>0a > 0):

  • FTCS (central space): g=1−iνsin⁡(ξΔx)g = 1 - i\nu\sin(\xi\Delta x) where ν=aΔt/Δx\nu = a\Delta t/\Delta x. Then ∣g∣2=1+ν2sin⁡2(ξΔx)>1|g|^2 = 1 + \nu^2\sin^2(\xi\Delta x) > 1 for all ν>0\nu > 0. FTCS is unconditionally unstable for advection.
  • Upwind: g=1−ν(1−e−iξΔx)=1−ν+νcos⁡(ξΔx)−iνsin⁡(ξΔx)g = 1 - \nu(1 - e^{-i\xi\Delta x}) = 1 - \nu + \nu\cos(\xi\Delta x) - i\nu\sin(\xi\Delta x). Stability requires 0≤ν≤10 \leq \nu \leq 1 (CFL condition).
  • Lax-Wendroff: g=1−iνsin⁡(ξΔx)−ν2(1−cos⁡(ξΔx))g = 1 - i\nu\sin(\xi\Delta x) - \nu^2(1-\cos(\xi\Delta x)). Stable for ∣ν∣≤1|\nu| \leq 1.
RemarkLimitations of Von Neumann Analysis

Von Neumann analysis applies only to linear schemes with constant coefficients on uniform grids with periodic (or whole-space) boundary conditions. For variable coefficients, boundaries, and nonlinear problems, stability must be established by energy methods, maximum principles, or other techniques. Nevertheless, the von Neumann condition is a necessary condition even for variable-coefficient problems (the "frozen coefficient" principle).