ProofComplete

Proof of Von Neumann Stability Analysis

Von Neumann stability analysis is the standard tool for determining stability of finite difference schemes for linear PDEs with constant coefficients. The method uses Fourier analysis to decompose the error into independent modes.


Statement

Theorem8.3Von Neumann Stability Criterion

Consider a finite difference scheme for a linear PDE with constant coefficients on a uniform grid, with periodic boundary conditions. The scheme is stable (in the 2\ell^2 norm) if and only if the amplification factor g(ξ)g(\xi) satisfies g(ξ)1+CΔt|g(\xi)| \leq 1 + C\Delta t for all frequencies ξ[π,π]\xi \in [-\pi, \pi] and some constant CC independent of Δt\Delta t and Δx\Delta x. For practical purposes, the condition g(ξ)1|g(\xi)| \leq 1 for all ξ\xi (the von Neumann condition) is equivalent to stability for dissipative schemes.


Proof

Proof

Fourier decomposition. On a periodic grid with NN points and spacing Δx\Delta x, any grid function ujnu_j^n can be written as a discrete Fourier series: ujn=k=N/2N/21u^kneiξkjΔxu_j^n = \sum_{k=-N/2}^{N/2-1} \hat{u}_k^n e^{i\xi_k j\Delta x} where ξk=2πk/(NΔx)\xi_k = 2\pi k/(N\Delta x).

Linearity and constant coefficients. For a linear scheme with constant coefficients, Fourier modes decouple: if uj0=eiξjΔxu_j^0 = e^{i\xi j\Delta x}, then ujn=g(ξ)neiξjΔxu_j^n = g(\xi)^n e^{i\xi j\Delta x} where g(ξ)g(\xi) is the amplification factor, obtained by substituting ujn=gneiξjΔxu_j^n = g^n e^{i\xi j\Delta x} into the scheme.

Stability \Leftrightarrow bounded amplification. By Parseval's theorem: un22=NΔxku^kn2=NΔxkg(ξk)2nu^k02\|u^n\|_{\ell^2}^2 = N\Delta x \sum_k |\hat{u}_k^n|^2 = N\Delta x \sum_k |g(\xi_k)|^{2n}|\hat{u}_k^0|^2.

(i) Necessity. If g(ξ0)>1+CΔt|g(\xi_0)| > 1 + C\Delta t for some ξ0\xi_0, choose u0=eiξ0jhu_0 = e^{i\xi_0 jh}. Then un2=g(ξ0)nu02\|u^n\|_{\ell^2} = |g(\xi_0)|^n \|u^0\|_{\ell^2}. For n=T/Δtn = T/\Delta t: g(ξ0)n>(1+CΔt)T/ΔteCT|g(\xi_0)|^n > (1 + C\Delta t)^{T/\Delta t} \to e^{CT}, which is bounded. But if g(ξ0)>1+CΔt|g(\xi_0)| > 1 + C\Delta t with CC growing as Δt0\Delta t \to 0, the bound diverges. Specifically, if g(ξ0)1+α/Δt|g(\xi_0)| \geq 1 + \alpha/\Delta t for some α>0\alpha > 0, then gneαn/Δt=eαT/(Δt)2|g|^n \sim e^{\alpha n/\Delta t} = e^{\alpha T/(\Delta t)^2} \to \infty, violating stability.

(ii) Sufficiency. If g(ξ)1+CΔt|g(\xi)| \leq 1 + C\Delta t for all ξ\xi, then g(ξ)n(1+CΔt)T/ΔteCT|g(\xi)|^n \leq (1 + C\Delta t)^{T/\Delta t} \leq e^{CT} for nΔtTn\Delta t \leq T. By Parseval: un2eCTu02\|u^n\|_{\ell^2} \leq e^{CT}\|u^0\|_{\ell^2}, confirming 2\ell^2 stability.

Example: FTCS for heat equation. Substituting ujn=gneiξjΔxu_j^n = g^n e^{i\xi j\Delta x}: g=1+r(eiξΔx2+eiξΔx)=14rsin2(ξΔx/2)g = 1 + r(e^{i\xi\Delta x} - 2 + e^{-i\xi\Delta x}) = 1 - 4r\sin^2(\xi\Delta x/2). For g1|g| \leq 1: we need 114rsin2(ξΔx/2)1-1 \leq 1 - 4r\sin^2(\xi\Delta x/2) \leq 1. The right inequality is automatic. The left requires 4rsin2(ξΔx/2)24r\sin^2(\xi\Delta x/2) \leq 2 for all ξ\xi, i.e., 4r24r \leq 2, giving r1/2r \leq 1/2. \square


ExampleStability of Advection Schemes

For ut+aux=0u_t + au_x = 0 (a>0a > 0):

  • FTCS (central space): g=1iνsin(ξΔx)g = 1 - i\nu\sin(\xi\Delta x) where ν=aΔt/Δx\nu = a\Delta t/\Delta x. Then g2=1+ν2sin2(ξΔx)>1|g|^2 = 1 + \nu^2\sin^2(\xi\Delta x) > 1 for all ν>0\nu > 0. FTCS is unconditionally unstable for advection.
  • Upwind: g=1ν(1eiξΔx)=1ν+νcos(ξΔx)iνsin(ξΔx)g = 1 - \nu(1 - e^{-i\xi\Delta x}) = 1 - \nu + \nu\cos(\xi\Delta x) - i\nu\sin(\xi\Delta x). Stability requires 0ν10 \leq \nu \leq 1 (CFL condition).
  • Lax-Wendroff: g=1iνsin(ξΔx)ν2(1cos(ξΔx))g = 1 - i\nu\sin(\xi\Delta x) - \nu^2(1-\cos(\xi\Delta x)). Stable for ν1|\nu| \leq 1.
RemarkLimitations of Von Neumann Analysis

Von Neumann analysis applies only to linear schemes with constant coefficients on uniform grids with periodic (or whole-space) boundary conditions. For variable coefficients, boundaries, and nonlinear problems, stability must be established by energy methods, maximum principles, or other techniques. Nevertheless, the von Neumann condition is a necessary condition even for variable-coefficient problems (the "frozen coefficient" principle).