Stability Theory for ODE Solvers
Stability determines whether numerical errors grow or decay during integration. For stiff problems, the stability region of the method -- not accuracy -- dictates the step size. The interplay between order, stability, and implementation defines the practical utility of each method.
Linear Stability Analysis
Apply a numerical method to the Dahlquist test equation with , . The method produces where is the stability function. The stability region is . A method is A-stable if , meaning it is stable for all step sizes on all problems with decaying modes.
- Forward Euler: , so (disc of radius 1 centered at ).
- Backward Euler: , A-stable (entire left half-plane).
- Trapezoidal rule: , A-stable and on .
- RK4: , stability region contains approximately.
Stiffness and A-Stability
A system is stiff if it has widely separated time scales, i.e., eigenvalues of the Jacobian span several orders of magnitude with . A method is L-stable if it is A-stable and as . L-stability ensures that very stiff components () are damped, not merely bounded. Backward Euler and BDF () are L-stable; the trapezoidal rule is A-stable but not L-stable ( on ).
First Dahlquist barrier: An explicit -step method has order at most . An implicit -step method has order at most ( if is odd). Second Dahlquist barrier: No A-stable multistep method has order greater than 2. The trapezoidal rule (order 2, A-stable) is the "best" A-stable multistep method. This motivates the use of BDF methods (which trade full A-stability for higher order) and implicit Runge-Kutta methods (which can be A-stable at any order).
Convergence
A multistep method is zero-stable if the roots of its characteristic polynomial satisfy , with roots on the unit circle being simple. The Dahlquist equivalence theorem states that a consistent multistep method is convergent if and only if it is zero-stable. Convergence then has order : where is the order of the local truncation error.
The midpoint rule has characteristic polynomial with roots . Although the root has and is simple, rounding errors excite the parasitic solution , causing oscillatory instability. This is zero-stable but marginally so; in practice, the midpoint rule is always used with periodic restarts or predictor-corrector damping.