ProofComplete

Symbolic Dynamics - Key Proof

ProofProof that Entropy Equals Logarithm of Spectral Radius

We prove that for an irreducible subshift of finite type (ΣA,σ)(\Sigma_A, \sigma) with transition matrix AA, the topological entropy is htop(σ)=logλ(A)h_{top}(\sigma) = \log \lambda(A) where λ(A)\lambda(A) is the spectral radius.

Step 1: Counting periodic orbits

A period-nn orbit corresponds to a closed loop in the transition graph. The number of such loops equals tr(An)\text{tr}(A^n)—the trace of AnA^n counts walks of length nn from each state to itself.

By the spectral theorem, for large nn:

tr(An)=i=1kλinλ(A)n\text{tr}(A^n) = \sum_{i=1}^k \lambda_i^n \approx \lambda(A)^n

since λ(A)>λi\lambda(A) > |\lambda_i| for all other eigenvalues λi\lambda_i (by Perron-Frobenius).

Step 2: Entropy via orbit growth

Topological entropy measures exponential growth of distinguishable orbits. One definition is:

htop(σ)=limn1nlogNnh_{top}(\sigma) = \lim_{n \to \infty} \frac{1}{n} \log N_n

where NnN_n is the number of distinct orbit segments of length nn. For SFTs, Nn=tr(An)N_n = \text{tr}(A^n) (each allowed word of length nn corresponds to an nn-step path).

Step 3: Taking the limit

htop(σ)=limn1nlogtr(An)=limn1nlog(λ(A)n+lower order terms)h_{top}(\sigma) = \lim_{n \to \infty} \frac{1}{n} \log \text{tr}(A^n) = \lim_{n \to \infty} \frac{1}{n} \log(\lambda(A)^n + \text{lower order terms})

Since λ(A)n\lambda(A)^n dominates for large nn:

htop(σ)=limn1nnlogλ(A)=logλ(A)h_{top}(\sigma) = \lim_{n \to \infty} \frac{1}{n} \cdot n \log \lambda(A) = \log \lambda(A)

Step 4: Rigor via Perron-Frobenius

The Perron-Frobenius theorem guarantees that for irreducible AA:

  • λ(A)\lambda(A) is positive and simple
  • All other eigenvalues satisfy λi<λ(A)|\lambda_i| < \lambda(A)

This ensures the asymptotic tr(An)cλ(A)n\text{tr}(A^n) \sim c \lambda(A)^n for some constant c>0c > 0, justifying the limit calculation.

Conclusion: The topological entropy of an SFT equals the logarithm of the spectral radius of its transition matrix.

This beautiful result connects three distinct mathematical areas:

  • Dynamics: topological entropy (intrinsic complexity)
  • Linear algebra: spectral radius (largest eigenvalue)
  • Combinatorics: orbit counting (traces of matrix powers)

The proof exemplifies symbolic dynamics' power: reducing a dynamical invariant to a computable algebraic quantity.

Remark

This formula has profound implications. Entropy, typically approximated numerically for geometric systems, becomes exactly computable for symbolic systems. Moreover, algebraic properties of λ(A)\lambda(A) (rationality, algebraic degree) encode dynamical information. For instance, if λ(A)\lambda(A) is a Perron number (algebraic integer with all conjugates <λ(A)< \lambda(A) in absolute value), the shift has special rigidity properties. This interplay between dynamics and algebra continues to yield deep results.

ExampleVerification for the 2-Shift

For the full 2-shift, A=(1111)A = \begin{pmatrix} 1 & 1 \\ 1 & 1 \end{pmatrix} has eigenvalues 2 and 0. Thus λ(A)=2\lambda(A) = 2 and htop=log2h_{top} = \log 2, matching the fact that there are 2n2^n sequences of length nn (exponential growth at rate 2).

This confirms our formula in the simplest nontrivial case.

The entropy formula demonstrates that symbolic dynamics achieves what seemed impossible: exact calculation of a fundamental dynamical invariant. This precision makes symbolic methods essential for rigorous chaos theory and connects dynamics to diverse areas of mathematics through the unifying language of matrices and eigenvalues.