Replace stub with full prose covering the stationary equation, long-run frequency interpretation, irreducibility and aperiodicity, a worked 2×2 analytical solution for the weather chain, and a power iteration pseudocode + Rust sketch.
Survey PageRank, MCMC, HMMs, RL, bioinformatics, queueing theory, and language models; add annotated reading list and Rust ecosystem pointers.