Strang's Linear Algebra and Its Applications 4e, question 5.1.19 (p. 280) asks:
It's clear that taking increasing powers of $$A = \begin{bmatrix} .8 & .3 \\ .2 & .7 \end{bmatrix}$$
yields the convergent behavior shown, and I can also see that the eigenvalues of $A^k$ are $1$ and $2^{-k}$, with the latter going to zero as $k$ approaches infinity and the matrix becomes singular.
However, I don't understand the explanation Strang provides:
There are plenty of matrices whose eigenvalues are $1$ and $.25$ that don't lie halfway between $A$ and $A^\infty$. Is there a more specific way to answer the question as posed: Why does $A^2 = \frac{1}{2}(A + A^\infty)$?
I'm assuming a full explanation rests on the fact that the eigenvectors for all powers of $A$ are the same (how do I prove this?), and somehow connects that to $A^k$'s convergent behavior.
Thank you.

