How Do We Use Eigenvectors?

Using eigen-axes to model matrices


Topics Covered



In the previous page you saw that once we have an eigenvector, every vector on the same line through the origin is also an eigenvector with the same eigenvalue:

T(v)=λv  means that  T(cv)=cT(v)=c(λv)=λ(cv).T(\vec{v}) = \lambda \vec{v} \ \text{ means that } \ T(c\vec{v})=cT(\vec{v})=c (\lambda \vec{v}) = \lambda (c\vec{v}).

You also saw the different arrangements of eigen-axes available for a 2×22 \times 2 matrix. In this page, you will see how we use those eigen-axes to model what happens to every vector in R2\mathbb{R}^2.





Case 1: Regular axes

Eigen-axes are incredibly useful for modeling what matrices do to vectors. To see this clearly, we'll start with the very nice case where the eigen-axes are the xx-axis and yy-axis.


Eigen-axes are the regular axes

Scaling the coordinates by the eigenvalues gives a very natural way to model what the matrix is doing.


Example 1: λx=4\lambda_x = 4 and λy=2\lambda_y = 2

Everything on the x-axis is scaled by 4
Everything on the x-axis is scaled by 4


Example 2: λx=1\lambda_x = 1 and λy=1\lambda_y = -1

Everything on the x-axis is scaled by 1
Everything on the x-axis is scaled by 1


Example 3: Matrix powers, λx=1.1\lambda_x = 1.1 and λy=34\lambda_y = -\frac{3}{4}

One application of A: x grows by 10% and y shrinks by 25%
One application of A: x grows by 10% and y shrinks by 25%



Problem 1: Using eigen-axes to model repeated applications of a matrix

If λx=1\lambda_x = 1 and λy=12\lambda_y = -\frac{1}{2} for a matrix AA, what does A3A^3 do the vector [58]\begin{bmatrix} 5 \\ 8 \end{bmatrix}?





Case 2: Different Axes

Different eigen-axes

Even when the axes are different from the standard x and y axes, we can still use them to model what a matrix does. We just treat one eigen-axis as the new x-axis and the other like the new y-axis.


Example 1: λx=3\lambda_x = 3 and λy=2\lambda_y = 2

Everything on this axis scales by 3
Everything on this axis scales by 3


Problem 2: Using eigen-coordinates

The matrix in this question has the same eigenvalues as before, λ=2\lambda=2 and λ=3\lambda=3, but the eigen-axes are slightly different. They are the spans of [11]\begin{bmatrix} 1 \\ 1 \end{bmatrix} and [11].\begin{bmatrix} -1 \\ 1 \end{bmatrix}. Using the diagram below, find AvA \vec{v} for the vector v=[53]\vec{v} = \begin{bmatrix} 5 \\ 3 \end{bmatrix}.

Here is v with its eigen-components
Here is v with its eigen-components




Application: Fibonnaci Numbers and the Golden Ratio

We are told that ratios of consecutive Fibonacci numbers approach the Golden Ratio.

limnFnFn1=φ.\lim_{n\rightarrow \infty} \frac{F_n}{F_{n-1}} = \varphi.

Let's examine this claim, representing these ratios as points with adjacent Fibonacci number coordinates. Our graphs will have the xx and yy axes switched so that a vector of the form [yx]\begin{bmatrix} y \\ x \end{bmatrix} lies on the line with slope yx.\frac{y}{x}.

We start with just the first Fibonacci number.
We start with just the first Fibonacci number.



There is an easy way to generate these Fibonacci pairs, using a matrix A=[1110]A = \begin{bmatrix} 1 & 1 \\ 1 & 0 \end{bmatrix} with just 0's and 1's. The top row of AA gets us Fn+1F_{n+1} by adding the previous Fibonacci pair together:

Fn+1=1Fn+1Fn1.F_{n+1} = 1 \cdot F_n + 1 \cdot F_{n-1}.

The bottom row of AA moves FnF_n to the bottom entry.

[1110][FnFn1]=[1Fn+1Fn11Fn+0Fn1]=[Fn+1Fn] \begin{bmatrix} 1 & 1 \\ 1 & 0 \end{bmatrix} \begin{bmatrix} F_n \\ F_{n-1} \end{bmatrix} = \begin{bmatrix} 1 \cdot F_n + 1 \cdot F_{n-1} \\ 1 \cdot F_n + 0 \cdot F_{n-1} \end{bmatrix} = \begin{bmatrix} F_{n+1} \\ F_n \end{bmatrix}

And there we go! The Fibonacci pairs are generated by powers of this matrix AA:

[1110]n[10]=[Fn+1Fn] \begin{bmatrix} 1 & 1 \\ 1 & 0 \end{bmatrix}^n \begin{bmatrix} 1 \\ 0 \end{bmatrix} = \begin{bmatrix} F_{n+1} \\ F_n \end{bmatrix}
n=1
n=1


Now let's use the eigen-axes of AA. It may not surprise you that one of these eigen-axes is a line whose slope is the golden ratio φ\varphi. As a quick reminder,

φ=1+521.62 \varphi = \frac{1 + \sqrt{5}}{2} \approx 1.62

The other eigen-axis is a line whose slope is the conjugate of the golden ratio,

φ=1520.62.\overline{\varphi} = \frac{1-\sqrt{5}}{2} \approx -0.62.

Now here is something really neat about this setup. Not only is the golden ratio the slope of the first eigen-axis, but it is also the eigenvalue. Similarly, φ\overline{\varphi} is also the eigenvalue for the second eigen-axis as well as its slope.

Eigen-axes
Eigen-axes


In conclusion, eigen-axes can be used to see the long-term behavior of these Fibonacci pairs. Because φ1.62\varphi \approx 1.62 and φ0.62\overline{\varphi} \approx -0.62, the first component grows by about 62% and the second shrinks by about 38% every time AA is applied, leading to rapid exponential growth along the first eigen-axis and rapid exponential decay along the second.

So it's easy to see why these ratios of Fibonacci numbers quickly approach the golden ratio. What I think is far more illuminating is that there was nothing magical about the Fibonacci sequence in particular! This same behavior occurs when you start with any two distinct integers. You can see this if you like by going back to the figure above, zooming back in to original blue point and dragging it around. The only thing connecting Fibonacci numbers to the Golden ratio is the matrix [1110]\begin{bmatrix} 1 & 1 \\ 1 & 0 \end{bmatrix}, which encodes the recurrence relation Fn+1=Fn+Fn1F_{n+1} = F_n + F_{n-1}.





Case 3: Eigen-axes that are not perpendicular

So far, you have only seen examples of eigen-axes that are perpendicular. I did this to ease the transition from the regular xx and yy axes to these new ones. But they don't have to be perpendicular. We'll end this mostly-visual exploration of eigen-axis usage with a non-perpendicular example.

New Eigen-axes
New Eigen-axes


You might sense another question coming that asks you to find the eigen-coordinates for a given vector. But you're about to see how to compute them with a nice, easy trick. Instead, this is a great time to point out that when then eigen-axes aren't perpendicular you get some unexpected behavior from the matrix. The eigenvalues are only 2 and -1, so it doesn't seem like the output should get much bigger than the input.

v can point in any direction, but must have magnitude 1.
v can point in any direction, but must have magnitude 1.






Other Cases


What happens when we don't have 2 eigen-axes?

This means one of two things:


In the case of no eigenvectors, we can extend our scalars to complex numbers and model the stretch and a rotation that a matrix does to every vector.


In the case of only one eigen-axis, we can extend our single axis of eigenvectors to a more general notion of eigenvector. This extension has a very nice parallel to repeated roots in differential equations.


Both extension methods are very closely related to how they will be used in Differential Equations, so they will be covered there. See complex conjugate roots and repeated roots for first order linear systems.


In the meantime, you will see a short page on how to compute eigen-coordinates and then the fundamental connection of eigenvectors to differential equations.