What are Eigenvectors?

Getting a better understanding


Topics Covered



In studying something, it often helps to start with its definition.

Definition of an Eigenvector

An eigenvector for a linear operator with matrix AA, is a non-zero vector v\vec{v} such that:

Av=λvA\vec{v} = \lambda \vec{v}

for some λR\lambda \in \mathbb{R}.


What does the definition mean?

This means that the matrix AA is scaling v\vec{v}. This means stretching, shrinking, or sometimes even reflecting v\vec{v} to go in the opposite direction.








Problem 1: Finding a Matrix that Scales Everything

Find the right entries for the matrix AA such that AA scales every input v\vec{v} by λ=2.\lambda = 2. Follow the pictures and descriptions below.

Every vector must be doubled by the matrix A, not just some of them.
Every vector must be doubled by the matrix A, not just some of them.


When you have the right matrix entries, enter them here.








Eigenvectors are Rare

Most vectors you put into most matrices do not come out parallel to themselves. Eigenvectors are the exception.


Example 1: A matrix with no eigenvectors

The matrix A=[1.170.760.761.17]A = \begin{bmatrix} 1.17 & -0.76 \\ 0.76 & 1.17 \end{bmatrix} has no eigenvectors. See some examples for yourself below. In the last frame you can drag the vector v\vec{v} around and confirm. There is a fixed, non-zero angle between every vector and its image.

X-axis: Not parallel
X-axis: Not parallel

Fun fact: Every 2x2 matrix with no eigenvectors like this one is multiplication by a complex number.


Example 2: Axes Only

In this example AA is a diagonal matrix. The x-axis and y-axis are comprised of eigenvectors but nothing else.

X-axis: Eigenvector with the same direction
X-axis: Eigenvector with the same direction

Fun fact: Most 2x2 matrices have two eigen-axes like these. But they may not be as easy to find as the x-axis and y-axis, and they may not even be perpendicular to each other.








Problem 2: Finding an Eigenvector with no computation

Below is a linear transformation given by an unknown 2x2 matrix.

Enter the eigenvector you found below.








Recap: All Possible Eigenvector Arrangements

The very first example you saw consisted of a matrix with the same values on the diagonal:

A=[λ00λ]. A = \begin{bmatrix} \lambda & 0 \\ 0 & \lambda \end{bmatrix}.

These are the only matrices where every non-zero vector is an eigenvector. For every other kind of matrix we either get eigen-axes or no eigenvectors at all. I would like to show you a visualization for each type, but first we need to tweak the way we see these vectors a little bit. Instead of every vector v\vec{v} coming from the origin, we will just represent v\vec{v} as a point. The image, AvA\vec{v}, will be a vector coming out of that point. This way we can look at lots of vector pairs at the same time.

Multi-vector perspective: v's are points, Av's are arrows from those points
Multi-vector perspective: v's are points, Av's are arrows from those points


Vector Scaling Issue

There is one small but important caveat for the pictures above: The orange output vectors were not scaled properly. Proper scaling would have quickly lead to giant orange overlapping vectors as we travelled out from the origin, since outputs are proportional to inputs when in the same direction. Each orange vector was displayed as a unit vector version of its self. For example, the two eigen axes is photo #4 above have different eigenvalues, but their arrows are all the same size.

  • Question: Can you tell just from looking at the picture if those eigenvalues are positive or negative?
  • Question: Which eigen-axis do you think has the bigger eigenvalue?

Fun fact: In higher dimensions, eigen-axes can become planes or even hyper-planes. The more general term of "eigenspace" is used.



Conclusion

You should now have a solid idea about what eigenvectors, eigenvalues, and eigen-axes look like for a 2x2 matrix.

These will play a key role in classifying and solving homogeneous first order linear systems of differential equations.

Next, we will cover the two big question that remain on the topic of eigenvectors.

  • How are eigenvectors used?
  • How they are computed?