Eigenvalues

Eigenvalues and Eigenvectors are the scalar and vector quantities associated with Matrix used for linear transformation. The vector that does not change even after applying transformations is called the Eigenvector and the scalar value attached to Eigenvectors is called Eigenvalues. Eigenvectors are the vectors that are associated with a set of linear equations. For a matrix, eigenvectors are also called characteristic vectors, and we can find the eigenvector of only square matrices. Eigenvectors are very useful in solving various problems of matrices and differential equations.

In this article, we will learn about eigenvalues, eigenvectors for matrices, and others with examples.

What are Eigenvalues?

Eigenvalues are the scalar values associated with the eigenvectors in linear transformation. The word ‘Eigen’ is of German Origin which means ‘characteristic’. Hence, these are the characteristic value that indicates the factor by which eigenvectors are stretched in their direction. It doesn’t involve the change in the direction of the vector except when the eigenvalue is negative. When the eigenvalue is negative the direction is just reversed. The equation for eigenvalue is given by

Av = λv

where A is the matrix

v is associated eigenvector

λ is scalar eigenvalue

What are Eigenvectors?

Eigenvectors for square matrices are defined as non-zero vector values which when multiplied by the square matrices give the scaler multiple of the vector, i.e. we define an eigenvector for matrix A to be “v” if it specifies the condition, Av = λv

The scaler multiple λ in the above case is called the eigenvalue of the square matrix. We always have to find the eigenvalues of the square matrix first before finding the eigenvectors of the matrix.

For any square matrix, A of order n × n the eigenvector is the column matrix of order n × 1. If we find the eigenvector of the matrix A by, Av = λv, “v” in this is called the right eigenvector of the matrix A and is always multiplied to the right-hand side as matrix multiplication is not commutative in nature. In general, when we find the eigenvector it is always the right eigenvector.

We can also find the left eigenvector of the square matrix A by using the relation, vA = vλ

Here, v is the left eigenvector and is always multiplied to the left-hand side. If matrix A is of order n × n then v is a column matrix of order 1 × n.

Eigenvector Equation

The Eigenvector equation is the equation that is used to find the eigenvector of any square matrix. The eigenvector equation is,

Av = λv

where,
A is the given square matrix
v is the eigenvector of matrix A
λ is any scaler multiple

What are Eigenvalues and Eigenvectors?

If A is a square matrix of order n × n then we can easily find the eigenvector of the square matrix by following the method discussed below,

We  know that the eigenvector is given using the equation Av = λv, for the identity matrix of order same as the order of A i.e. n × n we use the following equation,

(A-λI)v = 0

Solving the above equation we get various values of λ as λ₁, λ₂, …, λ_n these values are called the eigenvalues and we get individual eigenvectors related to each eigenvalue.

Simplifying the above equation we get v which is a column matrix of order n × 1 and v is written as,

How to Find an Eigenvector?

The eigenvector of the following square matrix can be easily calculated using the steps below,

Step 1: Find the eigenvalues of the matrix A, using the equation det |(A – λI| =0, where “I” is the identity matrix of order similar to matrix A

Step 2: The value obtained in Step 2 are named as, λ₁, λ₂, λ₃….

Step 3: Find the eigenvector (X) associated with the eigenvalue  λ₁ using the equation, (A – λ₁I) X = 0

Step 4: Repeat step 3 to find the eigenvector associated with other remaining eigenvalues λ₂, λ₃….

Following these steps gives the eigenvector related to the given square matrix.

Types of Eigenvector

The eigenvectors calculated for the square matrix are of two types which are,

• Right Eigenvector
• Left Eigenvector

Right Eigenvector

The eigenvector which is multiplied by the given square matrix from the right-hand side is called the right eigenvector. It is calculated by using the following equation,

AV_R = λV_R

where
A is given square matrix of order n×n
λ is one of the eigenvalues
V_R is the column vector matrix

The value of V_R is,

Left Eigenvector

The eigenvector which is multiplied by the given square matrix from the left-hand side is called the left eigenvector. It is calculated by using the following equation,

V_LA = V_Lλ

where
A is given square matrix of order n×n
λ is one of the eigenvalues
V_L is the row vector matrix

The value of V_L is,

V_L = [v₁, v₂, v₃,…, v_n]

Eigenvectors of a Square Matrix

We can easily find the eigenvector of square matrices of order n×n. Now, let’s find the following square matrices:

• Eigenvectors of a 2 × 2 matrix 
• Eigenvectors of a 3 × 3 matrix.

Eigenvector of a 2 × 2 matrix

The Eigenvector of the 2 × 2 matrix can be calculated using the above mention steps. An example of the same is,

Example: Find the eigenvalues and the eigenvector for the matrix A =

Solution:

If eigenvalues are represented using  λ and the eigenvector is represented as v = 

Then the eigenvector is calculated by using the equation,

|A- λI| = 0

 = 0

(1-λ)(4-λ) – 2.5 = 0

4 – λ – 4λ + λ² – 10 = 0

λ² -5λ -6 = 0

λ² -6λ + λ – 6 = 0

λ(λ-6) + 1(λ-6) = 0

(λ-6)(λ+1) = 0

λ = 6 and λ = -1

Thus, the eigenvalues are 6, and -1. Then the respective eigenvectors are,

For λ = 6

(A-λI)v = 0

 = 0

 = 0

-5a + 2b = 0

5a – 2b = 0

simplifying the above equation we get, 

5a=2b

The required eigenvector is,

For λ = -1

(A-λI)v = 0

 = 0

 = 0

2a + 2b = 0

5a + 5b = 0

simplifying the above equation we get, 

a = -b

The required eigenvector is,

Then the eigenvectors of the given 2 × 2 matrix are 

these are two possible eigen vectors but many of the corresponding multiples of these eigen vectors can also be considered as other possible eigen vectors.

Eigenvector of a 3 × 3 Matrix

The Eigenvector of the 3 × 3 matrix can be calculated using the above mention steps. An example of the same is,

Example: Find the eigenvalues and the eigenvector for the matrix A =

Solution:

If eigenvalues are represented using  λ and the eigenvector is represented as v = 

Then the eigenvector is calculated by using the equation,

|A- λI| = 0

 = 0

Simplifying the above determinant we get

(2-λ)(λ²) + 2λ² + 2λ² = 0

(-λ³) + 8λ² = 0

λ²(λ + 8) = 0

λ = 0, λ = -8

For λ = 0

(A – λI) v = 0

 = 0

 = 0

Simplifying the above equation we get

2a + 2b + 2c = 0

2(a+b+c) = 0

a+b+c = 0

Let b = k₁ and c = k₂

a + k₁ + k₂ = 0

a = -(k₁ + k₂)

Thus, the eigenvector is,

taking k₁ = 0 and k₁ = 1

the eigenvector is,

taking k₁ = 1 and k₁ = 0

the eigenvector is,

For λ = -8

(A – λI) v = 0

 = 0

 = 0

Simplifying the above equation we get

a = b = c = 0

Thus, the eigenvector is,

Eigenspace

We define the eigenspace of a matrix as the set of all the eigenvectors of the matrix. All the vectors in the eigenspace are linearly independent of each other.

To find the Eigenspace of the matrix we have to follow the following steps

Step 1: Find all the eigenvalues of the given square matrix.

Step 2: For each eigenvalue find the corresponding eigenvector.

Step 3: Take the set of all the eigenvectors (say A). The resultant set so formed is called the Eigenspace of the following vector.

From the above example of given 3 × 3 matrix A, the eigenspace so formed is{  }

Diagonalize Matrix Using Eigenvalues and Eigenvectors

Eigenvalues and Eigenvectors are used to find diagonal matrices. A diagonal matrix is a matrix which can be written as,

A = XDX^-1

where,
D is the matrix which is formed by replacing the 1’s in the identity matrix by eigenvalues.
X is the matrix formed by eigenvectors.

We can understand the concept of a diagonal matrix by taking the following example.

Example: Diagonalize the matrix A =

Solution:

We have already solved for the eigenvalues and the eigenvectors of the A =

The eigenvalues of the A are λ = 0, λ = 0, and λ = -8

The eigenvectors of A are 

Thus,

D = 

X =  

We can easily find the inverse of X as,

X^-1 = 

Read More,

• Elementary Operation on Matrices
• Identity Matrix
• Inverse of a Matrix

Solved Examples on Eigenvectors

Example 1: Find the eigenvectors of the matrix A = \begin{bmatrix}1 & 1 & 0\\0 & 1 & 1\\0 & 0 & 1\end{bmatrix}

Solution:

The eigen values of the matrix is found using,

|A – λI| = 0

 = 0

(1 – λ)³ = 0

Thus, the eigen values are,

λ = 1, 1, 1

As the all the eigenvalues are equal we have three identical eigenvectors. We will find the eigenvectors for λ = 1, using (A – λI)v = O

solving the above equation we get,

• a = K
• y = 0
• z = 0

Then the eigenvector is,

Example 2: Find the eigenvectors of the matrix A = 

Solution:

The eigen values of the matrix is found using,

|A – λI| = 0

 = 0

(5 – λ)² = 0

Thus, the eigen values are,

λ = 5, 5

As the all the eigenvalues are equal we have three identical eigenvectors. We will find the eigenvectors for λ = 1, using 

(A – λI)v = O

Simplying the above we get,

• a = 1, b = 0
• a = 0, b = 1

Then the eigenvector is,

FAQs on Eigenvectors

Q1: What are Eigenvectors?

Answer:

We define the eigenvector of any matrix as the vector which on multiplying with the matrix results in the scaler multiple of the matrix.

Q2: How to find Eigenvectors?

Answer:

Eigenvector of any matrix A is denoted by v. Eigenvector of the matrix is calculated by first finding the eigenvalue of the matrix.

• Eigenvalue of the matrix is found using the formula, |A-λI| = 0 where λ gives the eigenvalues.
• After finding eigenvalue we found eigenvector by the formula, Av = λv, where v gives the eigenvector.

Q3: What is the difference between Eigenvalue and Eigenvector?

Answer:

For any square matrix A the eigenvalues are represented by λ and it is calculated by the formula, |A – λI| = 0. After finding the eigenvalue we find the eigenvector by, Av = λv.

Q4: What is the Diagonalizable Matrix?

Answer:

Any matrix that can be expressed as the product of the three matrices as XDX^-1 is a diagonalizable matrix here D is called the diagonal matrix.

Q5: Are Eigenvalues and Eigenvectors same?

Answer:

No, Eigenvalues and Eigenvectors are not same. Eigenvalues are the scaler which is used to find eigenvectors whereas eigenvectors are the vectors that are used to find matrix vector transformations.

Q6: Can Eigenvector be a Zero Vector? 

Answer:

We can have eigenvalues be zero but the eigenvector can never be a zero vector.

Q7: What is Eigenvectors Formula?

Answer:

The eigenvector of any matrix is calculated using the formula,

Av = λv

where,
λ is the eigenvalue
v is the eigenvector