L U Decomposition

Last Updated : 27 Nov, 2023

LU decomposition of a matrix is the factorization of a given square matrix into two triangular matrices, one upper triangular matrix and one lower triangular matrix, such that the product of these two matrices gives the original matrix. It was introduced by Alan Turing in 1948, who also created the Turing machine. This method of factorizing a matrix as a product of two triangular matrices has various applications such as a solution of a system of equations, which itself is an integral part of many applications such as finding current in a circuit and solution of discrete dynamical system problems; finding the inverse of a matrix and finding the determinant of the matrix. Basically, the LU decomposition method comes in handy whenever it is possible to model the problem to be solved into matrix form. Conversion to the matrix form and solving with triangular matrices makes it easy to do calculations in the process of finding the solution. A square matrix A can be decomposed into two square matrices L and U such that A = L U where U is an upper triangular matrix formed as a result of applying the Gauss Elimination Method on A, and L is a lower triangular matrix with diagonal elements being equal to 1. For A = $\begin{bmatrix} a_{11} & a_{12} & a_{13} \\ a_{21} & a_{22} & a_{23} \\ a_{31} & a_{32} & a_{33} \end{bmatrix}$ , we have L = $\begin{bmatrix} 1 & 0 & 0 \\ l_{21} & 1 & 0 \\ l_{31} & l_{32} & 1 \end{bmatrix}$ and U = $\begin{bmatrix} u_{11} & u_{12} & u_{13} \\ 0 & u_{22} & u_{23} \\ 0 & 0 & u_{33} \end{bmatrix}$ ; such that A = L U. $\left[\begin{array}{lll} a_{11} & a_{12} & a_{13} \\ a_{21} & a_{22} & a_{23} \\ a_{31} & a_{32} & a_{33} \end{array}\right]=\left[\begin{array}{lll} 1 & 0 & 0 \\ l_{21} & 1 & 0 \\ l_{31} & l_{32} & 0 \end{array}\right] *\left[\begin{array}{ccc} u_{11} & u_{12} & u_{13} \\ 0 & u_{22} & u_{23} \\ 0 & 0 & u_{33} \end{array}\right]$ Here value of l₂₁ , u₁₁ etc can be compared and found. Gauss Elimination Method According to the Gauss Elimination method:

Any zero row should be at the bottom of the matrix.
The first non zero entry of each row should be on the right-hand side of the first non zero entry of the preceding row. This method reduces the matrix to row echelon form.

Steps for LU Decomposition:

Given a set of linear equations, first convert them into matrix form A X = C where A is the coefficient matrix, X is the variable matrix and C is the matrix of numbers on the right-hand side of the equations.
Now, reduce the coefficient matrix A, i.e., the matrix obtained from the coefficients of variables in all the given equations such that for ‘n’ variables we have an nXn matrix, to row echelon form using Gauss Elimination Method. The matrix so obtained is U.
To find L, we have two methods. The first one is to assume the remaining elements as some artificial variables, make equations using A = L U and solve them to find those artificial variables. The other method is that the remaining elements are the multiplier coefficients because of which the respective positions became zero in the U matrix. (This method is a little tricky to understand by words but would get clear in the example below)
Now, we have A (the nXn coefficient matrix), L (the nXn lower triangular matrix), U (the nXn upper triangular matrix), X (the nX1 matrix of variables) and C (the nX1 matrix of numbers on the right-hand side of the equations).
The given system of equations is A X = C. We substitute A = L U. Thus, we have L U X = C. We put Z = U X, where Z is a matrix or artificial variables and solve for L Z = C first and then solve for U X = Z to find X or the values of the variables, which was required.

Example: Solve the following system of equations using LU Decomposition method:

$\begin{equation*} x_1 + x_2 + x_3 = 1 \end{equation*} \begin{equation*} 4x_1 + 3x_2 - x_3 = 6 \end{equation*} \begin{equation*} 3x_1 + 5x_2 + 3x_3 = 4 \end{equation*}$

Solution: Here, we have A = $\begin{bmatrix} 1 & 1 & 1 \\ 4 & 3 & -1 \\ 3 & 5 & 3 \end{bmatrix} , X = \begin{bmatrix} x_1 \\ x_2 \\ x_3 \end{bmatrix}$ and $C = \begin{bmatrix} 1 \\ 6 \\ 4 \end{bmatrix}$ such that A X = C. Now, we first consider $\begin{bmatrix} 1 & 1 & 1 \\ 4 & 3 & -1 \\ 3 & 5 & 3 \end{bmatrix}$ and convert it to row echelon form using Gauss Elimination Method. So, by doing

(1) $\begin{equation*} R_2 \to R_2 - 4R_1 \end{equation*}$

(2) $\begin{equation*} R_3 \to R_3 - 3R_1 \end{equation*}$

we get $\begin{bmatrix} 1 & 1 & 1 \\ 4 & 3 & -1 \\ 3 & 5 & 3 \end{bmatrix} \sim$ $\begin{bmatrix} 1 & 1 & 1 \\ 0 & -1 & -5 \\ 0 & 2 & 0 \end{bmatrix}$ Now, by doing

(3) $\begin{equation*} R_3 \to R_3 - (-2)R_2 \end{equation*}$

we get $\sim \begin{bmatrix} 1 & 1 & 1 \\ 0 & -1 & -5 \\ 0 & 0 & -10 \end{bmatrix}$ (Remember to always keep ‘ – ‘ sign in between, replace ‘ + ‘ sign by two ‘ – ‘ signs) Hence, we get L = $\begin{bmatrix} 1 & 0 & 0 \\ 4 & 1 & 0 \\ 3 & -2 & 1 \end{bmatrix}$ and U = $\begin{bmatrix} 1 & 1 & 1 \\ 0 & -1 & -5 \\ 0 & 0 & -10 \end{bmatrix}$ (notice that in L matrix, $l_{21} = 4$ is from (1), $l_{31} = 3$ is from (2) and $l_{32} = -2$ is from (3)) Now, we assume Z $= \begin{bmatrix} z_1 \\ z_2 \\ z_3 \end{bmatrix}$ and solve L Z = C. $\begin{bmatrix} 1 & 0 & 0 \\ 4 & 1 & 0 \\ 3 & -2 & 1 \end{bmatrix} \begin{bmatrix} z_1 \\ z_2 \\ z_3 \end{bmatrix}$ $= \begin{bmatrix} 1 \\ 6 \\ 4 \end{bmatrix}$ So, we have $z_1 = 1 ,$ $4z_1 + z_2 = 6 ,$ $3z_1 - 2z_2 + z_3 = 4 .$ Solving, we get $z_1 = 1$ , $z_2 = 2$ and $z_3 = 5$ . Now, we solve U X = Z $\begin{bmatrix} 1 & 1 & 1 \\ 0 & -1 & -5 \\ 0 & 0 & -10 \end{bmatrix} \begin{bmatrix} x_1 \\ x_2 \\ x_3 \end{bmatrix}$ $= \begin{bmatrix} 1 \\ 2 \\ 5 \end{bmatrix}$ Therefore, we get $x_1 + x_2 + x_3 = 1 ,$ $-x_2 - 5x_3 = 2$ , $-10x_3 = 5 .$ Thus, the solution to the given system of linear equations is $x_1 = 1$ , $x_2 = 0.5$ , $x_3 = -0.5$ and hence the matrix X = $\begin{bmatrix} 1 \\ 0.5 \\ -0.5 \end{bmatrix}$ Exercise: In the LU decomposition of the matrix

| 2  2 |
| 4  9 |

, if the diagonal elements of U are both 1, then the lower diagonal entry l22 of L is (GATE CS 2015) (A) 4 (B) 5 (C) 6 (D) 7 For Solution, see https://www.geeksforgeeks.org/gate-gate-cs-2015-set-1-question-28/ This article is compiled by Nishant Arora.

Suggest improvement

Matrix Diagonalization

Finding Inverse of a Square Matrix using Cayley Hamilton Theorem in MATLAB

Share your thoughts in the comments

Matrix and Determinants

Sequence and Series

Calculus

Statistics and Numerical Methods

Probability Distribution

Engineering Math Practice Problems