# Divide and Conquer | Set 5 (Strassen’s Matrix Multiplication)

Given two square matrices A and B of size n x n each, find their multiplication matrix.

**Naive Method**

Following is a simple way to multiply two matrices.

`void` `multiply(` `int` `A[][N], ` `int` `B[][N], ` `int` `C[][N]) ` `{ ` ` ` `for` `(` `int` `i = 0; i < N; i++) ` ` ` `{ ` ` ` `for` `(` `int` `j = 0; j < N; j++) ` ` ` `{ ` ` ` `C[i][j] = 0; ` ` ` `for` `(` `int` `k = 0; k < N; k++) ` ` ` `{ ` ` ` `C[i][j] += A[i][k]*B[k][j]; ` ` ` `} ` ` ` `} ` ` ` `} ` `} ` |

*chevron_right*

*filter_none*

Time Complexity of above method is O(N^{3}).

**Divide and Conquer**

Following is simple Divide and Conquer method to multiply two square matrices.

1) Divide matrices A and B in 4 sub-matrices of size N/2 x N/2 as shown in the below diagram.

2) Calculate following values recursively. ae + bg, af + bh, ce + dg and cf + dh.

In the above method, we do 8 multiplications for matrices of size N/2 x N/2 and 4 additions. Addition of two matrices takes O(N^{2}) time. So the time complexity can be written as

T(N) = 8T(N/2) + O(N^{2}) From Master's Theorem, time complexity of above method is O(N^{3}) which is unfortunately same as the above naive method.

**Simple Divide and Conquer also leads to O(N ^{3}), can there be a better way?**

In the above divide and conquer method, the main component for high time complexity is 8 recursive calls. The idea of

**Strassen’s method**is to reduce the number of recursive calls to 7. Strassen’s method is similar to above simple divide and conquer method in the sense that this method also divide matrices to sub-matrices of size N/2 x N/2 as shown in the above diagram, but in Strassen’s method, the four sub-matrices of result are calculated using following formulae.

**Time Complexity of Strassen’s Method**

Addition and Subtraction of two matrices takes O(N^{2}) time. So time complexity can be written as

T(N) = 7T(N/2) + O(N^{2}) From Master's Theorem, time complexity of above method is O(N^{Log7}) which is approximately O(N^{2.8074})

Generally Strassen’s Method is not preferred for practical applications for following reasons.

1) The constants used in Strassen’s method are high and for a typical application Naive method works better.

2) For Sparse matrices, there are better methods especially designed for them.

3) The submatrices in recursion take extra space.

4) Because of the limited precision of computer arithmetic on noninteger values, larger errors accumulate in Strassen’s algorithm than in Naive Method (Source: CLRS Book)

**
**

`# Version 3.6 ` ` ` `import` `numpy as np ` ` ` `def` `split(matrix): ` ` ` `""" ` ` ` `Splits a given matrix into quarters. ` ` ` `Input: nxn matrix ` ` ` `Output: tuple containing 4 n/2 x n/2 matrices corresponding to a, b, c, d ` ` ` `"""` ` ` `row, col ` `=` `matrix.shape ` ` ` `row2, col2 ` `=` `row` `/` `/` `2` `, col` `/` `/` `2` ` ` `return` `matrix[:row2, :col2], matrix[:row2, col2:], matrix[row2:, :col2], matrix[row2:, col2:] ` ` ` `def` `strassen(x, y): ` ` ` `""" ` ` ` `Computes matrix product by divide and conquer approach, recursively. ` ` ` `Input: nxn matrices x and y ` ` ` `Output: nxn matrix, product of x and y ` ` ` `"""` ` ` ` ` `# Base case when size of matrices is 1x1 ` ` ` `if` `len` `(x) ` `=` `=` `1` `: ` ` ` `return` `x ` `*` `y ` ` ` ` ` `# Splitting the matrices into quadrants. This will be done recursively ` ` ` `# untill the base case is reached. ` ` ` `a, b, c, d ` `=` `split(x) ` ` ` `e, f, g, h ` `=` `split(y) ` ` ` ` ` `# Computing the 7 products, recursively (p1, p2...p7) ` ` ` `p1 ` `=` `strassen(a, f ` `-` `h) ` ` ` `p2 ` `=` `strassen(a ` `+` `b, h) ` ` ` `p3 ` `=` `strassen(c ` `+` `d, e) ` ` ` `p4 ` `=` `strassen(d, g ` `-` `e) ` ` ` `p5 ` `=` `strassen(a ` `+` `d, e ` `+` `h) ` ` ` `p6 ` `=` `strassen(b ` `-` `d, g ` `+` `h) ` ` ` `p7 ` `=` `strassen(a ` `-` `c, e ` `+` `f) ` ` ` ` ` `# Computing the values of the 4 quadrants of the final matrix c ` ` ` `c11 ` `=` `p5 ` `+` `p4 ` `-` `p2 ` `+` `p6 ` ` ` `c12 ` `=` `p1 ` `+` `p2 ` ` ` `c21 ` `=` `p3 ` `+` `p4 ` ` ` `c22 ` `=` `p1 ` `+` `p5 ` `-` `p3 ` `-` `p7 ` ` ` ` ` `# Combining the 4 quadrants into a single matrix by stacking horizontally and vertically. ` ` ` `c ` `=` `np.vstack((np.hstack((c11, c12)), np.hstack((c21, c22)))) ` ` ` ` ` `return` `c ` |

*chevron_right*

*filter_none*

**Easy way to remember Strassen’s Matrix Equation**

**References:**

Introduction to Algorithms 3rd Edition by Clifford Stein, Thomas H. Cormen, Charles E. Leiserson, Ronald L. Rivest

https://www.youtube.com/watch?v=LOLebQ8nKHA

https://www.youtube.com/watch?v=QXY4RskLQcI

Please write comments if you find anything incorrect, or you want to share more information about the topic discussed above

Don’t stop now and take your learning to the next level. Learn all the important concepts of Data Structures and Algorithms with the help of the most trusted course: **DSA Self Paced**. Become industry ready at a student-friendly price.

## Recommended Posts:

- Karatsuba algorithm for fast multiplication using Divide and Conquer algorithm
- Dynamic Programming vs Divide-and-Conquer
- Divide and Conquer Algorithm | Introduction
- Sum of maximum of all subarrays | Divide and Conquer
- Maximum Sum SubArray using Divide and Conquer | Set 2
- Frequency of an integer in the given array using Divide and Conquer
- Convex Hull using Divide and Conquer Algorithm
- Maximum Subarray Sum using Divide and Conquer algorithm
- Tiling Problem using Divide and Conquer algorithm
- The Skyline Problem using Divide and Conquer algorithm
- Advanced master theorem for divide and conquer recurrences
- Longest Common Prefix using Divide and Conquer Algorithm
- Closest Pair of Points using Divide and Conquer algorithm
- Merge K sorted arrays | Set 3 ( Using Divide and Conquer Approach )
- Generate a random permutation of elements from range [L, R] (Divide and Conquer)
- Merge K sorted arrays of different sizes | ( Divide and Conquer Approach )
- Search in a Row-wise and Column-wise Sorted 2D Array using Divide and Conquer algorithm
- Matrix Multiplication | Recursive
- Matrix Chain Multiplication | DP-8
- Multiplication of Matrix using threads