Dynamic Programming | Set 6 (Min Cost Path)
Given a cost matrix cost[][] and a position (m, n) in cost[][], write a function that returns cost of minimum cost path to reach (m, n) from (0, 0). Each cell of the matrix represents a cost to traverse through that cell. Total cost of a path to reach (m, n) is sum of all the costs on that path (including both source and destination). You can only traverse down, right and diagonally lower cells from a given cell, i.e., from a given cell (i, j), cells (i+1, j), (i, j+1) and (i+1, j+1) can be traversed. You may assume that all costs are positive integers.
For example, in the following figure, what is the minimum cost path to (2, 2)?

The path with minimum cost is highlighted in the following figure. The path is (0, 0) –> (0, 1) –> (1, 2) –> (2, 2). The cost of the path is 8 (1 + 2 + 2 + 3).

1) Optimal Substructure
The path to reach (m, n) must be through one of the 3 cells: (m-1, n-1) or (m-1, n) or (m, n-1). So minimum cost to reach (m, n) can be written as “minimum of the 3 cells plus cost[m][n]“.
minCost(m, n) = min (minCost(m-1, n-1), minCost(m-1, n), minCost(m, n-1)) + cost[m][n]
2) Overlapping Subproblems
Following is simple recursive implementation of the MCP (Minimum Cost Path) problem. The implementation simply follows the recursive structure mentioned above.
/* A Naive recursive implementation of MCP(Minimum Cost Path) problem */
#include<stdio.h>
#include<limits.h>
#define R 3
#define C 3
int min(int x, int y, int z);
/* Returns cost of minimum cost path from (0,0) to (m, n) in mat[R][C]*/
int minCost(int cost[R][C], int m, int n)
{
if (n < 0 || m < 0)
return INT_MAX;
else if (m == 0 && n == 0)
return cost[m][n];
else
return cost[m][n] + min( minCost(cost, m-1, n-1),
minCost(cost, m-1, n),
minCost(cost, m, n-1) );
}
/* A utility function that returns minimum of 3 integers */
int min(int x, int y, int z)
{
if (x < y)
return (x < z)? x : z;
else
return (y < z)? y : z;
}
/* Driver program to test above functions */
int main()
{
int cost[R][C] = { {1, 2, 3},
{4, 8, 2},
{1, 5, 3} };
printf(" %d ", minCost(cost, 2, 2));
return 0;
}
It should be noted that the above function computes the same subproblems again and again. See the following recursion tree, there are many nodes which apear more than once. Time complexity of this naive recursive solution is exponential and it is terribly slow.
mC refers to minCost()
mC(2, 2)
/ | \
/ | \
mC(1, 1) mC(1, 2) mC(2, 1)
/ | \ / | \ / | \
/ | \ / | \ / | \
mC(0,0) mC(0,1) mC(1,0) mC(0,1) mC(0,2) mC(1,1) mC(1,0) mC(1,1) mC(2,0)
So the MCP problem has both properties (see this and this) of a dynamic programming problem. Like other typical Dynamic Programming(DP) problems, recomputations of same subproblems can be avoided by constructing a temporary array tc[][] in bottom up manner.
/* Dynamic Programming implementation of MCP problem */
#include<stdio.h>
#include<limits.h>
#define R 3
#define C 3
int min(int x, int y, int z);
int minCost(int cost[R][C], int m, int n)
{
int i, j;
// Instead of following line, we can use int tc[m+1][n+1] or
// dynamically allocate memoery to save space. The following line is
// used to keep te program simple and make it working on all compilers.
int tc[R][C];
tc[0][0] = cost[0][0];
/* Initialize first column of total cost(tc) array */
for (i = 1; i <= m; i++)
tc[i][0] = tc[i-1][0] + cost[i][0];
/* Initialize first row of tc array */
for (j = 1; j <= n; j++)
tc[0][j] = tc[0][j-1] + cost[0][j];
/* Construct rest of the tc array */
for (i = 1; i <= m; i++)
for (j = 1; j <= n; j++)
tc[i][j] = min(tc[i-1][j-1], tc[i-1][j], tc[i][j-1]) + cost[i][j];
return tc[m][n];
}
/* A utility function that returns minimum of 3 integers */
int min(int x, int y, int z)
{
if (x < y)
return (x < z)? x : z;
else
return (y < z)? y : z;
}
/* Driver program to test above functions */
int main()
{
int cost[R][C] = { {1, 2, 3},
{4, 8, 2},
{1, 5, 3} };
printf(" %d ", minCost(cost, 2, 2));
return 0;
}
Time Complexity of the DP implementation is O(mn) which is much better than Naive Recursive implementation.
Please write comments if you find anything incorrect, or you want to share more information about the topic discussed above.
What if the array is as defined below:
/* Paste your code here (You may delete these lines if not writing code) */ int cost[R][C] = { {1, 2, 3}, {4, 1, 2}, {1, 5, 3} };Then the path cost using the code below for the top row would be wrong as we have a shorter path (1,1,3) not (1,2,3)
/* Paste your code here (You may delete these lines if not writing code) */ /* Initialize first row of tc array */ for (j = 1; j <= n; j++) tc[0][j] = tc[0][j-1] + cost[0][j];Sandy,
Read this line "You can only traverse down, right and diagonally lower cells from a given cell, i.e., from a given cell (i, j), cells (i+1, j), (i, j+1) and (i+1, j+1) can be traversed" . I think now initializing 1st row an d 1st col makes sense
What if we can traverse diagonally upper cells..?
What modification can be done in above solution to solve the problem...
This is an straight forward application of : Maximum size square sub-matrix with all 1s .
Provided that we have a 16x16 matrix, would this algorithm work? I was thinking of using this algorithm on 6 threads and then synchronizing them back which would yield the best path.. Am I wrong?
In the question it is mentioned "... You may assume that all costs are positive integers.". Do we need this assumption? Don't the method work even with negative values since we have no cycles.
How can we print the entire path in addition to the min cost.
plzz help
You guys rock. provide excellent free content
so happy to find your site, many other costly prep books out there don't even stand for what you provide free.
@anmol: Thanks for the nice comments. Keep visiting us and keep contributing.
what if you can also go UP? What will it change the problem, and what is the time complexity of the naive recursion approach?
See this comment for time complexity. Considering that all costs are positive, would we ever go up (or back) if are allowed to?
can you plz also expand to neg cost, and go up is possible? That will make the problem a lot more interesting. will the time complexity be exponential?
Sure, sounds interesting. One way to solve is to apply Bellman Ford algorithm. You can create a thread on forum (using the Ask a Question page) for more inputs from other geeks.
This is similar to Dijekstra's shortest path algo. Isn't it?
You can say similar as both are DP based and both are for min cost path, but Dijkstra is more complex than this. Dijkstra is for a any graph with non-negative edges. Let me know your thoughts.
Adding to it, the time complexity if done using Dijkstra based on a Priority Queue would be O(E log V) => O(3*mn log mn), in the above case.
Correct me if I'm wrong.
@praveen, It is more analogous to edit distance problem. For complete details review our Dynamic Programming problems list.
Good one. What is the time complexity of naive recursive solution?
Time complexity is O(3^n). The recursion tree is a complete ternary tree of height 3.
Thanks Kartik