In this article, we will see how to filter a Pandas DataFrame by the sum of rows or columns. This can be useful in some conditions. Let’s suppose you have a data frame consisting of customers and their purchased fruits. The rows consist of different customers and columns contain different types of fruits. You want to filter the data frame on the basis of their purchasing. To know more about filter Pandas DataFrame by column values and rows based on conditions refer to the article links. Pandas dataframe.sum() function has been used to return the sum of the values.
- Create or import the data frame
- Sum the rows: This can be done using the .sum() function and passing the parameter axis=1
- Sum the columns: By using the .sum() function and passing the parameter axis=0
- Filtering on the basis of required conditions
Filtering on basis of the sum of both rows and columns
If you want to remove the customers which did not buy any fruit or any particular fruit which was not bought by any customer. In this case, we need to filter on basis of both the values of the sum of rows or columns. Below is the code implementation of the above-proposed approach.
Filtering rows on basis of the sum of few columns
Now if we want to filter those customers who did not buy either of the fruits from a limited list, for example, customers who did not buy either grape, guava, or peach should be removed from the data frame. Here, we filter the rows on the basis of certain columns which are grape, peach, and guava in this case.
On calculating the sum of all rows for these three columns, we find the sum to be zero for indexes 2 and 3.
Filtering few columns from the entire dataset on the basis of their sum
If you want to remove any of the columns from a list of columns that has sum equals to zero. We only sum those columns and apply the condition on them.
In this way, we can modify our data frame in Pandas according to some situations by applying some conditions on rows and columns.
Attention geek! Strengthen your foundations with the Python Programming Foundation Course and learn the basics.
To begin with, your interview preparations Enhance your Data Structures concepts with the Python DS Course. And to begin with your Machine Learning Journey, join the Machine Learning – Basic Level Course