We are quite aware that the Standard deviations are for measuring the spread of the numbers in the datasets. The smaller standard deviations suggest that the deviations in the elements are very small or quite insignificant from the mean values of the data sets & the larger deviations suggest a significant or large spread of the items from their mean values in the data sets.
We can compute standard deviations using Python, we will see that here. In Python 3.x we get enormous libraries for the statistical computations. Python’s statistics is a built-in Python library for descriptive statistics. We can use it if our datasets are not too large or if we cannot simply depend on importing other libraries.
Pooled Standard Deviation:
The Pooled Standard Deviation is a weighted average of standard deviations for two or more groups. The individual standard deviations are averaged, with more “weight” given to larger sample sizes.
This is Cohen’s alternative formula here for reference:
SDpooled = √((n1-1).SD12 + (n2-1).SD22)/(n1+n2-2)
- SD1 = Standard Deviation for group 1
- SD2 = Standard Deviation for group 2
- n1 = Sample Size for group 1
- n2 = Sample Size for group 2
For equal-sized samples, it simply becomes,
SDpooled = √(SD12 + SD22)/2
Step for calculation:
- Import statistics (for python standard deviation libraries)
- Import math (to calculate the sqrt)
- Determine the length of the samples using the len function in python (say n1 = len(sample1))
- Calculate the standard deviation of the samples (exg. sample1, using statistics.stdev(sample1))
- Finally calculate the Pooled standard Deviation of the samples using the formula.
Pooled standard deviation = √ (n1-1)sample12 + (n2-1)sample22 / (n1+n2-2)
Note: If the samples are empty, StatisticsError will be raised.
Step 1: let us try this with an example :
- Firstly we import the required modules.
- Then, let’s say, we have two samples, sample1 = [4, 5, 6] and sample2 = [10, 12, 14, 16, 18, 20]. Now, statistics.stdev(sample1) calculates the standard deviation for it(basically the statistics.stdev() function computes sample standard deviation on a list of values in Python).
Standard Deviation for 1st sample = 1.0 Standard Deviation for 2nd sample = 3.7416573867739413
Step 2: Then, let’s calculate the length of the samples using the len function in Python
sample1 : length = 3 | S.D. = 1.0 sample2 : length = 6 | S.D. = 3.7416573867739413
Step 3: Finally, we calculate the Pooled Standard Deviation by using the formula stated above.
Pooled Standard Deviation = 3.2071349029490928
Attention geek! Strengthen your foundations with the Python Programming Foundation Course and learn the basics.
To begin with, your interview preparations Enhance your Data Structures concepts with the Python DS Course. And to begin with your Machine Learning Journey, join the Machine Learning – Basic Level Course