Open In App

Central Limit Theorem

Improve
Improve
Like Article
Like
Save
Share
Report

Central Limit Theorem in Statistics states that as the sample size increases and its variance is finite, then the distribution of the sample mean approaches normal distribution irrespective of the shape of the population distribution. The query that how much the sample size should increase can be answered that if the sample size is greater than 30 then the statement of the Central Limit Theorem holds true.

In this article on Central Limit Theorem, we will about the definition of the Central Limit Theorem, its example, the Central Limit Theorem Formula, its proof, and its applications.

What is Central Limit Theorem?

Central Limit Theorem explains that the sample distribution of the sample mean resembles the normal distribution irrespective of the fact that whether the variables themselves are distributed normally or not. Central Limit Theorem is often called CLT in abbreviated form.

Central Limit Theorem Definition

Central Limit Theorem states that when large samples usually greater than thirty are taken into consideration then the distribution of sample arithmetic mean approaches the normal distribution irrespective of the fact that random variables were originally distributed normally or not.

Central Limit Theorem Explanation

Let’s say we have a large sample of observations and each sample is randomly produced and independent of other observations. Calculate the average of the observations, thus having a collection of averages of observations. Now as per Central Limit Theorem, if the sample size was adequately large, then the probability distribution of these sample averages will approximate to a normal distribution.

Assumptions of Central Limit Theorem

Central Limit Theorem is valid for the following conditions:

  • The drawing of the sample from the population should be random.
  • The drawing of the sample should be independent of each other.
  • The sample size should not exceed ten percent of the total population when sampling is done without replacement.
  • Sample Size should be adequately large.
  • CLT only holds true for population with finite variance.

Central Limit Theorem Formula

Let us assume we have a random variable X. Let σ is its standard deviation and μ is the mean of the random variable. Now as per Central Limit Theorem, the sample mean \overline{X}     will approximate to the normal distribution which is given as \overline{X}     ⁓ N(μ, σ/√n). The Z-Score of the random variable \overline{X}     is given as Z = \dfrac{\overline x - \mu}{\frac{\sigma}{\sqrt n}}     . Here \overline x     is the mean of \overline X     . The image of the formula is attached below

Central-Limit-Theorem-Formula

Central Limit Theorem Proof

Let the independent random variables be X1, X2, X3, . . . . , Xn which are identically distributed and where their mean is zero(μ = 0) and their variance is one(σ2 = 1).

The Z score is given as, Z = \dfrac{\overline X - \mu}{\frac{\sigma}{\sqrt n}}

Here, according to Central Limit Theorem, Z approximates to Normal Distribution as the value of n increases.

Let m(t) be the Moment Generating Function of Xi

⇒ M(0) = 1

⇒ M'(1) = E(Xi) = μ = 0

⇒ M”(0) = E(Xi2) = 1

The Moment Generating Function for Xi/√n is given as E[etXi/√n]

Since, X1 X2, X3 . . . Xn are independent, hence the Moment Generating Function for (X1 + X2 + X3 + . . . + Xn)/√n is given as [M(t/√n)]n

Let us assume as function

f(t) = log M(t)

⇒ f(0) = log M(0) = 0

⇒ f'(0) = M'(0)/M(0) = μ/1 = μ

⇒ f”(0) = (M(0).M”(0) – M'(0)2)/M'(0)2 = 1

Now, using L’ Hospital Rule we will find t/√n as t2/2

⇒ [M(t/√n)]2 = [ef(t/√n)]n

⇒ [enf(t/√n)] = e^(t2/2)

Thus the Central Limit Theorem has been proved by getting Moment Generating Function of a Standard Normal Distribution.

Steps to Solve Problems on Central Limit Theorem

Problems of Central Limit Theorem that involves >, < or between can be solved by the following steps:

Step 1: First identify the >, < associated with sample size, population size, mean and variance in the problem. Also there can be ‘betwee; associated with range of two numbers.

Step 2: Draw a Graph with Mean as Centre

Step 3: Find the Z-Score using the formula

Step 4: Refer to the Z table to find the value of Z obtained in the previous step.

Step 5: If the problem involves ‘>’ subtract the Z score from 0.5; if the problem involves ‘<‘ add 0.5 to the Z score and if the problem involves ‘between’ then perform only step 3 and 4.

Step 6: The Z score value is found along \overline X

Step 7: Convert the decimal value obtained in all three cases to decimal.

Central Limit Theorem Application

Central Limit Theorem is generally used to predict the characteristics of a population from a set of sample. It can be applied in various fields. Some of the applications Central Limit Theorem are mentioned below:

  • Central Limit Theorem is used by Economist and Data Scientist to draw conclusion about population to make a statistical model.
  • Central Limit Theorem is used by Biologists to make accurate predictions about the characteristics of the population from set of sample.
  • Manufacturing Industries use Central Limit Theorem to predict overall defective items produced by selecting random products from a sample.
  • Central Limit Theorem is used in surveys to predict the characteristics of the population or to predict the average response of the population by analyzing a sample of obtained responses.
  • CLT can be used in Machine Learning to make conclusion about the performance of the model.

Read More,

Solved Examples on Central Limit Theorem

Example 1. The male population’s weight data follows a normal distribution. It has a mean of 70 kg and a standard deviation of 15 kg. What would the mean and standard deviation of a sample of 50 guys be if a researcher looked at their records?

Solution:

Given: μ = 70 kg, σ = 15 kg, n = 50

As per the Central Limit Theorem, the sample mean is equal to the  population mean.

Hence, \mu _{\overline{x}}          = μ = 70 kg

Now, \sigma _{\overline{x}}=\frac{\sigma }{\sqrt{n}}          = 15/√50

⇒ \sigma _{\overline{x}}          ≈ 2.1 kg

Example 2. A distribution has a mean of 69 and a standard deviation of 420. Find the mean and standard deviation if a sample of 80 is drawn from the distribution.

Solution:

Given: μ = 69, σ = 420, n = 80

As per the Central Limit Theorem, the sample mean is equal to the  population mean.

Hence, \mu _{\overline{x}}          = μ = 69 

Now, \sigma _{\overline{x}}=\frac{\sigma }{\sqrt{n}}

⇒ \sigma _{\overline{x}}         = 420/√80

⇒ \sigma _{\overline{x}}          = 46.95 

Example 3. The mean age of people in a colony is 34 years. Suppose the standard deviation is 15 years. The sample of size is 50. Find the mean and standard deviation of the sample.

Solution:

Given: μ = 34, σ = 15, n = 50

As per the Central Limit Theorem, the sample mean is equal to the  population mean.

Hence, \mu _{\overline{x}}          = μ = 34 years

Now, \sigma _{\overline{x}}=\frac{\sigma }{\sqrt{n}}

⇒ \sigma _{\overline{x}}         = 15/√50

⇒ \sigma _{\overline{x}}          = 2.12 years

Example 4. The mean age of cigarette smokers is 35 years. Suppose the standard deviation is 10 years. The sample size is 39. Find the mean and standard deviation of the sample.

Solution:

Given: μ = 35, σ = 10, n = 39

As per the Central Limit Theorem, the sample mean is equal to the  population mean.

Hence, \mu _{\overline{x}}          = μ = 35 years

Now, \sigma _{\overline{x}}=\frac{\sigma }{\sqrt{n}}          = 10/√39

⇒ \sigma _{\overline{x}}          = 1.601 years

Example 5. The mean time taken to read a newspaper is 8.2 minutes. Suppose the standard deviation is one minute. Take a sample of size 70. Find its mean and standard deviation.

Solution:

Given: μ = 8.2, σ = 1, n = 70

As per the Central Limit Theorem, the sample mean is equal to the  population mean.

Hence, \mu _{\overline{x}}          = μ = 8.2 minutes

Now, \sigma _{\overline{x}}=\frac{\sigma }{\sqrt{n}}          = 1/√70

⇒ \sigma _{\overline{x}}          = 0.11 minutes

Example 6. A distribution has a mean of 12 and a standard deviation of 3. Find the mean and standard deviation if a sample of 36 is drawn from the distribution.

Solution:

Given: μ = 12, σ = 3, n = 36

As per the Central Limit Theorem, the sample mean is equal to the  population mean.

Hence, \mu _{\overline{x}}          = μ = 12

Now, \sigma _{\overline{x}}=\frac{\sigma }{\sqrt{n}}          = 3/√36

⇒ \sigma _{\overline{x}}          = 0.5

Example 7. A distribution has a mean of 4 and a standard deviation of 5. Find the mean and standard deviation if a sample of 25 is drawn from the distribution.

Solution:

Given: μ = 4, σ = 5, n = 25

As per the Central Limit Theorem, the sample mean is equal to the  population mean.

Hence, \mu _{\overline{x}}          = μ = 4

Now, \sigma _{\overline{x}}=\frac{\sigma }{\sqrt{n}}

⇒ \sigma _{\overline{x}}         = 5/√25

⇒ \sigma _{\overline{x}}          = 1

FAQs on Central Limit Theorem

1. What is Central Limit Theorem in Statistics?

Central Limit Theroem in statistics states that whenever we take a large sample size of a population then the distribution of sample mean approximates to the normal distribution.

2. When does Central Limit Theorem apply?

Central Limit theorem applies when the sample size is larger usually greater than 30.

3. Why is Central Limit Theorem important?

Central Limit Theorem is important as it helps to make accurate prediction about a population just by analyzing the sample.

4. How to solve Central Limit Theorem?

The Central Limit Theorem can be solved by finding Z score which is calculated by using the formula Z = \dfrac{\overline x - \mu}{\frac{\sigma}{\sqrt n}}     . The detailed process has been discussed under the heading “Steps to Solve Central Limit Theorem”.

5. What is Moment Generating Function?

Moment Generating Function is a function that encodes the moment of a random variable into a function. It is the expectation of a function of Random Variable. It acts as alternative to Probability Distribution Function and Cumulative Distribution Function for a random variable



Last Updated : 06 Sep, 2023
Like Article
Save Article
Previous
Next
Share your thoughts in the comments
Similar Reads