What You Will Learn
- What the Central Limit Theorem means
- Why sample means are important
- How sample size affects the distribution of sample means
- Why the normal distribution appears in statistical inference
- The difference between the population distribution and sampling distribution
- How CLT supports confidence intervals and hypothesis testing
Start With the Big Idea
Imagine a population whose values are not normally distributed. Perhaps the data are heavily skewed or have an unusual shape.
Now repeatedly take random samples from that population and calculate the mean of each sample. As the sample size becomes sufficiently large, the distribution of those sample means tends to become approximately normal.
Population
Can have many different shapes
Sample Means
Tend toward a bell-shaped distribution
What Does the Central Limit Theorem Say?
The Central Limit Theorem states, in simplified form, that when independent observations are sampled from a population with a finite mean and variance, the sampling distribution of the sample mean becomes approximately normal as the sample size becomes sufficiently large.
The practical idea
A sufficiently large sample size makes the distribution of sample means approximately normal under common CLT conditions, even when the original population is not normally distributed.
Three Important Ideas
Sample Means
CLT focuses on the distribution of sample means, not simply individual observations.
Large Enough Samples
The approximation improves as sample size becomes sufficiently large, subject to the conditions of the theorem.
Approximate Normality
The sampling distribution of the mean tends toward a normal shape.
Population Shape Does Not Have to Be Normal
One reason the Central Limit Theorem is so useful is that the original population does not necessarily need to have a normal distribution for the sample mean to have an approximately normal sampling distribution when the sample size is sufficiently large.
Population
Example of a skewed population
Sampling Distribution
Sample means tend toward a bell shape
When Can We Use the CLT?
The phrase "large sample" is useful for intuition, but CLT is not a universal rule that says one fixed sample size works for every population.
Independent observations
The observations should satisfy the independence conditions required by the sampling design.
Finite variance
The usual CLT formulation assumes the population has a finite variance.
Sufficiently large sample
The required sample size depends on the population distribution and how strongly it deviates from normality.
What Does "Large Enough" Mean?
You may hear a rule such as "n ≥ 30." This can be a useful classroom guideline in some situations, but it should not be treated as a universal cutoff.
If the population is already close to normal, a relatively modest sample may be enough for a good normal approximation. If the population is strongly skewed or has extreme observations, a much larger sample may be needed.
Bigger sample ≠ automatically perfect
Sample size helps, but distribution shape and sampling conditions also matter.
Why Is the CLT So Important?
The Central Limit Theorem provides a foundation for many methods used in inferential statistics.
Confidence Intervals
Approximate normality of the sampling distribution helps us construct intervals for population parameters.
Hypothesis Testing
Sampling distributions help us evaluate how unusual an observed statistic would be under a hypothesis.
Standard Error
The spread of the sampling distribution is connected to the standard error of a statistic.
Data Analytics
Analysts can use sample data to make informed statements about larger populations.
A Numerical Example
Suppose a population has a mean of ₹50,000. We repeatedly take samples of the same size and calculate the sample mean.
Example sample means:
The values differ from sample to sample, but they tend to vary around the population mean of ₹50,000.
CLT in Five Steps
Start with a population
The population may have a non-normal distribution.
Take random samples
Take many samples of the same sufficiently large size.
Calculate the sample mean
Find the mean for each sample.
Build the sampling distribution
Look at the distribution of all the sample means.
Observe the shape
The distribution tends toward an approximately normal shape under CLT conditions.
Interactive Practice
Test Your Understanding
CHECK YOUR UNDERSTANDING
What does the Central Limit Theorem primarily describe?
CHECK YOUR UNDERSTANDING
Does the original population have to be normally distributed for the CLT to be useful?
CHECK YOUR UNDERSTANDING
What happens to the sampling distribution of the sample mean as sample size becomes sufficiently large?
CHECK YOUR UNDERSTANDING
Which statement about the rule 'n ≥ 30' is most accurate?
CHECK YOUR UNDERSTANDING
If different random samples are taken from the same population, what can happen to their sample means?
CHECK YOUR UNDERSTANDING
Why is the CLT important in inferential statistics?
Fill in the Blanks
The Central Limit ______ describes the behavior of sampling distributions as sample size increases.
The CLT is mainly concerned with the distribution of sample ______.
As sample size becomes sufficiently large, the sampling distribution of the sample mean tends to become approximately ______.
The original population does not necessarily have to be ______ distributed for the CLT to be useful.
Data Analytics Scenario
Think Like a Data Analyst
An analyst studies customer transaction values. The population distribution is strongly right-skewed. The analyst repeatedly takes random samples of 100 transactions and calculates the mean transaction value for each sample.
CHECK YOUR UNDERSTANDING
What should happen to the distribution of these sample means as the CLT conditions are satisfied?
CHECK YOUR UNDERSTANDING
What is being distributed in this sampling distribution?
Key Takeaways
The Central Limit Theorem concerns the sampling distribution of the sample mean.
The original population does not necessarily have to be normally distributed.
As sample size becomes sufficiently large, the sampling distribution of the mean tends to become approximately normal under appropriate conditions.
The exact sample size needed depends on the population distribution and other assumptions.
The rule n ≥ 30 is a rough classroom guideline, not a universal guarantee.
The CLT provides an important foundation for confidence intervals and hypothesis testing.