Inferential Statistics • Lesson 6

Standard Error

How much can a sample result change from one sample to another? Standard Error helps us answer this question.

📊

Understand

Learn what Standard Error actually represents.

🧮

Calculate

Use the Standard Error formula with real examples.

🎯

Apply

Connect Standard Error to data analytics.

STEP 1

Why Do We Need Standard Error?

Imagine an online shopping company wants to know the average amount customers spend per order.

The company has thousands of orders, so instead of studying every order, an analyst selects a sample.

Suppose we repeatedly select samples:

Sample 1

₹4,850

Sample 2

₹5,120

Sample 3

₹4,970

Sample 4

₹5,060

The sample means are not identical. They change because different samples contain different observations.

STEP 2

What Does Standard Error Mean?

Standard Error measures the typical variability of a sample statistic across repeated samples.

👥

Population

→
🎯

Sample

→
📊

Sample Mean

Think of it this way:

If we repeatedly take samples of the same size, how much will their means tend to move around? Standard Error gives us a way to quantify that variability.

STEP 3

Standard Deviation vs Standard Error

These two concepts are related, but they describe different types of variation.

ConceptWhat it describesExample
Standard DeviationVariation among individual observationsHow different customer orders are
Standard ErrorVariation of a sample statistic across samplesHow much sample means change

Easy memory trick

Standard Deviation → variation in the data.

Standard Error → variation in the estimate.

STEP 4

Standard Error Formula

For the sample mean, when the population standard deviation is known, the Standard Error is:

SE = σ / √n

SE = Standard Error

σ = Population Standard Deviation

n = Sample Size

When population standard deviation is unknown

In practice, the population standard deviation is often unknown. We can estimate the Standard Error using the sample standard deviation:

SE = s / √n

STEP 5

Worked Example

Suppose the population standard deviation of customer spending is ₹600 and we select a sample of 100 customers.

Population Standard Deviation

σ = ₹600

Sample Size

n = 100

Step 1: Write the formula

SE = σ / √n

Step 2: Substitute the values

SE = 600 / √100

SE = 600 / 10

SE = ₹60

STEP 6

What Happens When Sample Size Increases?

Look at the denominator of the formula:

√n

As sample size increases, √n also increases. Therefore, the Standard Error generally decreases, assuming the standard deviation remains unchanged.

Sample Size

n = 25

SE = 600 / √25

₹120

Sample Size

n = 100

SE = 600 / √100

₹60

Sample Size

n = 400

SE = 600 / √400

₹30

The pattern

Larger sample → smaller Standard Error → more precise estimate, assuming the other conditions remain comparable.

STEP 7

Why Does a Larger Sample Help?

Imagine trying to estimate the average height of students in a school.

👤 👤 👤

Small Sample

A few unusual observations can have a relatively large effect on the sample mean.

👤 👤 👤 👤 👤 👤 👤 👤

Larger Sample

Individual unusual observations tend to have less influence on the overall sample mean.

CHECK YOUR UNDERSTANDING

Interactive Quiz

Think before selecting an answer. The explanation will tell you why the answer is correct.

CHECK YOUR UNDERSTANDING

What does Standard Error measure?

CHECK YOUR UNDERSTANDING

Which formula represents the Standard Error of the mean when the population standard deviation is known?

CHECK YOUR UNDERSTANDING

If σ = 80 and n = 16, what is the Standard Error?

CHECK YOUR UNDERSTANDING

If sample size increases while σ stays constant, what generally happens to Standard Error?

CHECK YOUR UNDERSTANDING

A population standard deviation is ₹600 and n = 100. What is the Standard Error?

CHECK YOUR UNDERSTANDING

Which statement correctly distinguishes Standard Deviation from Standard Error?

PRACTICE

Fill in the Blank

Fill in the Blank

The Standard Error formula for a sample mean using population standard deviation is SE = σ / √__.

Fill in the Blank

As sample size increases, Standard Error generally becomes __.

Fill in the Blank

Standard Deviation describes variation among individual __.

Fill in the Blank

Standard Error describes the variability of a sample __ across repeated samples.

DATA ANALYTICS CHALLENGE

Estimate Customer Spending

You are a data analyst for an e-commerce company. The company wants to estimate average customer spending.

Given Data

Population SD

₹500

Sample A

n = 100

Sample B

n = 400

Sample A

SE = 500 / √100

SE = ₹50

Sample B

SE = 500 / √400

SE = ₹25

What should the analyst notice?

The larger sample has a smaller Standard Error. Therefore, assuming the same underlying variability, the sample mean has less sampling variability.

FINAL CHECK

One Last Question

If the sample size becomes four times larger, what happens to the Standard Error, assuming σ stays constant?

Original:SE = σ / √n

New sample size:4n

New Standard Error:σ / √(4n)

Therefore, the Standard Error becomes half as large.

LESSON SUMMARY

What You Should Remember

1. Standard Error

Measures the typical variability of a sample statistic across repeated samples.

2. Formula

For a mean with known population SD: SE = σ / √n.

3. Sample Size

Increasing sample size generally decreases Standard Error.

4. SD vs SE

SD describes variation in observations; SE describes sampling variability of an estimate.