The Central Limit Theorem and Sampling Distributions

Section 6-4: The Central Limit Theorem

Introduction to the Central Limit Theorem (CLT)

The Central Limit Theorem (CLT) is a fundamental concept in statistics that describes the behavior of the sampling distribution of the sample mean. It explains how, under certain conditions, the distribution of sample means becomes approximately normal, regardless of the shape of the population distribution.

Key Concepts and Definitions

• Population Mean (\( \mu \)): The average value of a variable in the entire population.

• Population Standard Deviation (\( \sigma \)): A measure of the spread or variability of the population data.

• Sample Size (\( n \)): The number of observations in each sample drawn from the population.

• Sample Mean (\( \overline{x} \)): The average value of a variable in a sample.

• Sampling Distribution of the Mean: The probability distribution of all possible sample means of a given size from a population.

• Standard Error of the Mean (\( \sigma_{\overline{x}} \)): The standard deviation of the sampling distribution of the sample mean.

Central Limit Theorem: Main Results

• 1. Shape of the Sampling Distribution: As the sample size \( n \) increases, the distribution of sample means \( \overline{x} \) approaches a normal distribution, regardless of the shape of the population distribution.

• 2. Mean of the Sampling Distribution: The mean of the sample means is equal to the population mean: $\mu_{\overline{x}} = \mu$

• 3. Standard Deviation of the Sampling Distribution (Standard Error): The standard deviation of the sample means is: $\sigma_{\overline{x}} = \frac{\sigma}{\sqrt{n}}$ This value is called the standard error of the mean.

Practical Rules for Applying the Central Limit Theorem

• Rule 1: For samples of size \( n > 30 \), the distribution of the sample means can be approximated reasonably well by a normal distribution. The approximation improves as \( n \) increases.

• Rule 2: If the original population is normally distributed, then the sample means will be normally distributed for any sample size \( n \), not just for large \( n \).

Important Point

• As the sample size increases, the sampling distribution of sample means approaches a normal distribution, regardless of the population's original distribution.

Example Application

• Example: Suppose the population of exam scores has a mean of 70 and a standard deviation of 12. If we take random samples of size 36, the sampling distribution of the sample mean will have:

  • Mean: $\mu_{\overline{x}} = 70$

  • Standard Error: $\sigma_{\overline{x}} = \frac{12}{\sqrt{36}} = 2$

  • Shape: Approximately normal, since \( n = 36 > 30 \)

Additional info: The Central Limit Theorem is essential for inferential statistics, as it justifies the use of normal probability methods for sample means, even when the population distribution is unknown or not normal, provided the sample size is sufficiently large.