Sampling Distributions: Concepts, Properties, and Applications

Sampling Distributions

Introduction to Sampling Distributions

Sampling distributions are fundamental in inferential statistics, providing the basis for estimating population parameters and testing hypotheses. This topic explores the distribution of sample statistics, such as the mean and proportion, derived from repeated samples of a given size from a population.

• Definition: A sampling distribution is the distribution of all possible values of a sample statistic (e.g., mean, proportion) for a given sample size selected from a population.

• Example: If you sample 50 students from your college and calculate their mean GPA, repeating this process many times yields a distribution of sample means.

Developing a Sampling Distribution

To understand sampling distributions, consider a population and all possible samples of a specific size drawn from it.

• Population Example: Suppose a population of size $N=4$ with ages $X = ext{18, 20, 22, 24}$ years.

• Population Mean: $ext{Population Mean:} \\ \, \mu = \frac{\sum X}{N} = \frac{18 + 20 + 22 + 24}{4} = 21$

• Population Standard Deviation: $\sigma = \sqrt{\frac{\sum (X - \mu)^2}{N}} = 2.236$

• Uniform Distribution: Each value is equally likely in the population.

Sampling with Replacement

• For samples of size $n=2$, all possible pairs are considered, resulting in $16$ sample means.

• The distribution of these sample means is no longer uniform.

Summary Measures of the Sampling Distribution

• Mean of Sample Means: $\mu_{\bar{X}} = \frac{18 + 19 + 19 + \ldots + 24}{16} = 21$

• Standard Deviation of Sample Means: $\sigma_{\bar{X}} = \sqrt{\frac{(18-21)^2 + (19-21)^2 + \ldots + (24-21)^2}{16}} = 1.58$

Comparing Population and Sample Means Distributions

Population (N=4)	Sample Means Distribution (n=2)
$\mu = 21$ $\sigma = 2.236$	$\mu_{\bar{X}} = 21$ $\sigma_{\bar{X}} = 1.58$

Key Point: The mean of the sample means equals the population mean, but the standard deviation is smaller.

Sample Mean Sampling Distribution: Standard Error of the Mean

Standard Error of the Mean

The standard error quantifies the variability of the sample mean from sample to sample.

• Formula: $\sigma_{\bar{X}} = \frac{\sigma}{\sqrt{n}}$

• As sample size $n$ increases, $\sigma_{\bar{X}}$ decreases.

• If the population is normal, the sampling distribution of $\bar{X}$ is also normal.

Z-value for the Sample Mean

• Formula: $Z = \frac{\bar{X} - \mu}{\sigma_{\bar{X}}} = \frac{\bar{X} - \mu}{\sigma / \sqrt{n}}$

• Used to standardize the sample mean for probability calculations.

Properties of Sampling Distributions

• The mean of the sampling distribution of $\bar{X}$ is equal to the population mean ($\mu_{\bar{X}} = \mu$).

• As $n$ increases, the standard error $\sigma_{\bar{X}}$ decreases, resulting in a narrower distribution.

• $\bar{X}$ is an unbiased estimator of $\mu$.

Central Limit Theorem (CLT)

Importance and Application

The Central Limit Theorem states that, regardless of the population's distribution, the sampling distribution of the sample mean approaches normality as the sample size increases.

• For most distributions, $n > 30$ is considered sufficient for normality.

• For fairly symmetric distributions, $n > 15$ may be adequate.

Interval Estimation Example

• To find an interval containing 95% of sample means:

  • Lower limit: $\bar{X}_L = \mu + Z \frac{\sigma}{\sqrt{n}}$

  • Upper limit: $\bar{X}_U = \mu + Z \frac{\sigma}{\sqrt{n}}$

  • For $\mu = 368$, $\sigma = 15$, $n = 25$, $Z = \pm 1.96$:

  • Interval: $362.12 < \bar{X} < 373.88$

Probability Example

• Given $\mu = 8$, $\sigma = 3$, $n = 36$, probability that $7.8 < \bar{X} < 8.2$:

• Standard error: $\sigma_{\bar{X}} = \frac{3}{\sqrt{36}} = 0.5$

• Standardize: $Z = \frac{7.8 - 8}{0.5} = -0.4$, $Z = \frac{8.2 - 8}{0.5} = 0.4$

• Probability: $P(-0.4 < Z < 0.4) = 0.6554 - 0.3446 = 0.3108$

Population Proportions and Their Sampling Distributions

Population Proportion ($\pi$) and Sample Proportion ($p$)

• Population Proportion ($\pi$): The proportion of the population with a specific characteristic.

• Sample Proportion ($p$): $p = \frac{X}{n}$ where $X$ is the number of items in the sample with the characteristic, and $n$ is the sample size.

• $0 \leq p \leq 1$

• For large $n$, $p$ is approximately normally distributed.

Sampling Distribution of $p$

• Approximated by a normal distribution if $n\pi \geq 5$ and $n(1-\pi) \geq 5$.

• Mean: $\mu_p = \pi$

• Standard deviation: $\sigma_p = \sqrt{\frac{\pi(1-\pi)}{n}}$

Z-Value for Proportions

• Formula: $Z = \frac{p - \pi}{\sigma_p} = \frac{p - \pi}{\sqrt{\frac{\pi(1-\pi)}{n}}}$

• Example: If $\pi = 0.4$, $n = 200$, probability that $0.40 \leq p \leq 0.45$:

• Standard error: $\sigma_p = \sqrt{\frac{0.4 \times 0.6}{200}} = 0.03464$

• Standardize: $Z = \frac{0.45 - 0.4}{0.03464} = 1.44$

• Probability: $P(0 \leq Z \leq 1.44) = 0.9251 - 0.5000 = 0.4251$

Chapter Summary

• The concept of a sampling distribution is essential for understanding statistical inference.

• Probabilities related to the sample mean and sample proportion can be computed using the normal distribution and the Central Limit Theorem.

• The Central Limit Theorem ensures that, for large samples, the sampling distribution of the mean (or proportion) is approximately normal, regardless of the population's shape.