Statistics Study Guide: Normal Distribution, Sampling, and Standard Error

Normal Distribution and Related Concepts

Standard Normal Distribution

The standard normal distribution is a special case of the normal distribution with a mean of 0 and a standard deviation of 1. It is used to calculate probabilities and percentiles for normally distributed data using the Z-table.

• Definition: A normal distribution with mean $\mu = 0$ and standard deviation $\sigma = 1$.

• Z-score: The number of standard deviations a value is from the mean. Calculated as $z = \frac{x - \mu}{\sigma}$.

• Empirical Rule: Approximately 68% of data falls within 1 standard deviation, 95% within 2, and 99.7% within 3.

• Probability Calculation: Use the Z-table to find the probability that a value falls within a certain range.

Example: For $\mu = 0$, $\sigma = 1$, the probability that $z$ falls between $-0.5$ and $0.5$ is found using the Z-table.

Z-scores and Percentiles

Z-scores standardize values from any normal distribution, allowing comparison and probability calculation.

• Formula: $z = \frac{x - \mu}{\sigma}$

• Percentile: The percentage of data below a given value. Find by looking up the Z-score in the Z-table.

Example: If the mean height of women is 65 inches ($\mu$) and the standard deviation is 3.5 inches ($\sigma$), the Z-score for 62 inches is $z = \frac{62 - 65}{3.5} = -0.86$. The percentile is found by looking up $z = -0.86$ in the Z-table, which gives approximately 19.4%.

Calculating Probabilities Using the Z-table

To find the probability that an observation falls within a certain region, use the Z-table to look up the area under the curve for the relevant Z-score(s).

• Single Value: Probability to the left of $z$ is the cumulative probability.

• Between Two Values: Subtract the cumulative probability of the lower Z-score from the higher Z-score.

Example: Probability that $z$ falls between $-0.5$ and $0.5$ is $P(-0.5 < z < 0.5) = P(z < 0.5) - P(z < -0.5)$.

Sampling Distributions and the Central Limit Theorem

Sampling Distribution of the Mean

The sampling distribution of the mean describes the distribution of sample means from repeated samples of the same size from a population.

• Mean of Sampling Distribution: Equal to the population mean $\mu$.

• Standard Error (SE): The standard deviation of the sampling distribution, calculated as $SE = \frac{\sigma}{\sqrt{n}}$.

• Effect of Sample Size: Increasing sample size decreases the standard error, making the sample mean more precise.

Example: If $\sigma = 3.0$ and $n = 100$, $SE = \frac{3.0}{\sqrt{100}} = 0.3$.

Central Limit Theorem (CLT)

The Central Limit Theorem states that the sampling distribution of the sample mean approaches a normal distribution as the sample size increases, regardless of the population's distribution, provided the sample size is sufficiently large (usually $n \geq 30$).

• Application: Allows use of normal probability methods for sample means.

• Implication: Even if the population is not normal, the distribution of sample means will be approximately normal for large $n$.

Standard Error and Law of Large Numbers

Standard Error

Standard error quantifies the variability of sample means around the population mean. It decreases as sample size increases.

• Formula: $SE = \frac{\sigma}{\sqrt{n}}$

• Interpretation: Smaller SE means sample means are closer to the population mean.

Example: Increasing sample size from 100 to 400 reduces SE from $0.3$ to $0.15$.

Law of Large Numbers

The Law of Large Numbers states that as the number of trials or sample size increases, the sample mean will get closer to the population mean.

• Application: Justifies using large samples for more accurate estimates.

Probability Distribution Vocabulary

Key Terms

• Random Variable: A variable whose value is subject to randomness.

• Probability Distribution: Describes the likelihood of all possible outcomes for a random variable.

• Discrete Random Variable: Takes on countable values.

• Weighted Average: Average where each value has a specific weight.

• Cumulative Probability: Probability that a variable is less than or equal to a value.

• Empirical Rule: See above under Standard Normal Distribution.

• Population Distribution: Distribution of a variable in the entire population.

• Population Parameter: Numerical summary of a population (e.g., mean, standard deviation).

• Sampling Distribution: Distribution of a statistic (e.g., mean) from repeated samples.

• Variability: Measure of spread in data.

Sample Problems and Solutions

Probability in Graphs

Use the Z-table to find probabilities for shaded regions under the normal curve.

• Example: For $\mu + 0.67\sigma$ and $\mu + 0.5\sigma$, use Z-table to find area.

• Solution: $P(z < 0.67) = 0.251$, $P(-0.5 < z < 0.5) = 0.383$.

Central Probabilities

Find probability that a value falls within a certain number of standard deviations from the mean.

• Example: Probability within 1.44 standard deviations: $P(-1.44 < z < 1.44) = 0.90$.

• Probability within 2.58 standard deviations: $P(-2.58 < z < 2.58) = 0.99$.

Sample Multiple Choice Problems

Problem	Calculation	Answer
Probability $z > 0.84$	$P(z > 0.84) = 1 - P(z < 0.84) = 1 - 0.7995 = 0.2005$	0.2005
Height less than 62 inches ($\mu = 65$, $\sigma = 3.5$)	$z = \frac{62 - 65}{3.5} = -0.86$, $P(z < -0.86) = 0.1949$	0.1949
Standard error for $n = 100$, $\sigma = 3.0$	$SE = \frac{3.0}{\sqrt{100}} = 0.3$	0.3
Standard error for $n = 400$, $\sigma = 3.0$	$SE = \frac{3.0}{\sqrt{400}} = 0.15$	0.15
Empirical Rule for $\mu = 500$, $\sigma = 16$, $n = 100$	$SE = \frac{16}{\sqrt{100}} = 1.6$; 99% interval: $500 \pm 3 \times 1.6 = 500 \pm 4.8$	495.2 to 504.8

Summary Table: Key Formulas

Concept	Formula (LaTeX)	Description
Z-score	$z = \frac{x - \mu}{\sigma}$	Standardizes a value
Standard Error	$SE = \frac{\sigma}{\sqrt{n}}$	Standard deviation of sample mean
Empirical Rule	68%: $\mu \pm 1\sigma$ 95%: $\mu \pm 2\sigma$ 99.7%: $\mu \pm 3\sigma$	Approximate coverage of normal distribution

Additional info:

• Some vocabulary and textbook sections were inferred from the syllabus and review lists.

• Examples and explanations were expanded for clarity and completeness.