Statistics Study Guide: Key Concepts and Methods

Ch1: Statistics Introduction

Observational Study vs. Experiment

Statistics distinguishes between observational studies and experiments based on whether variables are manipulated.

• Observational Study: No attempt is made to control or influence variables; data is simply observed and recorded.

• Experiment: Variables are manipulated to observe their effect on other variables.

Population Parameter vs. Sample Statistic

Understanding the difference between population parameters and sample statistics is fundamental in statistics.

• Population Parameter: A numerical characteristic of a population (e.g., mean, proportion).

• Sample Statistic: A numerical characteristic calculated from a sample, used to estimate population parameters.

Types of Data

• Categorical Data: Data that can be divided into groups or categories (e.g., gender, color).

• Numerical Data: Data that represents quantities (e.g., height, weight).

Variable Types

• Nominal Data: Used for identification; no inherent order (e.g., types of fruit).

• Ordinal Data: Categories with a meaningful order (e.g., rankings).

• Quantitative Data: Numeric values that can be measured (e.g., age, income).

Ch2: Graphical Summaries

Single Categorical Variables

• Bar Charts: Used to compare frequencies of categories.

• Pie Charts: Show proportions of categories as slices of a circle.

Two Quantitative Variables

• Scatterplots: Display the relationship between two quantitative variables.

• Linear Association: Points tend to follow a straight line.

Ch3: Numerical Summaries

Measures of Location (Central Tendency)

• Mean: The arithmetic average; sensitive to outliers.

• Median: The middle value; resistant to outliers.

• Mode: The most frequently occurring value.

Measures of Variability (Dispersion)

• Range: Difference between maximum and minimum values.

• Inter-Quartile Range (IQR): $IQR = Q_3 - Q_1$; resistant to outliers.

• Variance: Average squared deviation from the mean.

  • Population variance: $\sigma^2 = \frac{\sum (x_i - \mu)^2}{N}$

  • Sample variance: $s^2 = \frac{\sum (x_i - \bar{x})^2}{n-1}$

• Standard Deviation: Square root of variance; measures spread in same units as data.

  • Population: $\sigma$

  • Sample: $s$

Boxplots and Modified Boxplots

• Boxplots display the five-number summary: minimum, $Q_1$, median, $Q_3$, maximum.

• Modified boxplots identify outliers using fences:

  • Upper fence: $Q_3 + 1.5 \times IQR$

  • Lower fence: $Q_1 - 1.5 \times IQR$

Ch4: Relation Between Two Variables

Correlation and Regression

• Correlation Coefficient: Measures strength and direction of linear relationship.

• Regression Line: Predicts response variable from explanatory variable.

Ch5: Probability

Basic Probability Rules

• Probability of an Event: $0 \leq P(E) \leq 1$

• Sum of Probabilities: $\sum P(E_i) = 1$

• Conditional Probability: $P(A|B) = \frac{P(A \cap B)}{P(B)}$

• Independence: Events are independent if $P(A \cap B) = P(A) \times P(B)$

Probability Calculations

• Addition Rule: $P(A \cup B) = P(A) + P(B) - P(A \cap B)$

• Multiplication Rule: $P(A \cap B) = P(A) \times P(B)$ (if independent)

Ch6: Distribution of Discrete Random Variables

Discrete Probability Distributions

• Lists all possible values and their probabilities.

• Probabilities must sum to 1 and each be between 0 and 1.

Expected Value and Variance

• Expected Value: $E(X) = \sum x_i P(x_i)$

• Variance: $Var(X) = \sum (x_i - E(X))^2 P(x_i)$

Binomial Distribution

• Models number of successes in $n$ independent trials.

• Probability function: $P(X = k) = \binom{n}{k} p^k (1-p)^{n-k}$

• Mean: $\mu = np$

• Standard deviation: $\sigma = \sqrt{np(1-p)}$

Ch7: Distribution of Continuous Random Variables

Normal Distribution

• Bell-shaped, symmetric, defined by mean $\mu$ and standard deviation $\sigma$.

• Notation: $N(\mu, \sigma)$

• Empirical Rule:

  • 68% of data within 1 $\sigma$ of mean

  • 95% within 2 $\sigma$

  • 99.7% within 3 $\sigma$

Standard Normal Distribution

• Mean = 0, Standard deviation = 1

• Z-score: $z = \frac{x - \mu}{\sigma}$

• Use Z-tables to find probabilities and percentiles.

Ch8: Sampling Distributions

Sampling Distribution of the Mean

• Distribution of sample means from repeated samples.

• Central Limit Theorem: For large $n$, sampling distribution of mean is approximately normal.

• Mean: $E(\bar{x}) = \mu$

• Standard Error: $SE = \frac{\sigma}{\sqrt{n}}$

Ch9: Confidence Intervals

Definition and Structure

• A range of values likely to contain the true population parameter.

• General formula: $\text{Point Estimate} \pm \text{Critical Value} \times \text{Standard Error}$

Interpreting the Interval

• "We are 95% confident that the true mean is between [Lower Bound] and [Upper Bound]."

Factors Affecting Width

Factor	Change	Resulting Interval
Confidence Level	Higher (e.g., 99%)	Wider
Sample Size (n)	Increase	Narrower
Standard Deviation	Increase	Wider

Ch10: Hypothesis Testing

Core Concept

• Statistical method to decide if sample data provides enough evidence to support a claim about a population parameter.

The Two Hypotheses

• Null Hypothesis ($H_0$): No effect or difference.

• Alternative Hypothesis ($H_a$): There is an effect or difference.

Significance Level ($\alpha$)

• The risk of making a Type I error (rejecting $H_0$ when it is true).

Types of Errors

• Type I Error: Rejecting a true $H_0$.

• Type II Error: Failing to reject a false $H_0$.

Quick Summary Table

Component	Symbol	Description
Null Hypothesis	$H_0$	"Nothing is happening." (Always has equality sign =)
Alternative	$H_a$	"Something is happening." (Has <, >, or ≠)
Alpha	$\alpha$	The risk we are willing to take of being wrong (Type I error)
P-value	$p$	The evidence against $H_0$. Smaller $p$ = Stronger evidence.