Comprehensive Study Notes for Introductory Statistics

Ch1: Statistics Introduction

Observational Study vs. Experiment

• Observational Study: No attempt is made to control or influence the variables of interest. Data is simply observed and recorded.

• Experiment: One or more variables are manipulated to determine how they influence the variable of interest.

Population Parameter vs. Sample Statistic

• Population Parameter: A numerical characteristic of a population (e.g., population mean μ, population proportion p).

• Sample Statistic: A numerical summary calculated from a sample (e.g., sample mean x̄, sample proportion p̂).

Types of Data

• Categorical Data: Values that represent categories or groups (e.g., gender, color).

• Quantitative Data: Values that represent measurable quantities (e.g., height, weight).

Variable Types

• Nominal Data: Categories without a natural order (e.g., eye color).

• Ordinal Data: Categories with a natural order (e.g., class rank).

• Discrete Quantitative Data: Countable values (e.g., number of siblings).

• Continuous Quantitative Data: Any value within a range (e.g., height).

Ch2: Organizing and Summarizing Data

Graphical Summaries

• Bar Charts: Used for single categorical variables.

• Pie Charts: Show proportions of categories.

• Histograms: Used for quantitative data to show frequency distributions.

• Scatterplots: Show the relationship between two quantitative variables.

Ch3: Numerically Summarizing Data

Measures of Location (Central Tendency)

• Mean (x̄): The arithmetic average. Sensitive to outliers.

• Median: The middle value when data is ordered. Resistant to outliers.

• Mode: The most frequently occurring value.

Measures of Variability (Dispersion)

• Range: Difference between the maximum and minimum values.

• Interquartile Range (IQR): $IQR = Q_3 - Q_1$ (middle 50% of data).

• Variance: Average squared deviation from the mean.

  • Population variance: $\sigma^2 = \frac{\sum (x_i - \mu)^2}{N}$

  • Sample variance: $s^2 = \frac{\sum (x_i - \bar{x})^2}{n-1}$

• Standard Deviation: Square root of variance.

  • Population: $\sigma$

  • Sample: $s$

Boxplots and Outliers

• Boxplot: Visual summary using quartiles and median.

• Outlier Detection: Values more than 1.5 × IQR above Q3 or below Q1 are considered outliers.

Ch4: Describing the Relation Between Two Variables

Scatterplots and Correlation

• Scatterplot: Graphs two quantitative variables to identify relationships.

• Correlation Coefficient (r): Measures strength and direction of linear relationship.

  • $-1 \leq r \leq 1$

Regression

• Regression Line: Best-fit line through data points, used for prediction.

Ch5: Probability

Probability Basics

• Probability of an Event (A): $0 \leq P(A) \leq 1$

• Sum of Probabilities: All possible outcomes sum to 1.

• Relative Frequency: $P(A) = \frac{\text{Number of times A occurred}}{\text{Total number of trials}}$

Conditional Probability

• $P(A|B) = \frac{P(A \cap B)}{P(B)}$

Probability Rules

• Addition Rule (for mutually exclusive events): $P(A \cup B) = P(A) + P(B)$

• Multiplication Rule (for independent events): $P(A \cap B) = P(A) \times P(B)$

Ch6: Discrete Probability Distributions

Random Variables

• Discrete Random Variable: Takes on countable values (e.g., number of heads in coin tosses).

• Probability Distribution: Lists all possible values and their probabilities.

Expected Value and Variance

• Expected Value: $E(X) = \sum x_i P(x_i)$

• Variance: $Var(X) = \sum (x_i - \mu)^2 P(x_i)$

Binomial Distribution

• Models the number of successes in a fixed number of independent trials.

• Binomial Probability Formula: $P(X = k) = \binom{n}{k} p^k (1-p)^{n-k}$

  • n = number of trials

  • p = probability of success

  • k = number of successes

• Mean: $\mu = np$

• Standard Deviation: $\sigma = \sqrt{np(1-p)}$

Ch7: The Normal Probability Distribution

Normal Distribution

• Continuous, symmetric, bell-shaped distribution.

• Characterized by mean $\mu$ and standard deviation $\sigma$.

• Notation: $N(\mu, \sigma)$

Standard Normal Distribution

• Special case with $\mu = 0$ and $\sigma = 1$.

• Z-score: $z = \frac{x - \mu}{\sigma}$

• Used to find probabilities using standard normal tables.

Empirical Rule

• 68% of data within 1 standard deviation of mean

• 95% within 2 standard deviations

• 99.7% within 3 standard deviations

Ch8: Sampling Distributions

Sampling Distribution of the Sample Mean

• Distribution of sample means from all possible samples of a given size from a population.

• Central Limit Theorem: For large n, the sampling distribution of the sample mean is approximately normal, regardless of the population's distribution.

• Mean: $E(\bar{x}) = \mu$

• Standard Error: $\sigma_{\bar{x}} = \frac{\sigma}{\sqrt{n}}$

Ch9: Estimating the Value of a Parameter

Confidence Intervals

• Definition: Range of values likely to contain the true population parameter.

• General Form: $\text{Point Estimate} \pm (\text{Critical Value}) \times (\text{Standard Error})$

• Interpretation: "We are 95% confident that the true mean lies between [Lower Bound] and [Upper Bound]."

Factors Affecting Interval Width

Factor	Change	Resulting Interval
Confidence Level	Increase (e.g., 95% to 99%)	Wider
Sample Size (n)	Increase	Narrower
Standard Deviation	Increase	Wider

Ch10: Hypothesis Tests Regarding a Parameter

Hypothesis Testing Core Concept

• Statistical method to decide whether sample data provides enough evidence to support a specific claim about a population parameter.

• Null Hypothesis (H0): No effect or difference (status quo).

• Alternative Hypothesis (Ha): There is an effect or difference.

• Significance Level (α): Probability of Type I error (rejecting H0 when true), commonly 0.05.

• P-value: Probability of observing data as extreme as the sample, assuming H0 is true.

Types of Errors

• Type I Error (α): Rejecting a true H0.

• Type II Error (β): Failing to reject a false H0.

Summary Table

Component	Symbol	Description
Null Hypothesis	H0	"Nothing is happening." (Always has equality sign =)
Alternative	Ha	"Something is happening." (Has <, >, or ≠)
Alpha	α	The risk you are willing to take of being wrong (Type I error)
P-value	p	The evidence against H0. Smaller p = Stronger evidence.

Choosing the Right Test

• Use Z-test if population standard deviation is known.

• Use T-test if population standard deviation is unknown and estimated from the sample.