Statistics Practice Problems and Key Concepts Study Guide

Practice Problems and Key Concepts in Statistics

Instructions and General Guidelines

This set of practice problems is designed to reinforce key concepts in probability and statistics. Students are expected to show all work, simplify answers fully, and follow academic integrity policies. Calculators are allowed, but collaboration is not permitted.

• Exact Answers: Unless otherwise stated, do not approximate or round your answers. For example, write $\frac{5}{2} \times 3$ as $\frac{15}{2}$, not 7.5.

• Probability Expressions: Express probabilities as fractions or exact decimals when possible.

• Multiple Answers: If a question asks for all possible outcomes, list each one clearly.

Key Statistical Concepts and Theorems

Bayes' Theorem

Bayes' Theorem allows us to update the probability of an event based on new information.

• Formula:

$P(A_i|B) = \frac{P(B|A_i)P(A_i)}{\sum_j P(B|A_j)P(A_j)}$

• Application: Used in problems involving conditional probability and updating beliefs after observing evidence.

Properties of Expectation and Variance

Expectation (mean) and variance are fundamental measures for random variables.

• Linearity of Expectation: $E(X + Y) = E(X) + E(Y)$

• Scaling: $E(aX) = aE(X)$ for constant $a$

• Variance of a Sum:

$Var(X + Y) = Var(X) + Var(Y) + 2\rho \sqrt{Var(X)Var(Y)}$

• Where $\rho$ is the correlation coefficient. If $X$ and $Y$ are independent, $\rho = 0$ and $Var(X + Y) = Var(X) + Var(Y)$.

Properties of Density Curves

Density curves describe the distribution of continuous random variables.

• The curve takes nonnegative values.

• The total area under the curve is 1.

• For a random variable $X$ with density $f$, $P(a \leq X \leq b)$ is the area under the density curve between $a$ and $b$.

Common Discrete Distributions

• Binomial Distribution $B(n, p)$:

$E(X) = np$ $Var(X) = np(1-p)$

• Geometric Distribution $Geo(p)$:

$E(X) = \frac{1}{p}$ $Var(X) = \frac{1-p}{p^2}$

Central Limit Theorem (CLT)

The CLT states that the sampling distribution of the sample proportion $\hat{p}$ is approximately normal for large sample sizes.

$N\left( p, \frac{p(1-p)}{n} \right)$

• Used for normal approximation of binomial and other distributions when $n$ is large.

Standard Normal (Z) Table

The Z table provides cumulative probabilities for the standard normal distribution. It is used to find probabilities and percentiles for normally distributed variables.

Z	0.00	0.01	0.02	0.03	0.04	0.05	0.06	0.07	0.08	0.09
0.0	0.5000	0.5040	0.5080	0.5120	0.5160	0.5199	0.5239	0.5279	0.5319	0.5359
0.1	0.5398	0.5438	0.5478	0.5517	0.5557	0.5596	0.5636	0.5675	0.5714	0.5753
0.2	0.5793	0.5832	0.5871	0.5910	0.5948	0.5987	0.6026	0.6064	0.6103	0.6141
0.3	0.6179	0.6217	0.6255	0.6293	0.6331	0.6368	0.6406	0.6443	0.6480	0.6517
0.4	0.6554	0.6591	0.6628	0.6664	0.6700	0.6736	0.6772	0.6808	0.6844	0.6879
0.5	0.6915	0.6950	0.6985	0.7019	0.7054	0.7088	0.7123	0.7157	0.7190	0.7224
0.6	0.7257	0.7291	0.7324	0.7357	0.7389	0.7422	0.7454	0.7486	0.7517	0.7549
0.7	0.7580	0.7611	0.7642	0.7673	0.7704	0.7734	0.7764	0.7794	0.7823	0.7852
0.8	0.7881	0.7910	0.7939	0.7967	0.7995	0.8023	0.8051	0.8078	0.8106	0.8133
0.9	0.8159	0.8186	0.8212	0.8238	0.8264	0.8289	0.8315	0.8340	0.8365	0.8389

Additional info: Table truncated for brevity. Refer to a full Z table for more values.

Practice Problem Topics

Probability and Conditional Probability

• Problems involving the calculation of probabilities from tables and scenarios (e.g., Monty Hall problem, probability distributions).

• Application of Bayes' Theorem to real-world situations (e.g., quality control, game shows).

Random Variables and Distributions

• Calculation of mean and variance for discrete random variables.

• Sum of independent random variables: $E(X+Y) = E(X) + E(Y)$, $Var(X+Y) = Var(X) + Var(Y)$ if independent.

• Use of probability tables to find expected values and variances.

Density Curves and Continuous Probability

• Interpretation of density curves to find probabilities and percentiles.

• Calculation of areas under piecewise or irregular density curves.

Sampling and the Central Limit Theorem

• Normal approximation for binomial and other distributions using the CLT.

• Use of the Z table to find probabilities and construct confidence intervals.

• Calculation of sample proportions and their distributions.

Confidence Intervals and Error Bounds

• Construction of confidence intervals for proportions using the Z table.

• Calculation of sample sizes required to achieve a desired margin of error.

Markov Processes and Random Walks

• Problems involving movement on a coordinate plane based on dice rolls (random walks).

• Calculation of probabilities for reaching specific locations after a number of steps.

Example Table: Probability Distribution

The following table is used in several problems to calculate expected value and variance:

x	1	4	6	9
P(X = x)	0.1	0.4	?	0.1

Additional info: The probability for x = 6 is missing and can be found by ensuring the probabilities sum to 1.

Applications and Problem Types

• Monty Hall Problem: Decision-making under uncertainty and conditional probability.

• Random Guessing: Probability of correct answers under random guessing strategies.

• Random Walks: Movement on a grid based on probabilistic rules.

• Repeated Trials: Expected value and variance for repeated independent draws.

• Quality Control: Use of conditional probability to assess the likelihood of defects.

Summary Table: Key Formulas

Concept	Formula
Bayes' Theorem	$P(A|B) = \frac{P(B|A)P(A)}{P(B)}$
Expected Value (Discrete)	$E(X) = \sum x_i P(X = x_i)$
Variance (Discrete)	$Var(X) = E(X^2) - [E(X)]^2$
Binomial Mean/Variance	$E(X) = np$, $Var(X) = np(1-p)$
Geometric Mean/Variance	$E(X) = \frac{1}{p}$, $Var(X) = \frac{1-p}{p^2}$
Central Limit Theorem	$N\left( p, \frac{p(1-p)}{n} \right)$
Confidence Interval (proportion)	$\hat{p} \pm z^* \sqrt{\frac{\hat{p}(1-\hat{p})}{n}}$

Example: Using the Z Table

• To find $P(Z < 1.23)$, locate row 1.2 and column 0.03 in the Z table: $P(Z < 1.23) = 0.8907$.

• For a two-tailed confidence interval, find the critical value $z^*$ corresponding to the desired confidence level.

Additional info:

• Some problems require logical reasoning or multi-step calculations (e.g., finding missing probabilities, using independence, or applying the law of total probability).

• Students should be familiar with both discrete and continuous probability models, as well as the use of tables and normal approximations.