Probability, Distributions, and Statistical Calculations: Review Notes

Probability and Statistical Calculations

Probability Concepts

Probability is the study of randomness and uncertainty, providing a mathematical framework for quantifying the likelihood of events. Understanding probability is essential for analyzing data and making inferences in statistics.

• Sample Space (S): The set of all possible outcomes of a random experiment.

• Event: A subset of the sample space; a collection of outcomes.

• Probability of an Event (P): A number between 0 and 1 that measures the likelihood of an event occurring.

• Complementary Events: The probability that an event does not occur is $P(A^c) = 1 - P(A)$.

• Mutually Exclusive Events: Events that cannot occur at the same time; $P(A \cap B) = 0$.

• Conditional Probability: The probability of event A given that event B has occurred is $P(A|B) = \frac{P(A \cap B)}{P(B)}$.

• Independent Events: Two events A and B are independent if $P(A \cap B) = P(A) \times P(B)$.

Example: If a die is rolled, the probability of getting an even number (2, 4, 6) is $P(Even) = \frac{3}{6} = 0.5$.

Venn Diagrams

Venn diagrams are visual tools used to represent events and their relationships within a sample space. They are helpful for understanding unions, intersections, and complements of events.

• Union (A or B): $P(A \cup B) = P(A) + P(B) - P(A \cap B)$

• Intersection (A and B): $P(A \cap B)$

Example: In a deck of cards, let A be the event "drawing a heart" and B be "drawing a king." The union represents drawing a heart or a king.

Probability Tables and Conditional vs. Unconditional Probabilities

Probability tables (also called contingency tables) organize data to show the frequency or probability of combinations of two or more events. They are useful for calculating conditional probabilities.

• Conditional Probability: Probability of one event given another has occurred.

• Unconditional Probability: Probability of an event without any given condition.

Example: If 30 students are surveyed and 18 are female, the unconditional probability of selecting a female is $\frac{18}{30}$. If 10 of the 18 females play sports, the conditional probability that a randomly selected female plays sports is $\frac{10}{18}$.

Random Variables and Distributions

Discrete Random Variables and Binomial Distribution

A random variable assigns a numerical value to each outcome in a sample space. Discrete random variables take on countable values. The binomial distribution models the number of successes in a fixed number of independent trials, each with the same probability of success.

• Binomial Distribution: $P(X = k) = {n \choose k} p^k (1-p)^{n-k}$

• Mean (Expected Value): $\mu = np$

• Standard Deviation: $\sigma = \sqrt{np(1-p)}$

• Conditions: Fixed number of trials, independent trials, two possible outcomes (success/failure), constant probability of success.

Example: Flipping a coin 10 times, probability of getting exactly 6 heads: $n=10$, $p=0.5$, $k=6$.

Normal Distribution and Z-Scores

The normal distribution is a continuous, symmetric, bell-shaped distribution characterized by its mean and standard deviation. Z-scores standardize values to measure how many standard deviations they are from the mean.

• Standard Normal Distribution: Mean = 0, Standard deviation = 1.

• Z-Score Formula: $z = \frac{x - \mu}{\sigma}$

• Area Under the Curve: Represents probability; use Z-tables to find probabilities for given z-scores.

• "Unusual" Values: Values with $|z| > 2$ are often considered unusual.

Example: If $\mu = 100$, $\sigma = 15$, and $x = 130$, then $z = \frac{130 - 100}{15} = 2$.

Statistical Calculations and Expected Value

Expected Value (Mean) and Standard Deviation

The expected value (mean) of a random variable is the long-run average outcome. The standard deviation measures the spread of the distribution.

• Expected Value: $E(X) = \sum x_i P(x_i)$

• Standard Deviation: $\sigma = \sqrt{\sum (x_i - \mu)^2 P(x_i)}$

Example: For a game with outcomes $x = 0, 1, 2$ and probabilities $P(x) = 0.2, 0.5, 0.3$, the expected value is $E(X) = 0 \times 0.2 + 1 \times 0.5 + 2 \times 0.3 = 1.1$.

Probability Rules and Calculations

Basic Probability Rules

• Addition Rule: For any two events, $P(A \cup B) = P(A) + P(B) - P(A \cap B)$

• Multiplication Rule: For independent events, $P(A \cap B) = P(A) \times P(B)$

• Complement Rule: $P(A^c) = 1 - P(A)$

Applications: Dice, Cards, and Sample Spaces

Probability calculations often involve familiar objects like dice, cards, and coins. Understanding the sample space is crucial for accurate probability computation.

• Dice: Rolling a fair six-sided die, each outcome has probability $\frac{1}{6}$.

• Cards: A standard deck has 52 cards; probability of drawing an ace is $\frac{4}{52}$.

• Coins: Flipping a fair coin, probability of heads is $0.5$.

HTML Table: Probability Rules Comparison

Rule	Formula	When to Use
Addition Rule	$P(A \cup B) = P(A) + P(B) - P(A \cap B)$	Finding probability of A or B
Multiplication Rule	$P(A \cap B) = P(A) \times P(B)$	Finding probability of A and B (if independent)
Complement Rule	$P(A^c) = 1 - P(A)$	Finding probability of "not A"
Conditional Probability	$P(A|B) = \frac{P(A \cap B)}{P(B)}$	Probability of A given B

Summary

• Probability is foundational for statistics, involving sample spaces, events, and rules for calculation.

• Random variables can be discrete (e.g., binomial) or continuous (e.g., normal distribution).

• Expected value and standard deviation summarize the center and spread of distributions.

• Venn diagrams and probability tables help visualize and compute probabilities, including conditional probabilities.

• Applications include dice, cards, and coins, with calculations based on the structure of the sample space.

Additional info: Some content was inferred and expanded for clarity and completeness based on standard introductory statistics curriculum.