Fundamentals of Probability in Statistics: Concepts, Calculations, and Applications

Introduction to Probability

Definition and Basic Formula

Probability quantifies how likely an event is to occur, denoted as P(event). It is calculated as the ratio of the number of times an event occurs to the total number of possible outcomes.

• General Formula:

$P(event) = \frac{\text{number of times event occurs}}{\text{total number of possible outcomes}}$

• Sample Space: The set of all possible outcomes of an experiment. For example, the sample space for flipping a coin is S = {Heads, Tails}.

Theoretical vs. Empirical Probability

Theoretical Probability

Theoretical probability is based on reasoning about what could happen, calculated before any events occur.

• Formula:

$P(event) = \frac{\text{number of outcomes with event}}{\text{total possible outcomes}}$

• Example: Probability of rolling a number greater than 3 on a six-sided die: There are 3 outcomes (4, 5, 6) out of 6 possible outcomes, so $P = \frac{3}{6} = 0.5$.

Empirical (Experimental) Probability

Empirical probability is based on actual results from experiments, calculated after events occur.

• Formula:

$P(event) = \frac{\text{number of times event occurs}}{\text{number of trials}}$

• Example: If a die is rolled 10 times and a number greater than 3 appears 6 times, $P = \frac{6}{10} = 0.6$.

Complementary Events

Definition and Properties

The complement of event A, denoted as A', consists of all outcomes where A does not occur. The sum of the probabilities of an event and its complement is always 1.

• Formula:

$P(A) + P(A') = 1$

• Example: Probability of not rolling a 4 on a six-sided die: $P(\text{not 4}) = 1 - P(4) = 1 - \frac{1}{6} = \frac{5}{6}$.

Mutually Exclusive Events

Definition and Identification

Mutually exclusive events are events that cannot happen at the same time. If events A and B are mutually exclusive, $P(A \cap B) = 0$.

• Formula for Union:

$P(A \cup B) = P(A) + P(B)$

• Example: Probability of getting a 3 or a 5 when rolling a die: $P(3 \cup 5) = P(3) + P(5) = \frac{1}{6} + \frac{1}{6} = \frac{2}{6} = 0.333$.

Non-Mutually Exclusive Events

Definition and Calculation

Non-mutually exclusive events can occur simultaneously. To avoid double-counting, subtract the probability of both events occurring together.

• Formula:

$P(A \cup B) = P(A) + P(B) - P(A \cap B)$

• Example: Probability of rolling a number greater than 3 or an even number on a die: Calculate $P(>3)$, $P(\text{even})$, and $P(>3 \cap \text{even})$.

Independent Events

Definition and Multiplication Rule

Independent events are those whose outcomes do not affect each other. The probability of both events A and B occurring is the product of their individual probabilities.

• Formula:

$P(A \cap B) = P(A) \times P(B)$

• Example: Probability of getting heads on two consecutive coin flips: $P(\text{heads first}) \times P(\text{heads second}) = \frac{1}{2} \times \frac{1}{2} = \frac{1}{4}$.

Contingency Tables and Probability

Definition and Types of Probability

A contingency table displays frequencies for combinations of categorical variables. Probabilities can be marginal, joint, or conditional.

• Marginal Probability: Probability of a single event.

• Joint Probability: Probability of two events occurring together.

• Conditional Probability: Probability of one event given another has occurred.

Formulas:

• Marginal: $P(A) = \frac{\text{total for A}}{\text{grand total}}$

• Joint: $P(A \cap B) = \frac{\text{cell frequency for A and B}}{\text{grand total}}$

• Conditional: $P(B|A) = \frac{\text{cell frequency for A and B}}{\text{row or column total for A}}$

Example Contingency Table

	Drives a Car: Yes	Drives a Car: No	Total
Senior	40	10	50
Junior	20	30	50
Total	60	40	100

• Marginal Probability: Probability a student is a senior: $P(\text{Senior}) = \frac{50}{100} = 0.5$

• Joint Probability: Probability a student is a senior and drives a car: $P(\text{Senior} \cap \text{Drives a Car}) = \frac{40}{100} = 0.4$

• Conditional Probability: Probability a student drives a car, given they are a senior: $P(\text{Drives a Car} | \text{Senior}) = \frac{40}{50} = 0.8$

Practice Problems and Applications

• Calculate probabilities using tables, sample spaces, and formulas for various scenarios (coins, dice, cards, spinners, surveys).

• Apply concepts of complement, mutual exclusivity, independence, and contingency tables to real-world and experimental data.

Summary Table: Probability Types and Formulas

Type	Definition	Formula	Example
Theoretical	Based on possible outcomes	$P(event) = \frac{\text{# outcomes with event}}{\text{total possible outcomes}}$	Rolling a 4 on a die: $\frac{1}{6}$
Empirical	Based on observed data	$P(event) = \frac{\text{# times event occurs}}{\text{# trials}}$	Rolling a 4 in 10 trials: $\frac{2}{10}$
Complement	Probability event does not occur	$P(A') = 1 - P(A)$	Not rolling a 4: $1 - \frac{1}{6}$
Mutually Exclusive	Events cannot occur together	$P(A \cup B) = P(A) + P(B)$	Rolling a 3 or 5: $\frac{2}{6}$
Non-Mutually Exclusive	Events can overlap	$P(A \cup B) = P(A) + P(B) - P(A \cap B)$	Rolling >3 or even: $P(>3) + P(\text{even}) - P(>3 \cap \text{even})$
Independent	Events do not affect each other	$P(A \cap B) = P(A) \times P(B)$	Two coin flips: $\frac{1}{2} \times \frac{1}{2}$
Conditional	Probability given another event	$P(B|A) = \frac{\text{cell freq for A and B}}{\text{row/col total for A}}$	Drives a car given senior: $\frac{40}{50}$

Additional info: These notes expand on the provided slides and tables, filling in missing context and formulas for clarity and completeness. All examples and formulas are standard for introductory college statistics courses.