Chapter 5 - Probability Rules and Applications: Coin Tosses, Events, and Conditional Probability

Probability and Coin Toss Experiments

Introduction to Probability

Probability is a branch of mathematics that quantifies the likelihood of events occurring. In statistics, probability forms the foundation for making inferences about populations based on sample data. This section explores probability concepts using the example of coin toss experiments.

• Experiment: Tossing a fair coin multiple times and recording outcomes.

• Sample Space (S): The set of all possible outcomes. For a single coin toss, S = {H, T}.

• Event: A subset of the sample space, such as getting heads (H) or tails (T).

• Law of Large Numbers: As the number of trials increases, the experimental probability approaches the theoretical probability.

• Example: Toss a fair coin 10 times, repeat the experiment 1000 times, and organize the results into pie charts to summarize the data.

Probability Rules and Methods

Classical, Empirical, and Frequency Approaches

There are several methods to determine probabilities:

• Classical Probability: Assumes all outcomes in the sample space are equally likely. $P(A) = \frac{\text{Number of outcomes in event A}}{\text{Total number of possible outcomes}}$

• Empirical Probability: Based on observations from experiments. $P(A) = \frac{\text{Frequency of event A}}{\text{Total number of trials}}$

• Frequency Method: Similar to empirical, uses observed frequencies to estimate probabilities.

• Example: In 1000 coin tosses, if heads occurs 510 times, $P(H) = \frac{510}{1000} = 0.51$

Events and Their Properties

Simple, Impossible, and Unusual Events

• Simple Event: An event with a single outcome (e.g., getting heads in a coin toss).

• Impossible Event: An event that cannot occur (e.g., getting a birthday on February 31). $P(\text{Impossible Event}) = 0$

• Unusual Event: An event with a very low probability (e.g., winning the lottery).

Venn Diagrams and Event Relationships

Visualizing Events

Venn diagrams are used to represent relationships between events in a sample space.

• Intersection (A and B): The set of outcomes common to both events A and B.

• Union (A or B): The set of outcomes in either event A, event B, or both.

• Complement (Ac): The set of outcomes not in event A. $P(A^c) = 1 - P(A)$

• Disjoint (Mutually Exclusive) Events: Events that cannot occur together (no intersection). For disjoint events, $P(A \text{ and } B) = 0$

Rules of Probability

Addition Rule

The addition rule is used to find the probability that at least one of two events occurs.

• General Addition Rule: $P(A \text{ or } B) = P(A) + P(B) - P(A \text{ and } B)$

• Special Case (Disjoint Events): If A and B are mutually exclusive, $P(A \text{ or } B) = P(A) + P(B)$

• Example: If $P(M) = 0.6$, $P(E) = 0.7$, $P(M \text{ and } E) = 0.3$, then $P(M \text{ or } E) = 0.6 + 0.7 - 0.3 = 1.0$

Multiplication Rule and Independence

The multiplication rule is used to find the probability that two events both occur.

• General Multiplication Rule: $P(A \text{ and } B) = P(A) \times P(B|A)$

• Independent Events: Events A and B are independent if the occurrence of one does not affect the probability of the other. For independent events, $P(A \text{ and } B) = P(A) \times P(B)$

• Example: Tossing a coin twice. Probability of getting heads both times: $P(H \text{ and } H) = P(H) \times P(H) = 0.5 \times 0.5 = 0.25$

• Note: Disjoint events are not the same as independent events. Disjoint events cannot occur together, while independent events can.

Conditional Probability

Definition and Calculation

Conditional probability measures the probability of an event occurring given that another event has already occurred.

• Conditional Probability Formula: $P(F|E) = \frac{P(F \text{ and } E)}{P(E)}$

• For Independent Events: $P(F \text{ and } E) = P(F) \times P(E)$

• Example: If $P(M) = 0.6$, $P(E) = 0.7$, $P(M \text{ and } E) = 0.3$, then $P(M|E) = \frac{0.3}{0.7} \approx 0.429$

Contingency Tables

Organizing Data for Probability Calculations

Contingency tables (also called two-way tables) are used to organize data according to two categorical variables, making it easier to compute probabilities, intersections, and conditional probabilities.

	Event E	Not E	Total
Event M	n(M and E)	n(M and not E)	n(M)
Not M	n(not M and E)	n(not M and not E)	n(not M)
Total	n(E)	n(not E)	N

Additional info: The table above is a general structure for organizing joint and marginal frequencies for two events, which aids in calculating probabilities and conditional probabilities.

Summary Table: Key Probability Rules

Rule	Formula	When to Use
Addition Rule	$P(A \text{ or } B) = P(A) + P(B) - P(A \text{ and } B)$	To find probability of A or B occurring
Multiplication Rule	$P(A \text{ and } B) = P(A) \times P(B|A)$	To find probability of both A and B occurring
Multiplication Rule (Independent)	$P(A \text{ and } B) = P(A) \times P(B)$	When A and B are independent
Complement Rule	$P(A^c) = 1 - P(A)$	To find probability of event not occurring
Conditional Probability	$P(F|E) = \frac{P(F \text{ and } E)}{P(E)}$	Probability of F given E has occurred