Chapter 5: Probability – Structured Study Notes

Probability

Introduction to Probability

Probability is a fundamental concept in statistics that quantifies the likelihood of random phenomena or chance behavior. It is used to analyze experiments that yield unpredictable short-term results but demonstrate long-term predictability. The probability of an outcome is the long-term proportion in which that outcome is observed.

• Random Process: A scenario where the outcome of any particular trial is unknown, but the relative frequency of a particular outcome approaches a specific value as the number of trials increases.

• Law of Large Numbers: As the number of repetitions of a probability experiment increases, the observed proportion of a certain outcome approaches its theoretical probability.

Random Processes and Simulations

Random processes are unpredictable in the short term but predictable in the long term. Simulations are techniques used to recreate random events, either physically (e.g., flipping a coin) or virtually (e.g., computer simulations).

• Simulation: Used to measure how often a certain outcome is observed in repeated trials.

• Example: Flipping a coin 100 times and tracking the proportion of heads after each toss demonstrates the Law of Large Numbers.

Key Definitions in Probability

Understanding the terminology is essential for probability analysis:

• Experiment: Any process with uncertain results that can be repeated.

• Sample Space (S): The collection of all possible outcomes of an experiment.

• Event: Any collection of outcomes from a probability experiment. Simple events consist of one outcome; general events may include multiple outcomes.

Example: Rolling a Single Fair Die

Consider the experiment of rolling a single fair die:

• Outcomes: 1, 2, 3, 4, 5, 6

• Sample Space: S = {1, 2, 3, 4, 5, 6}

• Event E: Rolling an even number, E = {2, 4, 6}

• Fair Die: Each outcome is equally likely.

• Loaded Die: Some outcomes are more likely than others.

Rules of Probability

Basic Probability Rules

Probability values are governed by two fundamental rules:

• Rule 1: The probability of any event E, denoted P(E), must satisfy $0 \leq P(E) \leq 1$.

• Rule 2: The sum of the probabilities of all outcomes in the sample space must equal 1: $\sum_{i=1}^{n} P(e_i) = 1$.

Probability Model

A probability model lists all possible outcomes and their associated probabilities. It must satisfy the two rules above.

• Impossible Event: Probability is 0.

• Certain Event: Probability is 1.

• Unusual Event: An event with a low probability of occurring.

Example: Probability Model for M&M Colors

Suppose a candy is randomly selected from a bag of M&Ms. The probability model is:

Color	Probability
Brown	0.13
Yellow	0.14
Red	0.13
Blue	0.24
Orange	0.20
Green	0.16

Each probability is between 0 and 1, and their sum is 1, so this is a valid probability model.

Empirical Method for Probability

Computing Probabilities Using the Empirical Method

The empirical method estimates probabilities based on observed data. The probability of an event E is approximated by the relative frequency:

• Formula: $P(E) \approx \frac{\text{frequency of } E}{\text{number of trials}}$

• Example: If 24 out of 182 insured teenage drivers filed a claim, $P(E) = \frac{24}{182} \approx 0.132$.

Building Probability Models from Survey Data

Survey data can be used to construct probability models. For example, a survey of 200 people about their means of travel to work yields:

Means of Travel	Probability
Drive alone	0.765
Carpool	0.11
Public transportation	0.05
Walk	0.025
Other means	0.015
Work at home	0.035

• Interpretation: Probability that a randomly selected individual carpools is 0.11. Probability that an individual walks to work is 0.025, which is considered unusual.

Classical Method for Probability

Computing Probabilities Using the Classical Method

The classical method applies when outcomes are equally likely. The probability of an event E is:

• Formula: $P(E) = \frac{\text{number of ways } E \text{ can occur}}{\text{number of possible outcomes}}$

• Alternate Formula: $P(E) = \frac{N(E)}{N(S)}$ where $N(E)$ is the number of outcomes in E and $N(S)$ is the number of outcomes in the sample space.

Example: Rolling Two Fair Dice

• Sample Space: 36 equally likely outcomes.

• Probability of rolling a seven: 6 outcomes (e.g., (1,6), (2,5), ...), $P(E) = \frac{6}{36} = \frac{1}{6}$.

• Probability of rolling a two: 1 outcome (1,1), $P(F) = \frac{1}{36}$.

• Comparison: Rolling a seven is six times as likely as rolling a two.

Example: Random Selection

• Sample Space: Six possible pairs from four people (Yolanda, Michael, Kevin, Marissa).

• Probability Michael and Kevin attend: $\frac{1}{6}$.

• Probability Marissa attends: $\frac{3}{6} = 0.5$.

• Interpretation: In 1000 trials, expect about 500 times Marissa attends.

Comparing Classical and Empirical Methods

• Empirical Method: Based on observed data. E.g., 180 out of 500 families have two boys and one girl, $P(E) = \frac{180}{500} = 0.36$.

• Classical Method: Based on equally likely outcomes. For three children, sample space has 8 outcomes; three ways to have two boys and one girl, $P(E) = \frac{3}{8} = 0.375$.

• Interpretation: In 1000 trials, expect about 375 families with two boys and one girl.

Subjective Probability

Recognizing and Interpreting Subjective Probabilities

Subjective probability is based on personal judgment rather than empirical or classical methods. It is often used in situations where data is unavailable or outcomes are not equally likely.

• Example: An economist predicts a 20% chance of recession next year based on expert opinion.