Chapter 5: Probability – Rules, Methods, and Applications

Probability: Rules, Methods, and Applications

Understanding Random Processes and the Law of Large Numbers

Probability is the mathematical study of random phenomena and uncertainty. It provides a framework for quantifying the likelihood of various outcomes in random experiments. The Law of Large Numbers is a foundational concept that describes how the relative frequency of an event stabilizes as the number of trials increases.

• Random Process: A process whose outcome cannot be predicted with certainty, but the set of all possible outcomes is known.

• Law of Large Numbers: As the number of repetitions of a probability experiment increases, the proportion with which a certain outcome is observed gets closer to the actual probability of the outcome.

• Example: Rolling a die many times and recording the proportion of times a 'four' appears. As the number of rolls increases, the observed proportion approaches 1/6.

Probability Rules and Models

Probability rules provide the foundation for calculating the likelihood of events. A probability model assigns probabilities to all possible outcomes of a random experiment.

• Probability of an Event (P(E)): The likelihood that event E occurs.

• Rules of Probability:

  • 0 ≤ P(E) ≤ 1 for any event E.

  • The sum of the probabilities of all outcomes in the sample space is 1.

  • If events are mutually exclusive, P(E or F) = P(E) + P(F).

• Example Probability Model:

Color	Probability
Yellow	0.12
Red	0.17
Orange	0.21
Green	0.17
Blue	0.33

Empirical and Classical Probability

There are two main approaches to calculating probabilities: empirical (based on observation) and classical (based on equally likely outcomes).

• Empirical Probability: Based on observations from experiments or historical data.

• Classical Probability: Used when all outcomes are equally likely. The probability of event E is:

$P(E) = \frac{\text{Number of outcomes in E}}{\text{Number of outcomes in sample space}}$

• Example: Probability of drawing a yellow candy from a bag with 4 yellow, 7 red, 6 orange, and 3 green candies:

$P(\text{yellow}) = \frac{4}{4+7+6+3} = \frac{4}{20} = 0.20$

Subjective Probability

Subjective probability is based on personal judgment or experience rather than precise calculation or empirical data.

• Example: Estimating a 20% chance of rain tomorrow based on personal experience.

Addition Rule for Events

The addition rule is used to find the probability that at least one of several events occurs.

• Addition Rule for Disjoint Events: If E and F are mutually exclusive,

$P(E \text{ or } F) = P(E) + P(F)$

• General Addition Rule: For any two events E and F,

$P(E \text{ or } F) = P(E) + P(F) - P(E \text{ and } F)$

• Example: Probability that a randomly selected house has one or two rooms:

Number of Rooms	Probability
One	0.010
Two	0.031
Three	0.071
Four	0.171
Five	0.217
Six	0.179
Seven	0.127
Eight	0.079
Nine or more	0.115

Complement Rule

The complement rule is used to find the probability that an event does not occur.

• Complement Rule:

$P(E') = 1 - P(E)$

• Example: If 37.6% of households own a dog, the probability that a randomly selected household does not own a dog is:

$P(\text{no dog}) = 1 - 0.376 = 0.624$

Independence and the Multiplication Rule

Events are independent if the occurrence of one does not affect the probability of the other. The multiplication rule is used to find the probability that two independent events both occur.

• Multiplication Rule for Independent Events:

$P(E \text{ and } F) = P(E) \times P(F)$

• Example: Probability that two randomly selected students are both female, if 60% of students are female:

$P(\text{female and female}) = 0.6 \times 0.6 = 0.36$

Conditional Probability and the General Multiplication Rule

Conditional probability is the probability of one event occurring given that another event has occurred. The general multiplication rule applies to both independent and dependent events.

• Conditional Probability:

$P(E|F) = \frac{P(E \text{ and } F)}{P(F)}$

• General Multiplication Rule:

$P(E \text{ and } F) = P(E|F) \times P(F)$

Counting Techniques: Multiplication Rule, Permutations, and Combinations

Counting techniques are essential for determining the number of possible outcomes in probability problems.

• Multiplication Rule of Counting: If a procedure can be broken into k stages, with n1 ways for the first stage, n2 for the second, etc., the total number of outcomes is:

$N = n_1 \times n_2 \times \cdots \times n_k$

• Permutations: Arrangements of objects where order matters.

$P(n, r) = \frac{n!}{(n-r)!}$

• Combinations: Selections of objects where order does not matter.

$C(n, r) = \frac{n!}{r!(n-r)!}$

• Example: Number of ways to choose 3 marbles from a jar containing 4 red, 5 blue, and 3 yellow marbles:

$C(12, 3) = \frac{12!}{3!9!} = 220$

Simulation in Probability

Simulation uses random processes, often with computers, to estimate probabilities when theoretical calculation is difficult or impossible.

• Example: Simulating a poll by randomly selecting samples from a population to estimate the proportion with a certain characteristic.

Summary Table: Key Probability Rules

Rule	Formula
Complement Rule	$P(E') = 1 - P(E)$
Addition Rule (Disjoint Events)	$P(E \text{ or } F) = P(E) + P(F)$
Addition Rule (General)	$P(E \text{ or } F) = P(E) + P(F) - P(E \text{ and } F)$
Multiplication Rule (Independent Events)	$P(E \text{ and } F) = P(E) \times P(F)$
Conditional Probability	$P(E|F) = \frac{P(E \text{ and } F)}{P(F)}$
Multiplication Rule (General)	$P(E \text{ and } F) = P(E|F) \times P(F)$

Additional info:

• These notes cover the foundational concepts of probability, including empirical and classical approaches, probability rules, counting techniques, and simulation methods. They are essential for understanding more advanced topics in statistics and data analysis.