Fundamentals of Probability: Concepts, Rules, and Applications

Probability Fundamentals

Probability Experiments, Outcomes, and Events

Probability is the study of uncertainty and randomness in experiments. Understanding the basic terminology is essential for analyzing and solving probability problems.

• Probability Experiment: A chance process that leads to well-defined results called outcomes.

• Outcome: The result of a single trial of a probability experiment.

• Sample Space (S): The set of all possible outcomes of a probability experiment.

• Event: A subset of the sample space; consists of one or more outcomes.

• Simple Event: An event that cannot be broken down into simpler components.

• Compound Event: An event that consists of two or more outcomes or simple events.

Examples of Sample Spaces

Experiment	Sample Space
Toss a coin	Head, Tail
Roll a die	1, 2, 3, 4, 5, 6
Answer a true/false question	True, False
Toss two coins	HH, HT, TH, TT

Probability Notation and Definitions

Events and Probability Notation

Specific events are often denoted by capital letters such as A, B, and C. The probability of an event A occurring is denoted as P(A).

• Probability (P): The chance of an event occurring, expressed as a number between 0 and 1.

• Applications: Probability is used in weather forecasting, insurance, and predicting outcomes in various fields.

Sample Space for Rolling Two Dice

Die 1	Die 2
(1,1)	(1,2)
(1,3)	(1,4)
(1,5)	(1,6)
(2,1)	(2,2)
...	...

Additional info: The full sample space for two dice consists of 36 ordered pairs.

Interpretations of Probability

Types of Probability

There are three basic interpretations of probability:

• Classical Probability: Based on equally likely outcomes in the sample space.

• Empirical Probability: Based on actual experience or experiments.

• Subjective Probability: Based on intuition, educated guesses, or estimates.

Classical Probability Formula

For an event E:

$P(E) = \frac{n(E)}{n(S)}$

Where $n(E)$ is the number of desired outcomes and $n(S)$ is the total number of possible outcomes.

Empirical Probability Formula

Based on observed data:

$P(E) = \frac{f}{n}$

Where $f$ is the frequency of the desired class and $n$ is the sum of all frequencies.

Probability Limits and Properties

Probability Limits

Probabilities must always be expressed as a fraction or decimal between 0 and 1.

• The probability of an impossible event is 0.

• The probability of a certain event is 1.

• For any event A: $0 \leq P(A) \leq 1$

Complement of an Event

The complement of event E, denoted by $\overline{E}$, is the set of outcomes in the sample space not included in E.

$P(E) = 1 - P(\overline{E})$

Probability Rules (Properties)

• $0 \leq P(E) \leq 1$

• $P(\emptyset) = 0$

• $P(S) = 1$

• $\sum P(E_i) = 1$ (for all mutually exclusive events $E_i$ in the sample space)

• $P(E) + P(\overline{E}) = 1$

Odds and Payoff Odds

Understanding Odds

Odds provide another way to express the likelihood of events, commonly used in gambling and risk assessment.

• Actual Odds Against: $\frac{P(\overline{A})}{P(A)}$, expressed as a:b where a and b have no common factors.

• Actual Odds In Favor: $\frac{P(A)}{P(\overline{A})}$, reciprocal of odds against.

• Payoff Odds Against: Ratio of net profit to amount bet: (net profit) : (amount bet).

Tree Diagrams and Sample Spaces

Tree Diagrams

Tree diagrams are visual tools used to enumerate all possible outcomes of a probability experiment, especially when multiple stages are involved.

• Each branch represents a possible outcome at each stage.

• Tree diagrams help in calculating probabilities for compound events.

Example: Gender of Three Children

Sample Space
BBB, BBG, BGB, BGG, GBB, GBG, GGB, GGG

Probability that two of three children are girls: $\frac{3}{8}$

Summary Table: Probability Concepts

Concept	Definition	Formula
Classical Probability	Equally likely outcomes	$P(E) = \frac{n(E)}{n(S)}$
Empirical Probability	Based on observed data	$P(E) = \frac{f}{n}$
Complement	Probability of not E	$P(E) = 1 - P(\overline{E})$
Odds Against	Ratio of failure to success	$\frac{P(\overline{A})}{P(A)}$
Odds In Favor	Ratio of success to failure	$\frac{P(A)}{P(\overline{A})}$

Possible Values for Probabilities

Probabilities range from 0 (impossible) to 1 (certain), with intermediate values representing varying degrees of likelihood.

Additional Examples and Applications

• Weather forecasting: "75% chance of snow" means $P( ext{snow}) = 0.75$.

• Insurance rates: Probabilities are used to assess risk and set premiums.

• Games of chance: Calculating odds and probabilities for outcomes in dice, cards, and lotteries.

Additional info: These notes provide foundational concepts for further study in probability, including advanced topics such as conditional probability, independence, and combinatorics.