Introductory Statistics: Chapter 4 – Probability

Probability: Foundations and Concepts

Introduction to Probability

Probability is a fundamental concept in statistics that quantifies how likely an event is to occur. It provides a mathematical framework for making inferences about data and populations, and is essential for understanding randomness and uncertainty in real-world situations.

• Probability: How often something occurs or is expected to occur.

• Probability gives us information about data in a widely accessible format.

• Probability theory is used to make decisions about populations, often employing the Rare Event Rule.

Rare Event Rule for Inferential Statistics

The Rare Event Rule is a principle used in inferential statistics to determine whether an observed event is statistically significant. If, under a given assumption, the probability of an observed event is extremely small, the assumption is likely incorrect.

• Such an event is called statistically significant—it is too unlikely to occur by chance alone.

• This rule is foundational for hypothesis testing and will be revisited in later chapters.

Basic Probability Terms and Sample Space

Key Terms

• Event: An outcome of a procedure.

• Simple Event: An event that cannot be broken down into simpler components.

• Outcome: The result of a single trial in a procedure.

• Sample Space: The set of all possible outcomes of a procedure.

Tree Diagrams and Sample Space

Tree diagrams are visual tools used to systematically list all possible outcomes (the sample space) of a probability experiment, especially when there are multiple stages or choices.

• Each branch represents a possible outcome at each stage.

• Tree diagrams help in finding probabilities of compound events.

Examples: Finding Sample Spaces

• One roll of a six-sided die: {1, 2, 3, 4, 5, 6}

• One coin flip: {Heads, Tails}

• Two coin flips: {HH, HT, TH, TT}

• Three coin flips: {HHH, HHT, HTH, HTT, THH, THT, TTH, TTT}

Counting Principles in Probability

Fundamental Counting Principle

The Fundamental Counting Principle is a method for determining the total number of possible outcomes in a multi-stage experiment. Multiply the number of possible outcomes for each part of the procedure.

• For example, if you have 3 shirts and 2 pants, there are 3 × 2 = 6 possible outfits.

Application Example: Car Selection

Suppose you are purchasing a new car. The possible manufacturers are Ford, GM, and Honda; car sizes are compact and midsize; colors are white (W), red (R), black (B), and green (G). The total number of ways to select one manufacturer, one car size, and one color is:

• Number of ways = 3 (manufacturers) × 2 (sizes) × 4 (colors) = 24

Practice Problems: Counting Outcomes

• How many outfits can you make with 4 shirts, 3 pairs of pants, and 3 pairs of shoes? (4 × 3 × 3 = 36)

• An internet password consists of five capital letters, each used only once. How many passwords can be formed? (26 × 25 × 24 × 23 × 22)

• A door passcode uses four digits. The second digit must be four. The last digit must be even. How many passcodes are possible?

• How many ways can you put 6 books on a shelf? (6! = 720)

Factorial Notation

The factorial symbol, "!", denotes the product of all positive integers up to a given number. It is used in counting arrangements and permutations.

• For example, $4! = 4 \cdot 3 \cdot 2 \cdot 1 = 24$

• By definition, $0! = 1$

Probability Rules and Calculations

Probability Rules

• Probabilities are usually expressed as fractions or decimals.

• For any event, $0 \leq P(A) \leq 1$

• If $P(A) = 0$, the event is impossible.

• If $P(A) = 1$, the event is certain.

Example: Valid Probabilities

Determine which of the following numbers cannot be probabilities and explain why: 15, 1.11, 0, 1, 0.3948, $\sqrt{5}$, 0.99, 0.0001, -0.2938.

• Valid probabilities must be between 0 and 1, inclusive. Numbers like 15, 1.11, $\sqrt{5}$ (since $\sqrt{5} > 2$), and -0.2938 are not valid probabilities.

Classical vs. Relative Frequency Probability

• Classical Probability: Used when all outcomes are equally likely. Probability is calculated without conducting the experiment.

• Relative Frequency Probability: Based on actual data from repeated trials. Probability is approximated by the frequency of the event.

Calculating Probability

The probability of an event A, denoted $P(A)$, is calculated as:

$P(A) = \frac{\text{number of occurrences of A}}{\text{total number of outcomes}}$

Summary Table: Key Probability Concepts

Term	Definition	Example
Event	An outcome of a procedure	Rolling a 4 on a die
Sample Space	All possible outcomes	{1, 2, 3, 4, 5, 6} for a die
Classical Probability	All outcomes equally likely	Probability of heads in a coin flip: 0.5
Relative Frequency	Based on experimental data	Observed heads in 100 flips: 0.48
Factorial (n!)	Product of all positive integers up to n	4! = 24