Probability and Counting Principles in Statistics: Study Notes Chapter. 3

Probability and Counting Principles

Introduction to Probability in Statistics

Probability is a foundational concept in inferential statistics, allowing us to make predictions and draw conclusions from data. Understanding probability is essential for analyzing random events and quantifying uncertainty in outcomes.

• Descriptive statistics summarize data, while inferential statistics use probability to make predictions about populations based on samples.

• Probability provides the mathematical framework for inferential methods.

Basic Concepts of Probability and Counting

Probability Experiments and Sample Space

A probability experiment is an action or process that leads to one or more outcomes. The set of all possible outcomes is called the sample space.

• Probability experiment: An action or trial with specific results (e.g., rolling a die, drawing a card).

• Sample space (S): The set of all possible outcomes. Example: Rolling a die, S = {1, 2, 3, 4, 5, 6}.

• Outcome: The result of a single trial (e.g., rolling a 4).

• Event: A subset of the sample space, consisting of one or more outcomes (e.g., rolling an even number: {2, 4, 6}).

Types of Events

• Simple event: An event with a single outcome (e.g., rolling a 3).

• Compound event: An event with more than one outcome (e.g., rolling an even number).

• Example: Tossing a coin and rolling a die: Simple event: H3 (heads and 3). Compound event: H2, H4, H6 (heads and even number).

Examples: Simple or Not Simple Events

• Selecting a part from a batch: If only one part is selected, it is a simple event.

• Rolling a die and looking for at least a 4: Not a simple event (multiple outcomes: 4, 5, 6).

• Polling students for age: If the event is a specific age, it is simple; if a range, it is not.

Determining the Sample Space

Sample space can be determined by listing all possible outcomes, often using tree diagrams for complex situations.

• Example: Blood types (O, A, B, AB) and Rh factor (positive/negative): 4 types × 2 Rh states = 8 outcomes.

Blood Type	Rh+	Rh-
O	O+	O-
A	A+	A-
B	B+	B-
AB	AB+	AB-

Sample Space and Outcomes: Survey Examples

• 1-question survey with 3 response options (yes, no, unsure) and 2 sexes (M/F): 3 × 2 = 6 outcomes.

• Likert scale (4 options) × 4 age groups: 4 × 4 = 16 outcomes.

Fundamental Counting Principle

Definition and Application

The Fundamental Counting Principle states that if one event can occur in m ways and another in n ways, the total number of ways both can occur in sequence is m × n. This extends to any number of events.

• Formula: For k events with n1, n2, ..., nk possible outcomes: $n_1 \times n_2 \times \cdots \times n_k$

• Example: 3 car makes × 2 sizes × 4 colors = 24 possible cars.

• PIN codes: 4 digits, no repeats: 10 × 9 × 8 × 7 = 5040 codes. With repeats: 10 × 10 × 10 × 10 = 10,000 codes.

Theoretical and Empirical Probability

Theoretical Probability

Theoretical probability assumes all outcomes are equally likely. The probability of event E is:

• Formula: $P(E) = \frac{\text{Number of outcomes in } E}{\text{Total number of outcomes in sample space}}$

• Example: Rolling a 3 on a die: $P(3) = \frac{1}{6}$

• Selecting a heart from a deck: $P(\text{heart}) = \frac{13}{52} = \frac{1}{4}$

Empirical (Statistical) Probability

Empirical probability is based on observed data, not theoretical assumptions. It is calculated as the relative frequency of an event.

• Formula: $P(E) = \frac{\text{Frequency of } E}{\text{Total number of trials}}$

• Example: If 560 out of 1502 adults read print books: $P(\text{read print}) = \frac{560}{1502} \approx 0.373$

Law of Large Numbers

As an experiment is repeated many times, the empirical probability approaches the theoretical probability.

• Example: Tossing a coin many times, the proportion of heads approaches 0.5.

Rules in Probability

Probability Values and Complements

• Probability values range from 0 to 1: $0 \leq P(E) \leq 1$

• The probability of the complement of event E: $P(E') = 1 - P(E)$

• Events with probability ≤ 0.05 are considered unlikely.

Conditional Probability and the Multiplication Rule

Conditional Probability

Conditional probability is the probability of event B occurring, given that event A has already occurred. It is denoted $P(B|A)$.

• Formula: $P(B|A) = \frac{P(A \text{ and } B)}{P(A)}$

• Example: Probability that the second card is a queen, given the first is a king (without replacement): $P(B|A) = \frac{4}{51}$

Independent and Dependent Events

• Independent events: The occurrence of one does not affect the probability of the other. $P(B|A) = P(B)$

• Dependent events: The occurrence of one affects the probability of the other. $P(B|A) \neq P(B)$

• Example: Drawing cards without replacement is dependent; tossing a coin and rolling a die are independent.

Multiplication Rule

• General rule: $P(A \text{ and } B) = P(A) \times P(B|A)$

• For independent events: $P(A \text{ and } B) = P(A) \times P(B)$

• Example: Probability of tossing a head and rolling a 6: $P(H \text{ and } 6) = \frac{1}{2} \times \frac{1}{6} = \frac{1}{12}$

Addition Rule and Mutually Exclusive Events

Mutually Exclusive Events

Two events are mutually exclusive if they cannot occur at the same time (no overlap in outcomes).

• Example: Drawing a card that is both a 4 and an ace is impossible.

Addition Rule

• General rule: $P(A \text{ or } B) = P(A) + P(B) - P(A \text{ and } B)$

• For mutually exclusive events: $P(A \text{ or } B) = P(A) + P(B)$

• Example: Probability of drawing a 4 or an ace: $P(4 \text{ or ace}) = \frac{4}{52} + \frac{4}{52} = \frac{8}{52} = \frac{2}{13}$

• Non-mutually exclusive: Subtract the overlap: $P(A \text{ or } B) = P(A) + P(B) - P(A \text{ and } B)$

Examples with Tables

Tables are often used to organize data for probability calculations, such as blood types or survey responses.

Blood Type	Number of Donors
O	45
A	37
B	12
AB	8
Total	102

• Example: Probability donor has type O or A: $P(O \text{ or } A) = \frac{45 + 37}{102} = \frac{82}{102}$

Summary Table: Key Probability Rules

Rule	Formula	When to Use
Complement	$P(E') = 1 - P(E)$	Finding probability of 'not E'
Multiplication (Independent)	$P(A \text{ and } B) = P(A) \times P(B)$	Events do not affect each other
Multiplication (Dependent)	$P(A \text{ and } B) = P(A) \times P(B|A)$	Events affect each other
Addition (Mutually Exclusive)	$P(A \text{ or } B) = P(A) + P(B)$	No overlap between events
Addition (General)	$P(A \text{ or } B) = P(A) + P(B) - P(A \text{ and } B)$	Events may overlap

Applications and Examples

• Calculating probabilities in card games, dice rolls, and surveys.

• Using tree diagrams and tables to enumerate sample spaces and outcomes.

• Applying the counting principle to determine the number of possible combinations in real-world scenarios (e.g., PIN codes, license plates).

Additional info: These notes are based on lecture slides for a college-level statistics course, focusing on foundational probability concepts, rules, and applications relevant for exam preparation.