Chapter 4: Probability – Concepts, Rules, and Applications

Probability: Basic Concepts and Definitions

Inferential Statistics and Probability

Inferential statistics involves drawing conclusions about a population based on data collected from a sample. Probability provides the mathematical foundation for making these inferences, quantifying the likelihood of various outcomes.

• Experiment: An activity or process that produces observable outcomes (e.g., tossing a coin, rolling a die).

• Event: Any collection of outcomes from an experiment.

• Simple Event: An event that cannot be decomposed further (e.g., rolling a 3 on a die).

• Compound Event: An event composed of two or more simple events.

• Sample Space (S): The set of all possible outcomes of an experiment.

Example: Rolling a die: S = {1, 2, 3, 4, 5, 6}; Event A (even number) = {2, 4, 6}

Tree Diagrams and Sample Spaces

Tree diagrams are useful for visualizing all possible outcomes of multi-stage experiments, such as sequences of births or coin tosses.

Example: Three births: S = {bbb, bbg, bgb, bgg, gbb, gbg, ggb, ggg}

Sample Space Representation

Sample spaces can also be represented visually, such as with a spinner or wheel, where each outcome is equally likely.

Example: S = {1P, 2Y, 3Y, 4B, 5B, 6B, 7R, 8P}

Relationships Among Events

Subsets and Complements

An event A is a subset of the sample space S (A ⊆ S). The complement of an event A, denoted A' or A̅, consists of all outcomes in S that are not in A.

Example: If A = {1, 2}, then A' = {3, 4, 5, 6} in S = {1, 2, 3, 4, 5, 6}

Union and Intersection of Events

The union (A ∪ B) includes all outcomes in A, B, or both. The intersection (A ∩ B) includes only outcomes common to both A and B.

• Mutually Exclusive (Disjoint) Events: Events with no outcomes in common (A ∩ B = ∅).

Contingency Tables

Definition and Application

A contingency table (two-way table) displays the frequency distribution of variables, allowing for the analysis of relationships between categorical variables.

	Positive Test (P)	Negative Test (N)
Uses Drugs (D)	44	6
Does Not Use Drugs (D')	90	860

Example Questions:

• Number who got positive test results and used drugs: 44

• Number who got positive test results or used drugs: 44 + 90 + 6 = 140

• Among drug users, number with negative results: 6

Basic Properties and Approaches to Probability

Probability Notation and Properties

• Probability of event A: P(A)

• 0 ≤ P(A) ≤ 1

• P(S) = 1 (the probability of the sample space is 1)

• P(impossible event) = 0

Approaches to Probability

1. Relative Frequency Approximation: $P(A) = \frac{\text{number of times A occurred}}{\text{number of trials}}$

2. Classical Approach (Equally Likely Outcomes): $P(A) = \frac{\text{number of outcomes in A}}{\text{number of possible outcomes}}$

3. Subjective Probability: Based on personal judgment or experience.

Law of Large Numbers: As the number of trials increases, the relative frequency probability approaches the actual probability.

Addition and Multiplication Rules

Addition Rule

The probability that event A or event B occurs is given by:

$P(A \cup B) = P(A) + P(B) - P(A \cap B)$

If A and B are mutually exclusive: $P(A \cup B) = P(A) + P(B)$

Multiplication Rule

The probability that both events A and B occur is:

$P(A \cap B) = P(A) \cdot P(B|A) = P(B) \cdot P(A|B)$

If A and B are independent: $P(A \cap B) = P(A) \cdot P(B)$

Sampling With and Without Replacement

• With Replacement: Each selection is independent.

• Without Replacement: Selections are dependent; probabilities change after each draw.

Complements, Conditional Probability, and Bayes’ Theorem

Complementation Rule

The probability of an event not occurring is:

$P(A') = 1 - P(A)$

Conditional Probability

The probability of event A occurring given that event B has occurred is:

$P(A|B) = \frac{P(A \cap B)}{P(B)}$

Example: If 13 out of 20 people are female, and 8 own a pet, the probability that a randomly selected person is female is $\frac{13}{20}$, and the probability that a person owns a pet is $\frac{8}{20}$.

Applications of Conditional Probability

• Given a person is a Democrat, probability they are male: $P(\text{male}|\text{Democrat}) = \frac{300}{900} = 0.3$

• Given a person is female, probability they are Democrat: $P(\text{Democrat}|\text{female}) = \frac{600}{1000} = 0.6$

Summary Table: Key Probability Rules

Rule	Formula	When to Use
Addition Rule	$P(A \cup B) = P(A) + P(B) - P(A \cap B)$	Finding probability of A or B
Multiplication Rule	$P(A \cap B) = P(A) \cdot P(B|A)$	Finding probability of A and B
Complement Rule	$P(A') = 1 - P(A)$	Finding probability of not A
Conditional Probability	$P(A|B) = \frac{P(A \cap B)}{P(B)}$	Probability of A given B

Additional info:

• Bayes’ Theorem, while not explicitly covered in the provided material, is a key extension of conditional probability for updating probabilities based on new evidence.

• Contingency tables are foundational for later topics such as chi-square tests and analysis of categorical data.