Probability: Events, Sample Spaces, and Probability Rules

Probability: Events, Sample Spaces, and Probability Rules

Events, Sample Spaces, and Probability

Probability is a fundamental concept in statistics, providing a numerical measure of uncertainty. It allows us to quantify the likelihood of various outcomes in random experiments.

• Experiment: A process of observation that leads to a single outcome, which cannot be predicted with certainty in advance.

• Sample Point: The most basic possible outcome of an experiment.

• Sample Space (S): The set of all possible sample points for an experiment.

Examples of Sample Spaces:

• Toss a coin: S = {Head, Tail}

• Toss two coins: S = {HH, HT, TH, TT}

• Draw a card: S = {2♥, 2♠, ..., A♦}

• Inspect a part: S = {Defective, Good}

Events:

• Simple Event: Contains only one sample point.

• Compound Event: Contains two or more sample points.

Probability of an Event: The probability of an event A, denoted P(A), is a number between 0 and 1 that measures the likelihood of A occurring. The sum of probabilities for all sample points in the sample space is 1.

• 0 = Impossible event

• 1 = Certain event

Probability Rules for Sample Points:

• All probabilities must satisfy: $0 \leq p_i \leq 1$

• The sum of all probabilities: $\sum p_i = 1$

Equally Likely Probability:

• If all sample points are equally likely, $P(\text{Event}) = \frac{X}{T}$, where X is the number of outcomes in the event and T is the total number of sample points.

Steps for Calculating Probability:

1. Define the experiment and observation process.

2. List all sample points.

3. Assign probabilities to each sample point.

4. Identify the event of interest.

5. Sum the probabilities of the sample points in the event.

Combinations Rule

When selecting n elements from a set of N elements, the number of possible samples is given by the combinations formula:

$\binom{N}{n} = \frac{N!}{n!(N-n)!}$

where $n!$ (n factorial) is the product of all positive integers up to n, and $0! = 1$ by definition.

Unions and Intersections

Compound Events: Unions and Intersections

Compound events are formed by combining two or more events. The two main ways to combine events are unions and intersections:

• Union (A ∪ B): The event that either A or B or both occur. This is an 'OR' statement.

• Intersection (A ∩ B): The event that both A and B occur. This is an 'AND' statement.

Example: Drawing a card from a deck:

• Event Ace: {A♥, A♦, A♣, A♠}

• Event Black: {2♣, ..., A♠}

• Event Ace ∪ Black: All aces and all black cards

• Event Ace ∩ Black: {A♣, A♠}

Two-Way Tables

Two-way tables are useful for organizing probabilities of compound events involving two variables. They allow calculation of joint (intersection) and marginal (simple) probabilities.

	B1	B2	Total
A1	P(A1 ∩ B1)	P(A1 ∩ B2)	P(A1)
A2	P(A2 ∩ B1)	P(A2 ∩ B2)	P(A2)
Total	P(B1)	P(B2)	1

Example Table:

	Red	Black	Total
Ace	2/52	2/52	4/52
Non-Ace	24/52	24/52	48/52
Total	26/52	26/52	52/52

Complementary Events

Complementary Events and the Rule of Complements

The complement of an event A, denoted AC, is the event that A does not occur. The sum of the probabilities of an event and its complement is always 1:

$P(A) + P(A^C) = 1$

Example: If Event Black is drawing a black card, its complement is drawing a red card.

The Additive Rule and Mutually Exclusive Events

Mutually Exclusive Events

Events are mutually exclusive if they cannot occur at the same time (i.e., their intersection is empty).

• Additive Rule: For any two events A and B:

$P(A \cup B) = P(A) + P(B) - P(A \cap B)$

• If A and B are mutually exclusive: $P(A \cup B) = P(A) + P(B)$

Conditional Probability

Conditional Probability

Conditional probability is the probability of an event A given that another event B has occurred. It is denoted as P(A|B) and calculated as:

$P(A|B) = \frac{P(A \cap B)}{P(B)}$

Conditional probability revises the sample space to only those outcomes where B occurs.

The Multiplicative Rule and Independent Events

Multiplicative Rule

The multiplicative rule is used to find the probability of the intersection of two events:

$P(A \cap B) = P(A) \times P(B|A) = P(B) \times P(A|B)$

• If A and B are independent: $P(A \cap B) = P(A) \times P(B)$

Statistical Independence: Two events are independent if the occurrence of one does not affect the probability of the other. Tests for independence include:

• $P(A|B) = P(A)$

• $P(B|A) = P(B)$

• $P(A \cap B) = P(A) \times P(B)$

Tree Diagrams

Tree diagrams are useful for visualizing sequences of dependent or independent events, such as drawing objects without replacement. Each branch represents a possible outcome and its probability.

Example: Selecting 2 pens from 20 (14 blue, 6 red) without replacement:

• $P(R \cap R) = (6/20) \times (5/19) = 3/38$

• $P(R \cap B) = (6/20) \times (14/19) = 21/95$

• $P(B \cap R) = (14/20) \times (6/19) = 21/95$

• $P(B \cap B) = (14/20) \times (13/19) = 91/190$

Additional info: The images provided are only included where they directly reinforce the explanation of conditional probability using Venn diagrams. Other images were not included as they do not add direct educational value to the adjacent content.