Probability and Random Variables: Foundations and Rules

Chapter 12 & 13: Probability and Random Variables

Random Samples

Random samples are fundamental to statistics, as they introduce variability due to the process of random selection. Understanding this variability is essential for studying probability, which is the mathematical framework for describing random behavior.

• Random Sample: A subset of individuals chosen from a population in such a way that every possible sample has a predetermined probability of being selected.

• Statistical Variability: The differences in statistics calculated from different random samples.

Random Processes

Random processes are experiments or observational studies where the outcome is uncertain, but regular patterns emerge over many repetitions.

• Chance Behavior: Individual outcomes are unpredictable, but a regular distribution appears in the long run.

• Unpredictable in the Short Run: Each trial is uncertain, but the overall pattern is predictable over many trials.

• Random processes are often referred to as experiments.

Basic Terminology

• Outcome: The most basic possible result from a random process (e.g., rolling a 1 on a die).

• Event: A collection of one or more outcomes (e.g., rolling an odd number on a die).

• Sample Space (S): The set of all possible outcomes of a random process.

Examples of Outcomes and Events

• Rolling a die: S = {1, 2, 3, 4, 5, 6}

• Tossing a coin: S = {H, T}

• Drawing a card: S = {all 52 cards in a deck}

• Rolling an odd number: Event A = {1, 3, 5}

• Flipping exactly two heads in three coin tosses: Event B = {(H, H, T), (H, T, H), (T, H, H)}

The Sample Space S

The sample space S is the set of all possible outcomes of a random process. Events are subsets of S.

• Example 1: Rolling a die: S = {1, 2, 3, 4, 5, 6}

• Example 2: Tossing a coin: S = {H, T}

• Example 3: A business is either open or closed after two years: S = {open, close}

• Example 4: Inspecting four CD players, each rated as acceptable (A) or unacceptable (U): S = {AAAA, AAAU, AAUA, AAUU, ...} (all possible sequences of A and U for four items)

Tree Diagrams

Tree diagrams are useful for visualizing all possible outcomes of multi-stage random processes, such as flipping a coin three times or rating multiple items.

• For three coin flips, the sample space is: S = {(H, H, H), (H, H, T), (H, T, H), (H, T, T), (T, H, H), (T, H, T), (T, T, H), (T, T, T)}

Probability

Probability quantifies the likelihood of an event occurring, expressed as a number between 0 and 1.

• Probability of Event A: Denoted as P(A).

• Range: 0 ≤ P(A) ≤ 1.

• Interpretation: 0 means impossible, 1 means certain, 0.5 means a 50-50 chance.

Calculating Probabilities

• Empirical Approach: Estimate probability by repeating a process many times and recording the proportion of times the event occurs. $P(A) = \frac{\text{# times A occurs}}{\text{total # observations}}$

• Theoretical Approach: Use mathematical reasoning to determine probabilities based on the structure of the sample space.

Probability Rules

Probability rules help ensure that probability assignments are consistent and logical.

• Rule 1: For any event A, $0 \leq P(A) \leq 1$.

• Rule 2: The sum of the probabilities of all possible outcomes in the sample space S is 1. $\sum_{i=1}^n P(E_i) = 1$

• Rule 3 (Addition Rule for Disjoint Events): If events A and B are disjoint (mutually exclusive), then $P(A \text{ or } B) = P(A) + P(B)$.

• Rule 4 (Complement Rule): The probability that event A does not occur is $P(A^c) = 1 - P(A)$, where $A^c$ is the complement of A.

• Rule 5 (General Addition Rule): For any two events A and B, $P(A \text{ or } B) = P(A) + P(B) - P(A \text{ and } B)$

Examples of Probability Calculations

• Rolling a die: Probability of rolling a 5 in 5000 rolls, with 830 fives observed: $P(\text{roll a 5}) = \frac{830}{5000} = 0.1666... \approx \frac{1}{6}$

• Probability of an even number (A = {2, 4, 6}): $P(A) = \frac{3}{6} = 0.5$

• Probability of an odd number (B = {1, 3, 5}): $P(B) = \frac{3}{6} = 0.5$

• Probability of rolling a number less than 4 (D = {1, 2, 3}): $P(D) = \frac{3}{6} = 0.5$

• Probability of rolling a 1 (C = {1}): $P(C) = \frac{1}{6}$

• Probability of rolling a number greater than 0 (f = {1, 2, 3, 4, 5, 6}): $P(f) = 1$

Table: Example Probability Distribution

The following table shows a probability distribution for the number of units ordered (X):

Units Ordered (X)	Probability
0	0.05
1	0.15
2	0.27
3	0.33
4	0.13
5	0.07

To be a valid probability distribution, the probabilities must sum to 1.

Random Variables

A random variable is a numerical variable whose value depends on the outcome of a random process.

• Discrete Random Variable: Takes on a finite or countable number of values (e.g., number of heads in three coin tosses).

• Continuous Random Variable: Takes on any value in an interval (e.g., waiting time at a bus stop).

Examples

• Let X = number of heads in three coin tosses. Possible values: 0, 1, 2, 3.

• Let X = waiting time (in minutes) for a bus to arrive. Possible values: any non-negative real number.

Applications and Context

• Probability is used to model and analyze random phenomena in fields such as economics, engineering, and the natural sciences.

• Understanding probability rules and random variables is essential for interpreting data and making informed decisions under uncertainty.

Additional info: Some examples and explanations were expanded for clarity and completeness, including the distinction between discrete and continuous random variables, and the use of tree diagrams for visualizing sample spaces.