Probability and Random Variables: Foundations for Psychology

Chapter 12 & 13: Probability and Random Variables

Random Samples

Random sampling is a fundamental concept in statistics and psychology, as it allows researchers to generalize findings from a sample to a population. When two random samples are drawn from the same population, their statistics will likely differ due to chance variability.

• Randomness introduces variability in results, which is why probability is studied.

• Probability is the branch of mathematics that describes random behavior.

Random Processes

Random processes are procedures or experiments where the outcome is uncertain, but a regular pattern emerges over many repetitions.

• Chance behavior: Individual outcomes are unpredictable, but a regular distribution appears in the long run.

• Short-term unpredictability, long-term predictability.

• Experiments and observational studies are both types of random processes, often called experiments.

Basic Terminology

• Outcome: The most basic possible result from a random process (e.g., rolling a 1 on a die).

• Event: A collection of outcomes that share a property of interest (e.g., rolling an odd number).

• Sample Space (S): The set of all possible outcomes of a random process.

Examples of Outcomes and Events

• Rolling a die: S = {1, 2, 3, 4, 5, 6}

• Tossing a coin: S = {H, T}

• Drawing a card: S = {all 52 cards in a deck}

• Event: Rolling an odd number on a die: {1, 3, 5}

The Sample Space S

The sample space S includes all possible outcomes of a random process. Events are subsets of S.

• Example: For three coin tosses, S = {(H,H,H), (H,H,T), (H,T,H), (H,T,T), (T,H,H), (T,H,T), (T,T,H), (T,T,T)}

• For a business status after two years: S = {open, close}

• For a quality inspection with four ratings (A=acceptable, U=unacceptable): S = {all possible sequences of A and U for four items}

Probability

Probability quantifies the likelihood of an event occurring, expressed as a number between 0 and 1.

• Expressed as P(event), e.g., P(H) for the probability of heads.

• Always: 0 ≤ P(event) ≤ 1

• Probability of all possible outcomes in S must sum to 1.

Probability Scale

• 0: Impossible

• 0.5: 50-50 chance

• 1: Certain

Calculating Probabilities

• Empirical Approach: Repeat a process many times and estimate probability as the proportion of times the event occurs.

• Theoretical Approach: Use mathematical reasoning to determine probabilities based on the structure of the sample space.

Empirical Probability Formula

• $P(A) = \frac{\text{number of times A occurs}}{\text{total number of observations}}$

• Example: If a die is rolled 5000 times and 830 rolls are a 5, then $P(\text{roll a 5}) = \frac{830}{5000} = 0.1666... \approx \frac{1}{6}$

Probability Rules

• Rule 1: For any event A, $0 \leq P(A) \leq 1$

• Rule 2: The sum of probabilities of all possible outcomes in S is 1: $P(S) = 1$

• Rule 3: For disjoint (mutually exclusive) events A and B: $P(A \text{ or } B) = P(A) + P(B)$

• Rule 4: The probability that event A does not occur is $1 - P(A)$

• Rule 5: For any two events A and B: $P(A \text{ or } B) = P(A) + P(B) - P(A \text{ and } B)$

Disjoint (Mutually Exclusive) Events: Events that cannot occur together (no outcomes in common).

Complement of an Event: The event that A does not occur, denoted as A'.

Example Table: Probability of Economic Conditions

Outcome	Probability
Excellent (E)	0.03
Good (G)	0.12
Fair (F)	?
Poor (P)	0.10

To find the missing probability for 'Fair', use Rule 2: $P(E) + P(G) + P(F) + P(P) = 1$

Random Variables

A random variable is a variable whose value is a numerical outcome of a random process.

• Example: X = number of heads in three coin tosses.

• Example: X = waiting time at a bus stop.

Probability Distribution of a Discrete Random Variable

The probability distribution lists each possible value of the random variable and its probability.

Units Ordered (X)	Probability
0	0.05
1	0.15
2	0.27
3	0.33
4	0.13
5	0.07

To check if this is a valid probability distribution, sum all probabilities: $0.05 + 0.15 + 0.27 + 0.33 + 0.13 + 0.07 = 1$

Calculating Probabilities for Random Variables

• $P(X = 2) = 0.27$

• $P(X < 2) = P(X = 0) + P(X = 1) = 0.05 + 0.15 = 0.20$

• $P(X \geq 3) = P(X = 3) + P(X = 4) + P(X = 5) = 0.33 + 0.13 + 0.07 = 0.53$

Applications in Psychology

• Probability and random variables are essential for understanding research design, hypothesis testing, and data analysis in psychology.

• Random sampling and random assignment help ensure unbiased results in psychological experiments.

• Probability distributions are used to model behaviors, reaction times, and other psychological phenomena.

Additional info: These notes provide foundational concepts for probability and random variables, which are crucial for statistical reasoning in psychology. Understanding these principles supports the interpretation of experimental results and the design of robust psychological studies.