Probability and Independence: Study Notes for Statistics

Probability

Basic Probability Concepts

Probability is a measure of how likely an event is to occur, expressed as a number between 0 and 1. The probability of an event A is denoted as P(A).

• Sample Space (S): The set of all possible outcomes of an experiment.

• Event: A subset of the sample space.

• Probability Formula:

$P(A) = \frac{\text{Number of favorable outcomes}}{\text{Total number of outcomes}}$

• Complement Rule: $P(A^c) = 1 - P(A)$, where $A^c$ is the complement of event A.

• Addition Rule (for mutually exclusive events): $P(A \text{ or } B) = P(A) + P(B)$

• Multiplication Rule (for independent events): $P(A \text{ and } B) = P(A) \times P(B)$

Examples and Applications

• Wheel of Fortune Example: Calculating the probability of landing on a specific discount (e.g., 40%, 10%, 20%) by counting the number of corresponding sections and dividing by the total number of sections.

• Multiple Customers: For independent spins, the probability that several customers get the same or different discounts is found by multiplying individual probabilities.

• At Least One Event: The probability that at least one event occurs is $1 - P(\text{none occur})$.

Example: If the probability of a customer getting a 40% discount is 0.1, the probability that at least one out of three customers gets a 40% discount is $1 - (1-0.1)^3 = 1 - 0.9^3 = 0.271$.

Independence and Dependence of Events

Definitions

• Independent Events: Two events A and B are independent if the occurrence of one does not affect the probability of the other. Mathematically, $P(A \cap B) = P(A) \times P(B)$.

• Dependent Events: Two events are dependent if the occurrence of one affects the probability of the other.

Example: Drawing cards from a deck without replacement is a dependent event, while tossing a coin multiple times is independent.

Testing for Independence

• Compare $P(A \cap B)$ to $P(A) \times P(B)$. If equal, events are independent.

• Contingency tables can be used to check independence between categorical variables.

Tree Diagrams and Conditional Probability

Tree Diagrams

Tree diagrams are visual tools used to map out all possible outcomes of a sequence of events, especially useful for conditional probability problems.

• Each branch represents a possible outcome and its probability.

• Multiply along branches to find joint probabilities.

Conditional Probability

• Definition: The probability of event A given that event B has occurred is $P(A|B) = \frac{P(A \cap B)}{P(B)}$.

• Application: Used in medical testing (e.g., probability of having a disease given a positive test result).

Tabular Data and Independence

Contingency Tables

Contingency tables display the frequency distribution of variables and are used to analyze the relationship between categorical variables.

	High BP	Normal BP	Total
Male	12	8	20
Female	7	13	20
Total	19	21	40

Purpose: To determine if two variables (e.g., gender and high blood pressure) are independent.

• Calculate expected counts under independence and compare to observed counts.

Applications and Problem Solving

• Use probability rules to solve real-world problems (e.g., disease testing, political surveys, product discounts).

• Interpret results in context and justify reasoning (e.g., why events are independent or dependent).

Additional info:

• Probability is foundational for later topics such as binomial and normal distributions, hypothesis testing, and regression analysis.

• Understanding independence is crucial for correct application of probability rules.