Skip to main content
Back

Fundamental Concepts in Probability for Statistics

Study Guide - Smart Notes

Tailored notes based on your materials, expanded with key definitions, examples, and context.

Probability

Types of Probability

Probability is a measure of how likely an event is to occur. There are several ways to interpret and assign probabilities:

  • Theoretical Probability: Probability based on mathematical models or equally likely outcomes. For example, the probability of rolling a 3 on a fair six-sided die is .

  • Subjective Probability: Probability based on personal judgment or belief, rather than objective data. This is often used when empirical or theoretical data is unavailable.

  • Probability Assignment Rule: The sum of probabilities for all possible outcomes in a sample space must equal 1.

Basic Probability Rules

  • Complement Rule: The probability that an event does not occur is 1 minus the probability that it does occur.

  • Disjoint (Mutually Exclusive) Events: Two events are disjoint if they cannot occur at the same time (i.e., they have no outcomes in common). For disjoint events A and B:

  • Addition Rule: For any two events A and B:

Legitimate Probability Assignment

Any assignment of probabilities to outcomes is legitimate if:

  • Each probability is between 0 and 1 (inclusive).

  • The sum of all probabilities is 1.

Multiplication Rule & Independence

  • Multiplication Rule: For two independent events A and B, the probability that both occur is:

  • Independence: Two events are independent if the occurrence of one does not affect the probability of the other.

Example Applications

  • Example 1: If the probability of rain tomorrow is 0.3, then the probability it does not rain is .

  • Example 2: If you flip two coins, the probability both land heads (assuming independence) is .

Additional info: These rules form the foundation for more advanced topics in probability and statistics, such as binomial and normal distributions, hypothesis testing, and regression analysis.

Pearson Logo

Study Prep