Fundamental Probability Concepts and Applications

Probability Basics

Sample Spaces and Events

Probability is the measure of the likelihood that an event will occur. The sample space is the set of all possible outcomes of an experiment, and an event is any subset of the sample space.

• Example: Drawing a card from a standard deck. The sample space consists of 52 cards (13 ranks in each of 4 suits: Hearts, Diamonds, Spades, Clubs).

• Notation: P(A) denotes the probability of event A.

Calculating Probabilities

For equally likely outcomes, the probability of an event is:

$P(A) = \frac{\text{Number of favorable outcomes}}{\text{Total number of outcomes}}$

• Example: Probability of drawing a 5 from a deck: $P(5) = \frac{4}{52} = 0.0769$

• Example: Probability of drawing a black card (Spades or Clubs): $P(\text{Black Card}) = \frac{26}{52} = 0.5$

• Example: Probability of drawing a Queen or a Red card: $P(\text{Queen or Red card}) = \frac{2}{52} + \frac{26}{52} = 0.5385$ Additional info: The calculation assumes the two events are mutually exclusive except for the two red Queens, which should be counted only once.

Probability with Coin Flips

When flipping coins, each outcome is equally likely. For multiple flips, the sample space grows exponentially.

• Example: Flipping 3 coins. The sample space has $2^3 = 8$ outcomes.

• Probability of exactly 2 heads: $P(2 \text{ heads}) = \frac{3}{8}$

• Probability of at least 2 heads: $P(\text{at least 2 heads}) = \frac{4}{8} = 0.5$

Relative Frequency and Empirical Probability

Definition and Application

Relative frequency is the ratio of the number of times an event occurs to the total number of trials or observations. It is used to estimate probability empirically.

• Example: At a certain intersection, 929 accidents occur in a year, 211 were fatalities. The probability of dying in an accident is:

$P(\text{Death}) = \frac{211}{929} = 0.227$

• Interpretation: This expresses the fatality rate as a percentage (22.7%).

The Law of Large Numbers

Statement and Implications

The law of large numbers states that as the number of trials increases, the relative frequency probability approaches the actual (theoretical) probability.

• Application: If you flip a fair coin many times, the proportion of heads will get closer to 0.5 as the number of flips increases.

Probability in Everyday Life

Birthday Problem

The birthday problem explores the probability that, in a group of people, at least two share the same birthday.

• Key Point: In a group of 23 people, there is about a 50% chance that at least two people share a birthday.

• Application: This counterintuitive result is important in probability theory and has applications in cryptography and data science.