Probability: Basic Concepts, Rules, and Counting Principles

Introduction to Probability

Probability is a measure of how likely an event is to occur. It is expressed as a number between 0 and 1, where 0 means the event cannot happen and 1 means the event is certain to happen. The set of all possible outcomes is called the sample space.

• Probability of an Event: The probability of an event is calculated as the ratio of the number of ways the event can occur to the total number of possible outcomes.

Formula:

Example: When flipping a coin, the probability of getting heads is because there are two possible outcomes (heads or tails) and only one is heads.

Theoretical vs. Empirical Probability

There are two main approaches to probability:

• Theoretical Probability: Based on reasoning or known possible outcomes, before any experiment is performed.

• Empirical (Experimental) Probability: Based on observations or experiments, after events have occurred.

Theoretical Probability Formula:

Empirical Probability Formula:

Example: If a die is rolled 10 times and a 4 appears 3 times, the empirical probability of rolling a 4 is .

Complements and Complementary Events

The complement of an event A (written as A') consists of all outcomes in the sample space that are not in A. The probability of the complement is:

• Key Fact: The sum of the probabilities of an event and its complement is always 1.

Example: If the probability of rain tomorrow is 0.2, the probability that it will not rain is 1 - 0.2 = 0.8.

Addition Rule for Probability

The addition rule helps find the probability that at least one of two events occurs.

Mutually Exclusive Events

• Mutually Exclusive Events: Events that cannot happen at the same time (no overlap).

• Addition Rule:

Example: When rolling a die, the probability of getting a 2 or a 5 is .

Non-Mutually Exclusive Events

• Non-Mutually Exclusive Events: Events that can occur at the same time (overlap exists).

• Addition Rule:

Example: When drawing a card, the probability of getting a heart or a face card is .

Multiplication Rule: Independent and Dependent Events

Independent Events

• Independent Events: The occurrence of one event does not affect the probability of the other.

• Multiplication Rule:

Example: The probability of flipping two heads in a row is .

Dependent Events

• Dependent Events: The occurrence of one event affects the probability of the other.

• Multiplication Rule:

Example: Drawing two cards from a deck without replacement: , , so .

Conditional Probability

Conditional probability is the probability of event B occurring given that event A has already occurred. It is denoted as .

Formula:

Example: If 30 students play soccer and 10 of them also play basketball, the probability that a student plays basketball given they play soccer is .

Bayes' Theorem

Bayes' Theorem allows us to find the probability of an event based on prior knowledge of conditions related to the event. It is especially useful when the direct probability is unknown but related probabilities are known.

Formula:

Example: If a disease affects 1% of a population and a test is 95% accurate, Bayes' Theorem can be used to find the probability that a person has the disease given a positive test result.

Contingency Tables

A contingency table displays the frequency distribution of variables and is used to calculate marginal, joint, and conditional probabilities.

• Marginal Probability: Probability of a single event occurring.

• Joint Probability: Probability of two events occurring together.

• Conditional Probability: Probability of one event given another has occurred.

Formulas:

Fundamental Counting Principle

The Fundamental Counting Principle states that if one event can occur in m ways and a second event can occur in n ways, then the two events can occur in ways.

Example: If you have 3 shirts and 4 pants, you have possible outfits.

Permutations

A permutation is an arrangement of objects in a specific order. The number of permutations of n objects taken r at a time is:

Example: The number of ways to arrange 3 books out of 5 on a shelf is .

Permutations of Non-Distinct Objects

When some objects are identical, the number of distinct permutations is reduced. The formula is:

Example: The number of ways to arrange the letters in "BANANA" is .

Combinations

A combination is a selection of objects where order does not matter. The number of combinations of n objects taken r at a time is:

Example: The number of ways to choose 2 ice cream flavors out of 5 is .

Permutations vs. Combinations

• Permutation: Order matters (e.g., arranging books on a shelf).

• Combination: Order does not matter (e.g., selecting team members).

Example: Choosing 3 officers from 10 people is a permutation; choosing 3 students for a committee is a combination.

Applications: Probability with Counting

Probability problems often require counting the number of favorable outcomes and the total number of possible outcomes using permutations and combinations.

Example: The probability of winning a lottery where you must choose 5 numbers out of 40 is .