Basic Concepts of Probability

Key Concepts

Probability is the mathematical study of randomness and uncertainty. It helps us answer questions about the likelihood of events, such as winning a lottery or the probability of a certain outcome in an experiment.

• Statistical Random Experiment: Any random activity that results in a definite outcome.

• Event: Any collection of results or outcomes of a procedure.

• Simple Event: An outcome or event that cannot be further broken down into simpler components.

Sample Space and Simple Events

The sample space is the set of all possible outcomes of a probability experiment. Each outcome is called a simple event. For example, tossing a coin has two possible outcomes: heads or tails.

Note: In a probability experiment, there is only one unique outcome for each trial, even if multiple outcomes are possible in theory.

Counting Sample Spaces

To determine the probability of an event, it is important to count the number of possible outcomes in the sample space. The Fundamental Counting Principle states that if one event can occur in m ways and a second event can occur independently in n ways, then the two events can occur in m × n ways.

Probability

The main objective of probability is to assign a value between 0 and 1 to the likelihood of an event. Probability can be expressed as a fraction, decimal, or percent. The probability of event A is denoted as P(A).

• Probability Formula:

Types of Probability Assignments

1. Intuition/Personal/Subjective Probability

• Based on personal judgment, experience, or belief.

2. Relative Frequency (Empirical Probability)

• Based on observations or experiments.

• Formula:

3. Classical (Theoretical) Probability

• Assumes all outcomes are equally likely.

• Formula:

Empirical Probability vs. Classical Probability

Calculating Probability

When assigning the value of a probability, either give the exact fraction or decimal or round off to three decimal places. Probabilities must be between 0 and 1, inclusive.

• Range Rule:

• Sum Rule: The probabilities of all outcomes in a sample space must sum to 1.

• Complement Rule: The probability of the complement of event A is

The Law of Large Numbers vs. The Law of Averages

Law of Large Numbers

As the sample size increases, the relative frequency of an event approaches the theoretical probability of that event. For example, as you flip a fair coin more times, the proportion of heads will get closer to 50%.

Law of Averages

This is a common misconception. The law of averages incorrectly suggests that outcomes will "even out" in the short run. Probability does not "owe" you anything; each trial is independent.

Simulations

Simulations are used to model the outcomes of probability experiments when actual experiments are impractical. A simulation is a procedure that imitates a process or system, allowing us to estimate probabilities by running many trials.

Significant Results

Probability is used to determine when results are significantly high or low. For example, if the probability of an observed result is very low, it may be considered statistically significant.

Statistical significance helps us decide whether an observed effect is likely due to chance or represents a real phenomenon.

Examples and Applications

• Estimating the probability that a randomly selected student likes cafeteria food based on survey data.

• Calculating the probability of getting at least one head when tossing two coins.

• Using frequency tables to estimate probabilities from observed data.

To find the probability that a student chosen at random will be 18 to 25 years old, divide the frequency for that age group by the total number of students.