Probability: Basic Concepts and Approaches

Probability

Basic Concepts

Probability is a fundamental concept in statistics that quantifies the likelihood of events occurring in a random experiment. Understanding probability is essential for analyzing data and making inferences about populations.

• Event: Any collection of results or outcomes from a procedure.

• Simple Event: An outcome or event that cannot be further broken down into simpler components.

• Sample Space: The set of all possible simple events (outcomes) for a procedure.

Notation

• P: Denotes probability.

• A, B, C: Symbols used to represent specific events.

• P(A): Probability that event A occurs.

Properties of Probabilities

• The probability of any event is a number between 0 and 1, inclusive. If expressed as a percentage, it ranges from 0% to 100%.

• An event with probability 1 (or 100%) is certain to occur.

• An event with probability 0 is impossible.

Approaches to Finding Probabilities

1. Relative Frequency Approximation of Probability: Probability is estimated by conducting (or observing) a procedure and counting the number of times event A occurs. The probability is approximated as: $P(A) \approx \frac{\text{Number of times A occurs}}{\text{Number of times the procedure is repeated}}$

2. Classical Approach to Probability (Equally Likely Outcomes): If a procedure has n different simple events that are equally likely, and event A can occur in s different ways, then: $P(A) = \frac{s}{n}$

3. Subjective Probability: Probability is estimated using knowledge of the relevant circumstances, rather than formal calculations or experiments.

Law of Large Numbers

As a procedure is repeated many times, the relative frequency probability of an event tends to approach the actual (theoretical) probability.

Complementary Events

• The complement of event A, denoted by A̅ or A', consists of all outcomes in which event A does not occur.

• If $P(A) = n$, then $P(A') = 1 - n$.

Significant Events

• Significantly High Number of Successes: x successes among n trials is considered significantly high if the probability of x or more successes is 0.05 or less.

• Significantly Low Number of Successes: x successes among n trials is considered significantly low if the probability of x or fewer successes is 0.05 or less.

Odds

• Actual Odds Against Event A: The ratio $\frac{P(A')}{P(A)}$, usually expressed as a:b ("a to b"), where a and b are integers.

• Actual Odds in Favor of Event A: The ratio $\frac{P(A)}{P(A')}$, which is the reciprocal of the odds against. If the odds against are a:b, the odds in favor are b:a.

• Payoff Odds Against Event A: The ratio of net profit (if you win) to the amount bet.

Summary Table: Approaches to Probability

Approach	Description	Formula
Relative Frequency	Estimate probability by conducting or observing experiments	$P(A) \approx \frac{\text{Number of times A occurs}}{\text{Total number of trials}}$
Classical	Assumes equally likely outcomes	$P(A) = \frac{s}{n}$
Subjective	Based on knowledge or intuition	None (estimated)

Example: Classical Probability

Suppose you roll a fair six-sided die. What is the probability of rolling a 4?

• There are 6 equally likely outcomes (1, 2, 3, 4, 5, 6).

• Event A: Rolling a 4 (only 1 way).

• Using the classical approach: $P(A) = \frac{1}{6}$

Example: Complementary Events

If the probability of rain tomorrow is 0.3, what is the probability that it will not rain?

• $P(\text{rain}) = 0.3$

• $P(\text{no rain}) = 1 - 0.3 = 0.7$