Probability: Fundamental Concepts and Approaches in Statistics

Probability: Basic Concepts

Introduction to Probability

Probability is a foundational concept in statistics, used to quantify the likelihood of events or outcomes. Understanding probability is essential for interpreting statistical results and making informed decisions under uncertainty.

• Event: Any collection of results or outcomes of a procedure.

• Simple Event: An outcome or event that cannot be broken down into simpler components.

• Sample Space: The set of all possible simple events for a procedure.

Example: Simple Events and Sample Spaces

Simple events and sample spaces help organize and enumerate all possible outcomes of a random experiment.

• Example: For a birth, the result of 1 girl is a simple event. For three births, the sample space consists of eight possible outcomes: ggg, ggb, gbg, bgg, bgb, bgg, bbb, bgb.

Procedure	Example of Event	Sample Space
One birth	Girl (g)	{g, b}
Three births	Two girls, one boy	{ggb, gbg, bgg}

Notation and Probability Values

Probability Notation

Probabilities are denoted by P followed by the event in parentheses. For example, P(A) denotes the probability of event A occurring.

• P(A): Probability of event A

• P(B): Probability of event B

Probability Values

Probabilities are expressed as values between 0 and 1, where 0 indicates impossibility and 1 indicates certainty.

• 0 ≤ P(A) ≤ 1

Three Common Approaches to Finding Probability

1. Relative Frequency Approach

This approach estimates probability based on the ratio of the number of times an event occurs to the total number of trials.

• Formula: $P(A) = rac{ ext{number of times A occurred}}{ ext{number of times the procedure was repeated}}$

• Example: Probability of an airline crash: $P( ext{airline crash}) = rac{16}{30,000,000} = 0.00000054$

2. Classical Approach (Equally Likely Outcomes)

Used when all outcomes are equally likely. Probability is the ratio of the number of ways an event can occur to the total number of possible outcomes.

• Formula: $P(A) = rac{ ext{number of ways A can occur}}{ ext{number of equally likely outcomes}}$

• Caution: Only use when outcomes are truly equally likely.

3. Subjective Probability

Probability is estimated based on intuition, experience, or judgment about the likelihood of an event.

• Example: Estimating the probability of rain tomorrow based on weather patterns.

Simulations

Simulations use models or computer programs to mimic real-world processes and estimate probabilities when analytical approaches are impractical.

Rounding Probabilities

Best Practices

Probabilities should be expressed as exact fractions or rounded to three significant digits for clarity. If a probability is not a simple fraction, express it as a decimal.

• Example: $P = rac{2}{3} ightarrow 0.667$

Law of Large Numbers

Definition and Application

The Law of Large Numbers states that as a procedure is repeated many times, the relative frequency probability of an event tends to approach the actual probability.

• Applies to behavior over a large number of trials, not individual outcomes.

• Does not guarantee the likelihood of different possible outcomes in a small number of trials.

Complementary Events

Definition

The complement of event A, denoted by A', consists of all outcomes in which event A does not occur.

• Formula: $P(A') = 1 - P(A)$

• Example: If 0.89 probability of using the Internet, then 0.11 probability of not using the Internet.

Identifying Significant Results with Probabilities

Significantly High or Low Probabilities

Statistical significance is determined by whether the probability of an observed result is unusually high or low.

• Significantly High: Probability of x successes is ≤ 0.05.

• Significantly Low: Probability of x successes is ≥ 0.95.

Odds and Payoff Odds

Actual Odds Against

The actual odds against event A occurring are the ratio $P(A') : P(A)$, usually expressed in the form a:b.

• Formula: $P(A') : P(A)$

Actual Odds in Favor

The actual odds in favor of event A are the reciprocal of the actual odds against.

• Formula: $P(A) : P(A')$

Payoff Odds

Payoff odds are the ratio of net profit to the amount bet.

• Formula: Payoff odds against event A = (net profit):(amount bet)

Example: Actual Odds Versus Payoff Odds

Suppose you bet $5 on the number 13 in roulette, with actual odds against 37:1 and payoff odds 35:1.

• Actual odds against: $37:1$

• Payoff odds: $35:1$

• Net profit for $5 bet: $5 imes 35 = $175

• If casino operated without profit: Net profit would be $185 ($5 imes 37$).

Probability Review

Summary of Key Points

• The probability of an event is a fraction or decimal number between 0 and 1.

• The probability of an impossible event is 0.

• The probability of a certain event is 1.

• Notation: $P(A)$ is the probability of event A.

• Notation: $P(A')$ is the probability that event A does not occur.

Tables

Sample Space Table

Procedure	Example of Event	Sample Space
One birth	Girl (g)	{g, b}
Three births	Two girls, one boy	{ggb, gbg, bgg}

Probability Calculation Table (Ghosts Example)

Response	Number of Responses	Total Number of Responses
"yes"	363	2003
"no"	1640	2003

Additional info: Some explanations and examples have been expanded for clarity and completeness.