Probability and Probability Distributions: Core Concepts and Applications

Probability: Basic Concepts

Definitions and Interpretation

Probability is a measure of how likely an event is to occur, expressed as a number between 0 and 1. The closer the probability is to 1, the more certain the event is to happen; a probability of 0 means the event is impossible.

• Event: Any collection of outcomes from a probability experiment.

• Simple Event: An outcome that cannot be broken down into simpler components.

• Sample Space: The set of all possible outcomes of a procedure.

• P(A): Denotes the probability of event A occurring.

Probabilities are always expressed as fractions or decimals between 0 and 1.

• Impossible Event: Probability = 0

• Certain Event: Probability = 1

• Unlikely Event: Probability close to 0

• Likely Event: Probability close to 1

Example: Rolling a die: Sample space = {1, 2, 3, 4, 5, 6}. Event A: "Getting an even number" = {2, 4, 6}.

Rules for Computing Probabilities

• Relative Frequency Approximation: $P(A) = \frac{\text{Number of times A occurred}}{\text{Number of trials}}$

• Classical (Theoretical) Probability: $P(A) = \frac{s}{n}$, where s = number of ways A can occur, n = total equally likely outcomes.

• Subjective Probability: Estimated using knowledge of relevant circumstances.

Law of Large Numbers: As an experiment is repeated, the relative frequency probability approaches the actual probability.

Rules of Probability

Addition Rule

The addition rule is used to find the probability that event A or event B (or both) occur in a single trial.

• Formal Addition Rule: $P(A \text{ or } B) = P(A) + P(B) - P(A \text{ and } B)$

• Disjoint (Mutually Exclusive) Events: Events that cannot occur at the same time. For disjoint events, $P(A \text{ and } B) = 0$.

Example: If selecting a student, the probability that the student is wearing glasses or contacts is found using the addition rule.

Complementary Events

The complement of event A (denoted as \( \overline{A} \)) consists of all outcomes in which A does not occur.

• $P(A) + P(\overline{A}) = 1$

• $P(A) = 1 - P(\overline{A})$

• $P(\overline{A}) = 1 - P(A)$

Example: If 19.8% of college students take at least one class online, the probability that a student does not take any online class is $1 - 0.198 = 0.802$.

Multiplication Rule and Conditional Probability

Multiplication Rule

The multiplication rule is used to find the probability that event A occurs in the first trial and event B occurs in the second trial.

• Formal Multiplication Rule: $P(A \text{ and } B) = P(A) \cdot P(B|A)$

• Independent Events: If A and B are independent, $P(B|A) = P(B)$, so $P(A \text{ and } B) = P(A) \cdot P(B)$

• Dependent Events: The probability of B is affected by the occurrence of A.

Conditional Probability

Conditional probability is the probability of event B occurring given that event A has already occurred.

• $P(B|A) = \frac{P(A \text{ and } B)}{P(A)}$

Example: If 44 out of 1000 subjects use drugs and have a positive test, and 59 have a positive test, then $P(\text{Uses drugs} | \text{Positive test}) = \frac{44}{59}$.

Counting Principles in Probability

Fundamental Counting Rule

If one event can occur in m ways and a second event in n ways, the events together can occur in $m \times n$ ways.

Factorial Rule

The number of ways to arrange n different items is $n!$ (n factorial).

• $4! = 4 \times 3 \times 2 \times 1 = 24$

• $0! = 1$ (by definition)

Permutations and Combinations

• Permutations: Order matters. Number of ways to arrange r items from n: $P(n, r) = \frac{n!}{(n-r)!}$

• Combinations: Order does not matter. Number of ways to choose r items from n: $C(n, r) = \frac{n!}{r!(n-r)!}$

Example: Number of ways to choose 3 people from 7: $C(7, 3) = \frac{7!}{3!4!} = 35$

Probability Distributions

Random Variables and Probability Distributions

A probability distribution lists each possible value of a random variable together with its probability.

• Random Variable: A variable whose value is determined by chance.

• Discrete Random Variable: Takes countable values.

• Continuous Random Variable: Takes infinitely many values, associated with measurements.

Requirements for a probability distribution:

• Each probability is between 0 and 1 inclusive.

• The sum of all probabilities is 1.

Probability Distribution Histogram

A probability histogram visually represents the probability distribution of a discrete random variable.

Mean, Variance, and Standard Deviation of a Probability Distribution

• Mean (Expected Value): $\mu = \sum [x \cdot P(x)]$

• Variance: $\sigma^2 = \sum [(x - \mu)^2 \cdot P(x)]$

• Standard Deviation: $\sigma = \sqrt{\sum [(x - \mu)^2 \cdot P(x)]}$

Expected Value (E): The mean value of the outcomes, representing the long-term average if the experiment is repeated many times.

Binomial Probability Distributions

Definition and Properties

A binomial probability distribution arises from a procedure that meets these criteria:

• Fixed number of trials (n)

• Each trial is independent

• Each trial has two possible outcomes (success or failure)

• The probability of success (p) is the same for each trial

Notation:

• n = number of trials

• p = probability of success

• q = probability of failure = 1 - p

• x = number of successes in n trials

Binomial Probability Formula

The probability of getting exactly x successes in n trials is:

$P(x) = C(n, x) \cdot p^x \cdot q^{n-x}$

where $C(n, x) = \frac{n!}{x!(n-x)!}$

Parameters for Binomial Distributions

• Mean: $\mu = np$

• Variance: $\sigma^2 = npq$

• Standard Deviation: $\sigma = \sqrt{npq}$

Range Rule of Thumb: Values are unusual if they lie outside $\mu \pm 2\sigma$.

Applications and Examples

• Finding the probability of a certain number of successes in repeated independent trials (e.g., number of students who donated blood, number of correct answers on a test by guessing).

• Using the binomial probability table for quick lookup of probabilities.

Additional info: The notes above include expanded definitions, formulas, and examples to ensure completeness and clarity for exam preparation. All images included directly reinforce the adjacent explanations.