Probability and Probability Distributions: Core Concepts for Statistics

Probability and Probability Distributions

Basic Definitions of Probability

Probability theory is fundamental in statistics and decision-making, especially in business and finance. It quantifies uncertainty and helps managers make informed decisions under risk. Probability is used to analyze sales trends, customer behavior, inventory levels, and more.

• Probability: A numerical measure (between 0 and 1) of the likelihood that an event will occur.

• Experiment: Any process of observation or measurement that generates well-defined outcomes (e.g., tossing a coin, rolling a die).

• Sample Space (S): The set of all possible outcomes of an experiment.

• Event: A subset of the sample space; a statement about one or more outcomes.

• Outcome: The result of a single trial of an experiment.

Example: Rolling a die: S = {1,2,3,4,5,6}. Event A (odd numbers) = {1,3,5}.

Key Probability Concepts

• Equally Likely Events: Events with the same chance of occurring.

• Mutually Exclusive Events: Events that cannot occur simultaneously.

• Complement of an Event (A'): All outcomes in the sample space not in event A.

• Elementary Event: An event with only one outcome.

• Compound Event: An event with more than one outcome.

• Intersection (A ∩ B): Outcomes common to both events A and B.

• Union (A ∪ B): Outcomes in A, B, or both.

• Independent Events: The occurrence of one does not affect the probability of the other.

• Dependent Events: The occurrence of one affects the probability of the other.

Approaches to Measuring Probability

• Classical Approach: Used when all outcomes are equally likely. $P(A) = \frac{n(A)}{N}$, where n(A) is the number of favorable outcomes and N is the total number of outcomes.

• Relative Frequency Approach: Probability is the long-run proportion of times an event occurs in repeated trials. $P(A) = \lim_{N \to \infty} \frac{n(A)}{N}$

• Axiomatic Approach: Probability is defined by axioms:

  • $0 \leq P(A) \leq 1$

  • $P(S) = 1$

  • $P(A') = 1 - P(A)$

  • If A and B are mutually exclusive: $P(A \cup B) = P(A) + P(B)$

  • General addition rule: $P(A \cup B) = P(A) + P(B) - P(A \cap B)$

• Subjective Approach: Probability is based on personal judgment or prior knowledge.

Conditional Probability and Independence

Conditional probability measures the likelihood of event A given that event B has occurred:

• $P(A|B) = \frac{P(A \cap B)}{P(B)}$, provided $P(B) \neq 0$

• For independent events: $P(A \cap B) = P(A)P(B)$

Example: If $P(A) = 0.4$, $P(B) = 0.2$, $P(A \cap B) = 0.08$, then A and B are independent because $0.4 \times 0.2 = 0.08$.

Random Variables and Probability Distributions

Random Variables

A random variable assigns a real number to each outcome in the sample space. There are two types:

• Discrete Random Variable: Takes countable values (e.g., number of customers).

• Continuous Random Variable: Takes any value within an interval (e.g., time, height).

Probability Distributions

• Discrete Probability Distribution: Lists all possible values of a discrete random variable and their probabilities.

  • $\sum P(X = x_i) = 1$

  • $0 \leq P(X = x_i) \leq 1$

• Continuous Probability Distribution: Described by a probability density function (pdf) $f(x)$, where:

  • $f(x) \geq 0$ for all x

  • $\int_{-\infty}^{\infty} f(x)dx = 1$

  • $P(a \leq X \leq b) = \int_a^b f(x)dx$

Expectation and Variance

• Expected Value (Mean):

  • Discrete: $E(X) = \sum x_i P(X = x_i)$

  • Continuous: $E(X) = \int_{a}^{b} x f(x)dx$

• Variance:

  • Discrete: $Var(X) = E(X^2) - [E(X)]^2$

  • Continuous: $Var(X) = \int_{a}^{b} x^2 f(x)dx - [E(X)]^2$

Common Discrete Probability Distributions

Binomial Distribution

The binomial distribution models the number of successes in n independent trials, each with probability p of success.

• Probability mass function: $P(X = x) = \binom{n}{x} p^x (1-p)^{n-x}$, for $x = 0, 1, ..., n$

• Mean: $E(X) = np$

• Variance: $Var(X) = np(1-p)$

Example: Probability of 3 successes in 10 trials with $p = 0.2$:

• $P(X = 3) = \binom{10}{3} (0.2)^3 (0.8)^7$

Poisson Distribution

The Poisson distribution models the number of events in a fixed interval of time or space, given the average rate λ.

• Probability mass function: $P(X = x) = \frac{\lambda^x e^{-\lambda}}{x!}$, for $x = 0, 1, 2, ...$

• Mean and Variance: $E(X) = Var(X) = \lambda$

Example: Probability of 1 customer arriving in a minute when λ = 4:

• $P(X = 1) = \frac{4^1 e^{-4}}{1!}$

Common Continuous Probability Distributions

Normal Distribution

The normal distribution is a continuous, symmetric, bell-shaped distribution defined by its mean (μ) and standard deviation (σ):

• Probability density function: $f(x) = \frac{1}{\sigma \sqrt{2\pi}} e^{-\frac{1}{2} \left(\frac{x-\mu}{\sigma}\right)^2}$

• Total area under the curve is 1.

• Mean = Median = Mode = μ

• Standardization: $Z = \frac{X - \mu}{\sigma}$, where Z follows the standard normal distribution $N(0,1)$

Probabilities are found using the area under the curve between two points, often with the help of Z-tables.

Example: Probability that Z is between z1 and z2 is the shaded area under the curve between those points.

Properties of the Standard Normal Distribution

• Mean = 0, Standard deviation = 1

• Symmetrical about the mean

• Area to the left of Z = 0 is 0.5

• Probabilities for any interval can be found using standard normal tables

Applications of the Normal Distribution

• Finding probabilities for intervals (e.g., $P(a < X < b)$)

• Calculating probabilities for real-world scenarios (e.g., investment returns, heights, test scores)

• Standardizing values to compare different normal distributions

Example: If returns are normally distributed with mean 10% and standard deviation 5%, the probability of a negative return is $P(X < 0) = P(Z < -2) = 0.0228$.