Probability Distributions and Random Variables: Key Concepts and Applications

Probability Distributions and Random Variables

Definitions and Types of Random Variables

In statistics, understanding random variables and their associated probability distributions is fundamental for analyzing random phenomena and making inferences about populations.

• Random variable: A variable (typically represented by x) that has a single numerical value, determined by chance, for each outcome of a procedure.

• Probability distribution: A description that gives the probability for each value of the random variable; often expressed in the format of a graph, table, or formula.

• Discrete random variable: Either a finite number of values or a countable number of values, where “countable” refers to the fact that there might be infinitely many values, but they result from a counting process.

• Continuous random variable: Infinitely many values, and those values can be associated with measurements on a continuous scale without gaps or interruptions.

Probability Distributions: Representation and Examples

Probability distributions can be represented graphically, in tables, or by formulas. The vertical scale in a probability histogram shows probabilities, similar to a relative frequency histogram.

• Example: Probability Histogram A probability histogram for the number of Mexican-American jurors among 12 shows the probability for each possible outcome.

• Example: Probability Distribution for Rolling a Die

  Outcome X	Probability P(X)
  1	1/6
  2	1/6
  3	1/6
  4	1/6
  5	1/6
  6	1/6

• Example: Probability Distribution for Tossing Three Coins

  Number of Heads X	Probability P(X)
  0	1/8
  1	3/8
  2	3/8
  3	1/8

Properties of Probability Distributions

Probability distributions must satisfy the following properties:

• Total probability: $\sum P(x) = 1$ where x assumes all possible values.

• Individual probabilities: $0 \leq P(x) \leq 1$ for every individual value of x.

Mean, Variance, and Standard Deviation of a Probability Distribution

These measures summarize the central tendency and spread of a probability distribution.

• Mean (Expected Value): $\mu = \sum [x \cdot P(x)]$

• Variance: $\sigma^2 = \sum [(x - \mu)^2 \cdot P(x)]$

• Variance (shortcut): $\sigma^2 = \sum [x^2 \cdot P(x)] - \mu^2$

• Standard Deviation: $\sigma = \sqrt{\sum [x^2 \cdot P(x)] - \mu^2}$

Rounding Rule: Carry one more decimal place than the number of decimal places used for the random variable x. If the values of x are integers, round $\mu$, $\sigma$, and $\sigma^2$ to one decimal place.

Identifying Unusual Results: Range Rule of Thumb

The range rule of thumb helps identify values that are considered unusual in a probability distribution.

• Most values should lie within 2 standard deviations of the mean.

• Maximum usual value: $\mu + 2\sigma$

• Minimum usual value: $\mu - 2\sigma$

Rare Event Rule for Inferential Statistics

If, under a given assumption (such as the assumption that a coin is fair), the probability of a particular observed event is extremely small, we conclude that the assumption is probably not correct.

• Example: If the probability of getting 992 heads in 1000 tosses of a coin is extremely small, the assumption that the coin is fair may be rejected.

Identifying Unusual Results Using Probabilities

Probabilities can be used to determine when results are unusual:

• Unusually high: x successes among n trials is an unusually high number of successes if $P(x \text{ or more}) \leq 0.05$.

• Unusually low: x successes among n trials is an unusually low number of successes if $P(x \text{ or fewer}) \leq 0.05$.

Additional info: These concepts are foundational for further study in inferential statistics, hypothesis testing, and probability modeling.