Probability

Basic Concepts of Probability

Probability is a fundamental concept in statistics that quantifies the likelihood of events occurring. An event is a collection of possible outcomes, and the sample space (denoted by S) is the set of all possible outcomes of an experiment.

• Probability of an Event: The proportion of times an event occurs if the experiment is repeated infinitely many times.

• Notation: P(A) denotes the probability of event A occurring.

There are three main approaches to calculating probability:

1. Empirical Probability (Relative Frequency Approximation): Estimated by repeating the experiment many times and calculating the ratio of the number of times the event occurs to the total number of trials. Formula: Example: If a coin is flipped 100 times and heads appear 52 times, .

2. Classical Probability (Theoretical Probability): Used when all outcomes are equally likely. If event A can occur in s ways out of n possible outcomes: Formula: Example: For a fair coin, .

3. Subjective Probability: Based on personal judgment or knowledge of relevant circumstances. Example: Estimating the probability of rain tomorrow based on weather reports.

• Law of Large Numbers: As an experiment is repeated, the empirical probability approaches the actual probability.

Complement of an Event

The complement of event A, denoted by A', consists of all outcomes in which event A does not occur. The probabilities of an event and its complement always add up to 1.

• Formula:

• Example: If the probability of finding a defective item is 0.043, then the probability of finding a non-defective item is .

Counting Principles

Counting principles are used to determine the number of possible outcomes in a sample space, which is essential for calculating classical probabilities.

• Example: The sample space for flipping a coin is S = {H, T}.

Discrete Probability Distributions

Random Variables

A random variable is a variable whose value is determined by the outcome of a random experiment. Random variables can be classified as discrete or continuous.

• Discrete Random Variable: Takes countable values (e.g., number of children in a family).

• Continuous Random Variable: Takes uncountable values, often measured (e.g., time, weight).

Comparison Table: Discrete vs. Continuous Random Variables

Probability Distribution

A probability distribution for a discrete random variable lists all possible values (x) and their associated probabilities (P(x)). The sum of all probabilities must equal 1, and each probability must be between 0 and 1.

• Requirements:

  • Each probability

Example: Probability Distribution Table

• Exactly 6:

• More than 8:

• 5 to 8:

• At most 6:

Mean and Standard Deviation of a Discrete Probability Distribution

The mean (expected value) of a discrete probability distribution is the weighted average of all possible values, using their probabilities as weights. The standard deviation measures the spread of the distribution.

• Mean Formula:

• Standard Deviation Formula:

• Example: For the Elmo's Sporting Goods distribution:

  • (average sales per day)

  • (variation in daily sales)

Calculation Table for Mean and Standard Deviation

Expected Value

The expected value (E(X)) is the long-run average value of a random variable after many repetitions of the experiment. It is calculated by multiplying each possible value by its probability and summing the results.

• Formula:

• Example:

  X	P(X)	X*P(X)
  2	0.45	0.90
  4	0.35	1.40
  6	0.15	0.90
  8	0.05	0.40
  Total		3.60

  Thus, .

• Fair Game: If , the game is considered fair.

Key Concepts for Exam Preparation

• Discrete Random Variable

• Continuous Random Variable

• Probability Distribution

  • Requirements

  • Finding the mean/expected value

• Basic Probability

• Terminology and Notation

  • Calculate probabilities of events

  • Complement of an event

Important Principles and Notation:

• The probability of an event is a fraction or decimal number between 0 and 1 inclusive.

• The probability of an impossible event is 0.

• The probability of an event that is certain to occur is 1.

• Notation: The probability of event A is denoted by P(A).

• Notation: The probability that event A does not occur is denoted by P(A').

Additional info: These notes expand on brief points by providing definitions, formulas, and examples for probability and discrete probability distributions, as well as clarifying the requirements for probability distributions and the calculation of expected value and standard deviation.