Early Ideas with Probability Distributions and Data: Study Notes for Introductory Statistics

Probability Distributions and Data

Introduction to Probability Distributions

Probability distributions describe how the values of a variable are distributed across possible outcomes. They are foundational in statistics for understanding both populations and samples. Different types of variables (continuous, discrete, categorical) have different types of probability distributions.

• Continuous Variables: Can take any value within a range (e.g., volume of coffee dispensed, waistline measurements).

• Discrete Variables: Take specific, separate values (often counts, e.g., number of bacteria colonies).

• Categorical Variables: Represent categories or groups (e.g., type of pet: cat, dog, other).

Examples of probability distributions include the actual volume dispensed by a vending machine, waistline measurements, counts of bacteria, and simulated random numbers.

Describing Data with Tables and Graphs

Frequency Distribution Tables

To understand a sample, we often summarize data using a frequency distribution table. This table groups data into intervals (called bins, intervals, or classes) and counts how many values fall into each bin.

• Bin (Interval/Class): A range of values that includes its left endpoint but not its right endpoint.

• Frequency: The number of sample points in each bin.

• Bins should not overlap, have no gaps, and together cover all sample values.

For example, measuring the actual ounces dispensed by a coffee vending machine 50 times yields a sorted list of values. These can be grouped into bins to create a frequency distribution table.

Bin (Ounces)	Frequency
11.40 – 11.50	1
11.50 – 11.60	2
11.60 – 11.70	4
11.70 – 11.80	6
11.80 – 11.90	3
11.90 – 12.00	4
12.00 – 12.10	7
12.10 – 12.20	8
12.20 – 12.30	7
12.30 – 12.40	4
12.40 – 12.50	6
12.50 – 12.60	3
12.60 – 12.70	2
Total	50

Additional info: Table reconstructed from provided data; some frequencies inferred for completeness.

Histograms

A histogram is a graphical representation of the frequency distribution. Each bin is represented by a rectangle whose height corresponds to the frequency of values in that bin. As the sample size increases, the histogram more closely resembles the underlying probability distribution curve (e.g., bell-shaped for normal distributions).

• Choose the number of bins based on sample size (e.g., 10–15 bins for n = 50).

• Bin width should be consistent and chosen so that number of bins × bin width slightly exceeds the data range.

• Formula for range: $\text{Range} = \text{Maximum} - \text{Minimum}$

• Approximate bin width: $\text{Bin Width} \approx \frac{\text{Range}}{\text{Number of Bins}}$

Example: For data ranging from 42.3 to 98.8 (range = 56.5), using 15 bins gives a bin width of about 4.0; using 17 bins gives about 3.5.

Describing Data Numerically

Variables and Types

Each attribute measured in a population is called a variable. Variables can be:

• Numerical (Quantitative): Continuous (e.g., distance from home) or discrete (e.g., number of credits).

• Categorical (Qualitative): Binary (e.g., commutes: yes/no) or with more categories (e.g., major, minor).

Example Table: (Attributes of U.S. college students)

ID	Major	Minor	Commutes	CurrentTermCredits	AvgLibraryVisits/wk	DistanceFromHome
1	Nursing	NULL	0	12	4.3	114
2	History	Philosophy	1	15	12	380
3	Math	NULL	0	15	3.8	225
4	Marketing	French	1	14	0.8	4
5	Anthropology	Psychology	0	1	1.0	225

Additional info: Table reconstructed and simplified for clarity.

Probability

Probability Distributions for Different Variable Types

• Continuous Variables: Probability is defined as the area under the distribution curve over an interval. The total area under the curve is 1.

• Discrete Variables: Probability is assigned to each possible value. The sum of all probabilities is 1.

• Categorical Variables: Probability is assigned to each category (e.g., via a table or pie chart).

Example (Discrete): Suppose a variable can take values 0, 1, 2, 3, 4, 5 with probabilities 0.05, 0.15, 0.25, 0.25, 0.20, 0.10. The sum is 1.

Example (Categorical): For pet ownership: 67% dogs, 30% cats, 3% other.

Binary Variable: Probability of 'A' (e.g., making a free throw) is 0.82; probability of 'not A' is 0.18.

Types of Probabilities

• Left-tail probability: Probability that a value is less than or equal to a threshold.

• Right-tail probability: Probability that a value is greater than or equal to a threshold.

• Interval probability: Probability that a value falls within a specified interval.

Mode of a Distribution

Definition and Examples

The mode of a probability distribution is the value with the highest probability (the peak of the distribution curve).

• Sample Mode: The most frequently occurring value in a sample.

• A sample can have no mode, one mode, or multiple modes.

Examples:

• Sample: 4, 8, 8, 11, 12, 13 → Mode: 8

• Sample: 4, 8, 11, 12, 13 → No mode

• Sample: 4, 8, 8, 11, 12, 13, 13 → Modes: 8 and 13

Notation for Samples

Sample Size and Values

• n: Sample size (number of values in the sample).

• x1, x2, ..., xn: The values in the sample.

• Subscripts (indices) are used to refer to specific sample values.

Sigma Notation: Used to sum sample values.

For example, the sum of all sample values is written as:

$\sum_{i=1}^{n} x_i$

where i is the index variable.

Summary Table: Types of Variables

Type	Definition	Examples
Continuous	Any value in a range	Height, weight, coffee ounces
Discrete	Specific, separate values (often counts)	Number of credits, bacteria count
Categorical	Categories or groups	Major, pet type, yes/no

Key Takeaways

• Probability distributions describe how values are spread in a population or sample.

• Frequency tables and histograms are essential tools for summarizing and visualizing data.

• Variables can be continuous, discrete, or categorical, each with appropriate methods for summarization and probability assignment.

• Understanding sample notation and the use of sigma notation is crucial for further statistical analysis.