Core Concepts in Statistics: Data Types, Descriptive Statistics, Probability, and Discrete Distributions

Types of Data

Qualitative and Quantitative Data

Understanding the type of data is foundational in statistics, as it determines the appropriate analysis methods. Data can be classified as either qualitative (categorical) or quantitative (numerical).

• Qualitative Data: Non-numerical data describing categories or characteristics.

  • Nominal: Categories without a natural order. Example: Favorite sport (hockey, golf, soccer).

  • Ordinal: Categories with a natural order. Example: Movie ratings (bad, fair, good).

• Quantitative Data: Numerical data that allows for arithmetic operations.

  • Discrete: Data obtained by counting; only specific values are possible. Example: Number of goals scored.

  • Continuous: Data obtained by measuring; any value within a range is possible. Example: Height or temperature.

Measures of Central Tendency

Mean, Median, and Mode

Measures of central tendency summarize the center of a dataset, providing a single value that represents the entire distribution.

• Mean (Average): The sum of all data values divided by the number of values. Formula for Sample Mean: $x\bar = \frac{\sum x}{n}$ Example: For test scores 70, 75, 80, 85, 85, 90, 92: $x\bar = \frac{577}{7} \approx 82.4$

• Median: The middle value when data is ordered. Location Formula: $\frac{n+1}{2}$ Example: For sorted scores 70, 75, 80, 85, 85, 90, 92 ($n=7$), the median is the 4th value: 85.

• Mode: The value that appears most frequently. Example: In the dataset above, 85 appears twice and is the mode.

Note: Datasets can be bimodal (two modes), multimodal (more than two), or have no mode.

Measures of Spread

Range, Interquartile Range (IQR), and Standard Deviation

Measures of spread describe the variability or dispersion within a dataset.

• Range: Difference between the maximum and minimum values. Formula: $\text{Range} = \text{Max} - \text{Min}$ Example: For hours studied: 1, 2, 4, 5, 5, 6, 7, 10, $\text{Range} = 10 - 1 = 9$ hours.

• Interquartile Range (IQR): Spread of the middle 50% of data. Formula: $\text{IQR} = Q_3 - Q_1$ Example: For the same data: $Q_1 = 3$, $Q_2 = 5$, $Q_3 = 6.5$, so $\text{IQR} = 6.5 - 3 = 3.5$

• Standard Deviation (s): Measures the typical distance of data values from the mean. Formula for Sample Standard Deviation: $s = \sqrt{\frac{\sum (x - x\bar)^2}{n-1}}$ Example: For hours studied (mean = 5): Squared deviations sum to 56, $s = \sqrt{\frac{56}{7}} = \sqrt{8} \approx 2.8$ hours.

Note: For population standard deviation, divide by $n$ instead of $n-1$.

Graphing Data

Visualizing Qualitative and Quantitative Data

Graphs are essential for visualizing data distributions, trends, and outliers. The choice of graph depends on the data type.

• Qualitative Data Graphs:

  • Bar Chart: Displays frequency for each category; bars are separated.

  • Pie Chart: Shows each category's proportion as a sector of a circle.

• Quantitative Data Graphs:

  • Histogram: For continuous data; bars touch, representing frequency within intervals (bins).

  • Box Plot (Box-and-Whisker Plot): Visualizes the five-number summary (min, $Q_1$, median, $Q_3$, max) and highlights outliers.

Probability Basics

Theoretical and Experimental Probability

Probability quantifies the likelihood of an event, ranging from 0 (impossible) to 1 (certain).

• Theoretical Probability: Based on possible outcomes under ideal conditions. Formula: $P(A) = \frac{\text{Number of ways event A can occur}}{\text{Total number of possible outcomes}}$ Example: Probability of rolling a 3 on a die: $P(3) = \frac{1}{6}$ Probability of rolling two 3s in a row: $P(3 \text{ and } 3) = \frac{1}{6} \times \frac{1}{6} = \frac{1}{36}$

• Experimental Probability: Based on observed outcomes in experiments. Formula: $P(A) = \frac{\text{Number of times event A occurred}}{\text{Total number of trials}}$ Example: Rolling a die 20 times and getting two 3s: $P(3, \text{experimental}) = \frac{2}{20} = 0.1$

Law of Large Numbers: As the number of trials increases, experimental probability approaches theoretical probability.

Discrete Probability Distributions

Discrete Random Variables and the Binomial Distribution

A discrete probability distribution lists all possible values of a discrete random variable and their probabilities. The binomial distribution is a key example, describing the number of successes in a fixed number of independent trials with constant probability of success.

• Discrete Random Variable: Takes on countable values (e.g., number of goals scored).

• Binomial Distribution:

  • Fixed number of trials ($n$)

  • Each trial has two outcomes (success/failure)

  • Probability of success ($p$) is constant

  • Trials are independent

  Example: Rolling a six-sided die three times, counting sixes ($n=3$, $p=1/6$)

Probability Mass Function (PMF) for Binomial Distribution

The PMF gives the probability of observing exactly $k$ successes in $n$ trials:

$P(X = k) = \binom{n}{k} p^k (1-p)^{n-k}$

Example: For rolling a six three times ($n=3$, $p=1/6$):

$P(X = k) = \binom{3}{k} \left(\frac{1}{6}\right)^k \left(\frac{5}{6}\right)^{3-k}$, where $k = 0, 1, 2, 3$

Tabular Representation of the Binomial Distribution

The table below lists the probabilities for each possible number of sixes rolled in three attempts:

Number of Sixes (k)	Probability $P(X=k)$
0	$\binom{3}{0} \left(\frac{1}{6}\right)^0 \left(\frac{5}{6}\right)^3 = 1 \times 1 \times \frac{125}{216} = \frac{125}{216}$
1	$\binom{3}{1} \left(\frac{1}{6}\right)^1 \left(\frac{5}{6}\right)^2 = 3 \times \frac{1}{6} \times \frac{25}{36} = \frac{75}{216}$
2	$\binom{3}{2} \left(\frac{1}{6}\right)^2 \left(\frac{5}{6}\right)^1 = 3 \times \frac{1}{36} \times \frac{5}{6} = \frac{15}{216}$
3	$\binom{3}{3} \left(\frac{1}{6}\right)^3 \left(\frac{5}{6}\right)^0 = 1 \times \frac{1}{216} \times 1 = \frac{1}{216}$

Note: The sum of all probabilities in a discrete probability distribution is always 1.

Additional info: Other types of discrete distributions include hypergeometric, geometric, and Poisson, but the binomial is most commonly encountered at this level.