Core Statistical Concepts and Data Summarization

Statistical Concepts

Population and Sample

In statistics, understanding the distinction between a population and a sample is fundamental. The population refers to the entire group of interest, while a sample is a subset selected from the population for analysis.

• Population: The complete set of individuals, items, or data under study.

• Sample: A portion of the population chosen for measurement or observation.

Types of Data

Data can be classified based on their nature and measurement scale.

• Quantitative (Numerical): Data that represent counts or measurements (e.g., height, weight).

• Qualitative (Categorical): Data that represent categories or labels (e.g., gender, color).

• Continuous: Data that can take any value within a range (e.g., temperature).

• Discrete: Data that can only take specific values (e.g., number of students).

• Nominal: Categories without a natural order (e.g., types of fruit).

• Ordinal: Categories with a meaningful order (e.g., rankings).

• Interval: Numerical data with meaningful differences but no true zero (e.g., Celsius temperature).

• Ratio: Numerical data with a true zero (e.g., weight).``

Types of Sampling

Sampling methods determine how samples are selected from the population.

• Random Sampling: Every member has an equal chance of selection.

• Convenience Sampling: Selection based on ease of access.

• Systematic Sampling: Selection at regular intervals.

• Stratified Sampling: Population divided into subgroups (strata), samples taken from each.

• Clustered Sampling: Population divided into clusters, some clusters are randomly selected.

Types of Study

• Census: Data collected from the entire population.

• Observational Study: Observing subjects without intervention.

• Retrospective Study: Looking back at past data.

• Prospective Study: Following subjects into the future.

• Cross-sectional Study: Data collected at a single point in time.

• Experimental Study: Manipulating variables to observe effects.

Tables and Graphs

Frequency Table

A frequency table summarizes data by showing the number of observations within specified intervals (classes).

• Class Limits: The lowest and highest values that can belong to a class.

• Class Width: $\text{Class width} = \text{Upper class limit} - \text{Lower class limit}$

• Class Boundaries: The values that separate classes.

• Relative Frequency: The proportion of observations in each class.

• Cumulative Frequency: The running total of frequencies through the classes.

Histograms

Histograms are graphical representations of the frequency distribution of numerical data.

• Skewness: Indicates the asymmetry of the distribution.

• Positively Skewed: Majority of data on the left, tail on the right.

• Negatively Skewed: Majority of data on the right, tail on the left.

Other Graphical Tools

• Pie Chart: Shows proportions of categories as slices of a circle.

• Bar Plot: Displays categorical data with rectangular bars.

• Dot Plot: Uses dots to represent individual data points.

• QQ Plot: Compares sample data to a normal distribution.

Mean, Variance (Standard Deviation), and Five-Number Summary

Mean

The mean is the average value of a dataset.

• Population Mean ($\mu$): $\mu = \frac{x_1 + x_2 + \cdots + x_N}{N}$

• Sample Mean ($\bar{x}$): $\bar{x} = \frac{x_1 + x_2 + \cdots + x_n}{n}$

• Sample Mean from Frequency Table: $\bar{x} = \frac{\sum (f \times \text{class midpoint})}{\sum f}$

• Weighted Mean: $\bar{x} = \frac{\sum w x}{\sum w}$, where $w$ is the weight and $x$ is the data value.

Median

The median is the middle value when data are ordered.

• If $n$ is odd, the median is the middle value.

• If $n$ is even, the median is the average of the two middle values.

Mode

The mode is the value that appears most frequently in a dataset. There can be one, two, or more modes.

Variance and Standard Deviation

Variance measures the spread of data values. Standard deviation is the square root of variance.

• Population Variance ($\sigma^2$): $\sigma^2 = \frac{\sum (x - \mu)^2}{N}$

• Sample Variance ($s^2$): $s^2 = \frac{\sum (x - \bar{x})^2}{n - 1}$

• Standard Deviation ($s$): $s = \sqrt{s^2}$

• Variance has units squared of the original data values.

• If $s = 0$ or $\sigma = 0$, all data values are the same.

Resistance

Resistance refers to how statistics are affected by extreme values (outliers).

• Median: Resistant to outliers.

• Mean, Variance, Standard Deviation: Not resistant.

Quartiles and Percentiles

Quartiles divide data into four equal parts; percentiles divide data into 100 equal parts.

• 25th Percentile: First quartile (Q1)

• 50th Percentile: Median (Q2)

• 75th Percentile: Third quartile (Q3)

Five-Number Summary

The five-number summary provides a quick overview of data distribution.

• Minimum

• Q1 (First Quartile)

• Median (Q2)

• Q3 (Third Quartile)

• Maximum

Interquartile Range (IQR) and Outlier Rule

• IQR: $\text{IQR} = Q3 - Q1$

• Outlier Rule: A value is an outlier if it is less than $Q1 - 1.5 \times IQR$ or greater than $Q3 + 1.5 \times IQR$.

Boxplot

Boxplots visually display the five-number summary and highlight outliers.

• Box extends from Q1 to Q3; line inside box is the median.

• Points outside the box indicate outliers.

• Skewed right: mean > median

• Skewed left: mean < median

Z-Score

The z-score measures how many standard deviations a data value is from the mean.

• $z = \frac{x - \mu}{\sigma}$ for population

• $z = \frac{x - \bar{x}}{s}$ for sample

• If $z \leq -2$, the value is significantly low; if $z \geq 2$, the value is significantly high.

Example Table: Types of Data

Type	Description	Example
Nominal	Categories without order	Colors, gender
Ordinal	Categories with order	Rankings, satisfaction levels
Interval	Numerical, no true zero	Temperature (Celsius)
Ratio	Numerical, true zero	Height, weight

Example: Calculating Sample Mean from Frequency Table

• Suppose you have class midpoints: 10, 20, 30 with frequencies: 2, 3, 5.

• Sample mean: $\bar{x} = \frac{(2 \times 10) + (3 \times 20) + (5 \times 30)}{2 + 3 + 5} = \frac{20 + 60 + 150}{10} = 23$

Example: Identifying Outliers Using IQR

• Given Q1 = 15, Q3 = 25, IQR = 10.

• Lower bound: $15 - 1.5 \times 10 = 0$

• Upper bound: $25 + 1.5 \times 10 = 40$

• Any value below 0 or above 40 is an outlier.