Numerically Summarizing Data

Overview

Numerical summaries are essential for understanding the characteristics of a data set. The three main characteristics to consider are shape, center, and spread. These summaries help identify patterns, trends, and outliers in the data.

Measures of Central Tendency

Definitions and Importance

Measures of central tendency describe the average or typical value in a data set. The three most common measures are the mean, median, and mode. Each measure provides a different perspective on the data's center and may yield different results depending on the data's distribution.

• Mean: The arithmetic average, sensitive to extreme values (outliers).

• Median: The middle value when data are ordered; resistant to outliers.

• Mode: The most frequently occurring value; useful for categorical data.

Arithmetic Mean

• Population Mean (\( \mu \)):

• Sample Mean (\( \overline{x} \)):

The mean is often referred to as the "center of gravity" of the data set.

Median

• Arrange data in ascending order.

• If the number of observations (n) is odd, the median is the middle value.

• If n is even, the median is the mean of the two middle values.

Mode

• The value that occurs most frequently in the data set.

• Data can be unimodal, bimodal, or multimodal.

Resistant Statistics

A statistic is resistant if it is not substantially affected by extreme values. The median and interquartile range are resistant, while the mean and standard deviation are not.

Measures of Dispersion

Definitions and Importance

Measures of dispersion describe the spread or variability in a data set. Common measures include the range, variance, and standard deviation.

• Range (R):

• Population Variance (\( \sigma^2 \)):

• Sample Variance (\( s^2 \)):

• Population Standard Deviation (\( \sigma \)):

• Sample Standard Deviation (\( s \)):

The standard deviation measures the typical distance of data values from the mean.

Empirical Rule (for Bell-Shaped Distributions)

• Approximately 68% of data within 1 standard deviation of the mean

• Approximately 95% within 2 standard deviations

• Approximately 99.7% within 3 standard deviations

Chebyshev’s Inequality (for Any Distribution)

For any k > 1, at least of the data lie within k standard deviations of the mean.

Measures from Grouped Data

Approximating the Mean and Standard Deviation

• Mean (Grouped Data): , where is the frequency and is the class midpoint.

• Standard Deviation (Grouped Data):

Weighted Mean

• , where is the weight for observation .

Measures of Position and Outliers

Z-Scores

• Population z-score:

• Sample z-score:

Z-scores indicate how many standard deviations a value is from the mean.

Percentiles and Quartiles

• The kth percentile is the value below which k% of the data fall.

• Quartiles divide data into four equal parts: Q1 (25th percentile), Q2 (median, 50th percentile), Q3 (75th percentile).

Interquartile Range (IQR)

• Represents the range of the middle 50% of the data.

Checking for Outliers

• Calculate Q1, Q3, and IQR.

• Lower Fence:

• Upper Fence:

• Values outside these fences are considered outliers.

The Five-Number Summary and Boxplots

Five-Number Summary

• Minimum

• First Quartile (Q1)

• Median (Q2)

• Third Quartile (Q3)

• Maximum

Boxplots

A boxplot is a graphical summary of the five-number summary. It displays the distribution's center, spread, and potential outliers.

1. Draw a number line covering the data range.

2. Draw a box from Q1 to Q3 with a line at the median.

3. Draw whiskers from the box to the smallest and largest values within the fences.

4. Mark outliers beyond the fences with asterisks or dots.

Figure: Initial boxplot with quartiles and fences marked.

Figure: Boxplot with whiskers extending to non-outlier data points.

Figure: Final boxplot with outliers indicated beyond the upper fence.

Comparing Distributions with Boxplots

Side-by-side boxplots allow for comparison between groups, such as ride distances for shared versus non-shared rides. Differences in medians, spreads, and outliers can be visually assessed.

Figure: Side-by-side boxplots comparing ride distances by sharing status.

Summary Table: Measures of Central Tendency and Dispersion

Choosing Appropriate Measures

• For symmetric distributions without outliers, use the mean and standard deviation.

• For skewed distributions or those with outliers, use the median and interquartile range.

Additional info: This summary integrates textbook explanations, formulas, and examples to provide a comprehensive overview of numerically summarizing data, suitable for college-level statistics students.