Statistical and Critical Thinking: Foundations of Statistics

Statistical and Critical Thinking

Introduction to Statistics

Statistics is the science of planning studies and experiments, obtaining data, and then organizing, summarizing, presenting, analyzing, and interpreting those data to draw conclusions. It is essential for making informed decisions based on data.

• Data: Collections of observations, such as measurements, genders, or survey responses. A single value is called a datum.

• Population: The complete collection of all measurements or data that are being considered. Typically, a population is the entire group about which we want to draw conclusions.

• Sample: A subcollection of members selected from a population.

• Census: The collection of data from every member of the population.

Example: Residential Carbon Monoxide Detectors

In a study of carbon monoxide detector failure rates, the population was all 38 million detectors in the United States, while the sample consisted of 30 randomly selected detectors. The objective was to use the sample data to draw conclusions about the entire population.

• Population: All 38 million carbon monoxide detectors in the United States.

• Sample: The 30 detectors that were selected and tested.

Preparing, Analyzing, and Concluding in Statistical Studies

Steps in Statistical Analysis

Statistical studies typically follow a structured process to ensure valid and meaningful results. The process can be divided into three main phases: Prepare, Analyze, and Conclude.

Prepare

• Context: Understand what the data represent and the goal of the study.

• Source of the Data: Consider if the data come from a source with a special interest that could bias the results.

• Sampling Method: Assess whether the data were collected in an unbiased way or if there was self-selection or other bias.

Analyze

• Graph the Data: Visualize the data to identify patterns and outliers.

• Explore the Data: Summarize with statistics such as mean and standard deviation, check for outliers, and examine the distribution.

• Apply Statistical Methods: Use technology and statistical techniques to obtain results.

Conclude

• Significance: Determine if the results have statistical and practical significance.

Potential Pitfalls in Data Analysis

Survivor Bias

Survivor bias occurs when conclusions are drawn from data that only represent subjects that 'survived' a process, ignoring those that did not. For example, analyzing bullet holes on returning aircraft without considering those that did not return can lead to misleading conclusions about vulnerability.

Types of Samples

Voluntary Response Sample

A voluntary response sample (or self-selected sample) is one in which the respondents themselves decide whether to be included. Such samples are often biased and do not represent the population accurately.

• Definition: A sample where participation is optional and self-selected.

• Example: TV polls where viewers call in to express their opinions.

Statistical vs. Practical Significance

Making Conclusions

• Statistical Significance: Achieved when a result is very unlikely to occur by chance. A common criterion is a probability less than 5% ($p < 0.05$).

• Practical Significance: Refers to whether the result is large or important enough to be meaningful in real-world terms, regardless of statistical significance.

Examples

• Getting 98 girls in 100 random births is statistically significant because such an extreme outcome is unlikely due to random chance.

• Getting 52 girls in 100 births is not statistically significant, as this could easily occur with random chance.

• A treatment may be statistically significant but not practically significant if the effect size is too small to matter in practice.

Tabular Data: Task Duration and Distance Traveled

The following table compares the time taken for various tasks while driving and the approximate distance traveled at 60 mph during each task.

Task	Duration (seconds)	Distance Traveled at 60 mph (feet)
Text Messaging	5.94	Approx. 520 ft
Destination Entry (GPS)	4.59	Approx. 403 ft
10-digit Dialing	3.82	Approx. 336 ft
Contact Dialing	2.57	Approx. 226 ft
Radio Tuning	2.09	Approx. 184 ft

Summary

• Statistics involves collecting, analyzing, and interpreting data to make informed decisions.

• Understanding the context, source, and sampling method is crucial for valid conclusions.

• Distinguishing between statistical and practical significance helps assess the real-world impact of findings.

• Awareness of biases, such as survivor bias and voluntary response samples, is essential for critical thinking in statistics.