Foundations of Statistics: Concepts, Populations, and Samples

1.1 What is Statistics?

Definition and Scope of Statistics

Statistics is the discipline concerned with collecting, organizing, analyzing, and interpreting data to make decisions or draw conclusions under uncertainty. It is fundamental in fields such as business, health, and science, where data-driven decisions are essential.

• Statistics helps us summarize and visualize data through graphs, tables, and numerical summaries.

• Inference allows us to generalize from a sample to a broader group or process, justifying conclusions about populations.

• Data refers to recorded information about cases (people, items, occasions) used as evidence for questions of interest.

Example: In a clinical trial, statistics can help determine whether a new drug is more effective than the standard treatment by analyzing patient outcomes.

Description vs. Inference

Statistical analysis involves both describing what is observed (description) and making predictions or generalizations beyond the observed data (inference).

• Description: Summarizes observed data (e.g., average test scores, proportion of heads in coin flips).

• Inference: Uses sample data to make statements about a larger population or process.

Example: A streaming service tests two homepage designs and uses the results to infer which design will perform better for all users.

Variability, Bias, and Honest Uncertainty

Statistical practice aims to reduce bias and acknowledge variability. Two forces shape every data set:

• Variability: Natural fluctuation in data from case to case or study to study.

• Bias: Systematic deviation due to design, measurement, or selection methods.

Example: In a dartboard analogy, variability is the spread of darts around the board, while bias is the consistent offset from the center.

Recap Table: Key Terms and Definitions

Keyword	Definition
Statistics	The discipline of learning from data to describe patterns and make decisions under uncertainty.
Data	Recorded information about cases used as evidence for questions of interest.
Descriptive statistics	Methods for summarizing and visualizing what was observed.
Inferential statistics	Methods for generalizing from a sample to a population and quantifying uncertainty.
Population	The full group or process we want to understand.
Sample	The subset we actually observe and analyze.
Parameter	A (usually unknown) numerical characteristic of a population.
Statistic	A numerical summary computed from a sample, used to learn about a parameter.
Variability	Natural fluctuation in data from case to case or study to study.

1.2 Populations and Samples

Populations, Samples, and Sampling Frames

Understanding the difference between populations and samples is crucial for statistical inference. The population is the entire group of interest, while the sample is the subset actually measured.

• Population: The full group or process you want to understand.

• Target population: The group you truly care about answering a question for.

• Accessible population: The portion of the target population you can practically reach.

• Sampling frame: The list or mechanism from which the sample is drawn.

Example: If you want to study all Baylor first-year students, your sampling frame might be students who attended welcome week.

What Counts as a Sample?

A sample is the subset of the population you measure. Special cases arise when you attempt to measure every unit in the population (a census), but these are rare due to cost and time constraints.

• Sample: The subset of the population actually observed and analyzed.

• Census: Attempt to measure every unit in the population.

Parameters and Statistics: The Bridge Between Population and Sample

Parameters are numerical characteristics of populations, while statistics are numerical summaries computed from samples. We use statistics to estimate parameters.

• Parameter: A number that describes the population (usually unknown).

• Statistic: A number computed from a sample, used to estimate a parameter.

Example: The average run time of all batteries produced today is a parameter; the average run time from a sample of 16 batteries is a statistic.

Observational Units vs. Sampling Units

It is important to distinguish between the thing you measure (observational unit) and the thing you sample (sampling unit), especially in complex designs.

• Observational unit: The entity on which data are measured (e.g., person, battery, game).

• Sampling unit: The thing you sample (could be the same as the observational unit, or a group in cluster designs).

Why Sampling Works (and When It Doesn't)

Sampling works when your sample is representative of the population and your measurement is trustworthy. Problems arise when parts of the population are systematically excluded (coverage problems) or when selection is related to the outcome (selection effects).

• Coverage problems: Some groups are systematically excluded from the sample.

• Selection effects: The way you select units is related to the outcome.

Example: If only students who arrived late are sampled, the results may not represent all students.

Recap Table: Populations and Samples

Keyword	Definition
Population	The full group or process you want to understand.
Target population	The group you truly care about answering a question for.
Accessible population	The portion of the target population you can practically reach.
Sampling frame	The list or mechanism from which the sample is drawn.

Formulas and Equations

• Sample mean: $\bar{x} = \frac{1}{n} \sum_{i=1}^{n} x_i$

• Population mean: $\mu = \frac{1}{N} \sum_{i=1}^{N} x_i$

• Sample proportion: $\hat{p} = \frac{x}{n}$

Examples and Applications

• Clinical trial: Use statistics to compare outcomes between treatment and control groups.

• Business A/B testing: Use inferential statistics to decide which product design performs better.

• Education research: Use sampling to estimate average test scores for a school district.

Short Comparison Table: Description vs. Inference

Aspect	Description	Inference
Purpose	Summarize observed data	Generalize to population
Methods	Tables, graphs, numerical summaries	Confidence intervals, hypothesis tests
Uncertainty	Not quantified	Quantified

Additional info:

• JMP Pro 17 is a statistical software used for data analysis, including graph building, distribution analysis, and modeling.

• Good statistical practice involves clear definition of populations, samples, and sampling frames before analysis.