Foundations of Statistics: Populations, Samples, Data Types, and Sampling Methods

Parameters vs. Statistics

Definitions and Key Concepts

Statistics is the science of collecting, organizing, analyzing, and interpreting data to make informed decisions. Understanding the distinction between populations and samples, as well as parameters and statistics, is fundamental in statistical analysis.

• Data: Information gathered from counting, measuring, or collecting responses.

• Population: The entire set containing all data points of interest (e.g., every individual in a group).

• Sample: A subset of the population, selected for analysis.

• Parameter: A numerical value that describes a characteristic of a population.

• Statistic: A numerical value that describes a characteristic of a sample.

Example:

Scenario	Population or Sample?	Parameter or Statistic?
The salary of every employee at a marketing firm	Population	Parameter
The salaries of 12 out of 100 total employees at a marketing firm	Sample	Statistic
The average salary of all employees at a marketing firm is $41,000	Population	Parameter
The average salary of 12 out of 100 employees at a marketing firm is $58,000	Sample	Statistic

Types of Data

Qualitative vs. Quantitative Data

Data can be categorized based on their nature and the type of information they represent.

• Qualitative Data (Categorical): Data that represent qualities or categories (e.g., favorite color, eye color).

• Quantitative Data (Numerical): Data that represent quantities and can be measured or counted.

Subtypes of Quantitative Data

• Discrete Data: Quantitative data that can take only specific, separate values (e.g., number of students in a classroom, dice roll outcomes).

• Continuous Data: Quantitative data that can take any value within a range (e.g., time, temperature).

Example Table:

Type	Description	Examples
Qualitative	Qualities, categories	Favorite color, eye color
Quantitative - Discrete	Countable, separate values	Dice roll, number of students
Quantitative - Continuous	Any value in a range	Time, temperature

Intro to Collecting Data

Methods of Data Collection

There are two main ways to collect data in statistics:

• Experiment: Apply a treatment and measure its effects; allows for causation to be inferred.

• Observational Study: Observe characteristics without changing anything; does not allow for causation to be inferred.

Example:

• Testing a medication by giving 15 subjects a placebo and 15 the actual medication is an experiment (can infer causation).

• Surveying students about their sleep habits and grades is an observational study (cannot infer causation).

• Rolling a fair and a loaded die 10 times each and comparing results is an experiment (can infer causation).

Sampling and Simple Random Sampling

Sampling Concepts

Sampling is the process of selecting a smaller group (sample) from a larger group (population) for analysis.

• Representative Sample: A sample made up of equal proportions of characteristics as the original population.

• Simple Random Sampling (SRS): Each subject in the population has an equal chance of being selected.

Example Table:

Scenario	Representative Sample?	Simple Random Sample?
Randomly select 3 marbles from a bag with 2 red & 4 blue marbles; all selected are blue	No	Yes
University with 60% undergraduates & 40% graduates surveys 60% undergrads & 40% grads	Yes	No (unless random selection within groups)

Steps for Simple Random Sampling

1. Assign a unique number to each member of the population.

2. Use a random number generator or draw numbers from a hat to select the desired sample size.

3. Ensure each member has an equal chance of being selected.

Example: To select 5 random students out of 20, assign numbers 1–20 to each student, then randomly select 5 numbers.

Practice and Application

Identifying Data Types and Sampling Methods

• Determine if a data set is a population or sample based on whether it includes all members or just a subset.

• Identify if a value is a parameter (population) or statistic (sample).

• Classify data as qualitative or quantitative; if quantitative, determine if it is discrete or continuous.

• Distinguish between experiments and observational studies, and recognize when causation can be inferred.

• Evaluate whether a sample is representative and/or a simple random sample.

Additional info: These foundational concepts are essential for understanding more advanced topics in statistics, such as hypothesis testing, confidence intervals, and inferential statistics.