Introduction to Statistics

What is Statistics?

Statistics is the science of collecting, organizing, analyzing, and interpreting data. Data are collections of observations, such as measurements, genders, survey responses, or counts. Statistics is essential for making informed decisions and understanding the world, but it is important to recognize that data can be misused or presented in misleading ways. Proper statistical methods help ensure accurate and meaningful conclusions.

Data Sources and Types of Studies

Types of Data Collection

• Cross-sectional study: Data are observed, measured, and collected at one point in time.

• Retrospective study: Data are collected from the past, often through examination of records or interviews.

• Prospective (cohort) study: Data are collected in the future from groups (cohorts) sharing common factors.

These study designs are fundamental for understanding how data are gathered and the implications for analysis.

Gathering Data: Populations and Samples

Population, Census, and Sample

• Population: The complete collection of all data (people or items) that are of interest.

• Census: The collection of data from every member of a population.

• Sample: A subset of the population, selected for analysis.

Sampling is often necessary because it is usually impractical or impossible to collect data from an entire population.

Sampling Methods

Types of Sampling

• Simple Random Sample: Every possible sample of size n has the same chance of being chosen. Example: Drawing names from a hat.

• Systematic Sample: Select every kth individual from a list after a random start.

• Stratified Sample: Divide the population into subgroups (strata) and randomly sample from each subgroup.

• Cluster Sample: Divide the population into clusters, randomly select some clusters, and include all members from those clusters.

Random selection is a key principle in sampling, ensuring that the sample is representative of the population.

Good Sampling Practices

• The goal is for the sample to accurately represent the population.

• Randomness and sufficient sample size are essential for minimizing bias and error.

Parameters and Statistics

Definitions

• Parameter: A numerical measurement describing a characteristic of a population.

• Statistic: A numerical measurement describing a characteristic of a sample.

Parameters are usually unknown and estimated using statistics from samples.

Classifying Data

Types of Data

• Categorical (Qualitative) Data: Names or labels that do not represent counts or measurements (e.g., eye color, gender).

• Quantitative Data: Numbers representing counts or measurements (e.g., height, weight, age).

Levels of Measurement

Data can be classified by their level of measurement, which determines the types of statistical analysis that are appropriate.

Discrete vs. Continuous Data

• Discrete Data: Quantitative values that are countable and distinct (e.g., number of students).

• Continuous Data: Quantitative values that can take any value within a range (e.g., height, time).

Bias in Data Collection

Types of Bias

• Sampling Bias: Occurs when some subjects have a higher probability of being selected, making the sample less representative.

• Self-Interest Bias: When researchers or sponsors have a vested interest in the outcome, leading to selective reporting.

• Leading Question Bias: When survey questions are worded to influence responses.

• Nonresponse Bias: When certain groups are less likely to respond, skewing results.

• Confirmation Bias: When researchers favor information that confirms their preconceptions.

Bias can be intentional or unintentional and should be minimized to ensure accurate results.

Anecdotal Evidence

Definition and Limitations

• Anecdotal Evidence: Conclusions drawn from personal stories or isolated examples rather than systematic data collection.

• Anecdotal evidence is not reliable for making generalizations about a population.