Chapter 1: Introduction to Statistics

Section 1.3: Data Collection and Experimental Design

This section introduces foundational concepts in designing statistical studies, distinguishing between observational studies and experiments, and outlines various data collection and sampling techniques. Understanding these principles is essential for conducting valid and reliable statistical research.

Designing a Statistical Study

• Identify Variables and Population: Clearly define the variable(s) of interest and the population under study.

• Develop a Data Collection Plan: Ensure the sample is representative of the population.

• Collect Data: Gather information using appropriate methods.

• Describe Data: Use descriptive statistics to summarize the data.

• Interpret Data: Apply inferential statistics to make decisions about the population.

• Identify Errors: Recognize and account for possible errors in the study.

Types of Statistical Studies

• Observational Study: The researcher observes and measures characteristics without influencing the subjects. Example: Measuring time spent on activities by individuals.

• Experiment: A treatment is applied to a group (treatment group), and responses are compared to a control group, which may receive a placebo. Example: Testing effects of artificial sweeteners on glycemic response.

Examples: Observational Study vs. Experiment

• Experiment Example: Vitamin supplementation study with treatment and placebo groups.

• Observational Study Example: Surveying Americans about economic confidence without influencing responses.

Other Data Collection Methods

• Simulation: Uses mathematical or physical models (often computer-based) to replicate real-world conditions. Useful for impractical or dangerous situations (e.g., crash tests).

• Survey: Investigates population characteristics by asking questions. Surveys can be conducted via interviews, phone, mail, or online. Question wording is crucial to avoid bias.

Key Elements of Experimental Design

• Control: Managing variables to isolate the effect of the treatment.

• Randomization: Randomly assigning subjects to treatment groups to reduce bias.

• Replication: Repeating the experiment with a large sample size to validate results.

Confounding Variables and Placebo Effect

• Confounding Variable: Occurs when it is unclear which factor caused an observed effect. Example: Increased business after remodeling coinciding with a mall opening.

• Placebo Effect: Subjects respond to a fake treatment. Blinding (subjects unaware of treatment) and double-blind experiments (both subjects and experimenters unaware) help control this effect.

Randomization Techniques

• Completely Randomized Design: Subjects are randomly assigned to groups.

• Randomized Block Design: Subjects are divided into blocks based on characteristics, then randomly assigned within blocks.

• Matched-Pairs Design: Subjects are paired based on similarity; each pair receives different treatments.

Sample Size and Replication

• Sample Size: Larger sample sizes increase the reliability and validity of experimental results.

• Replication: Repeating experiments with many subjects ensures findings are not due to chance.

Examples of Experimental Design Issues

• Small Sample Size: Results may not be valid; replication is needed.

• Group Similarity: Groups must be similar; random assignment within blocks is necessary to avoid bias.

Sampling Techniques

• Census: Measures the entire population.

• Sampling: Measures part of the population; more practical for large populations.

• Sampling Error: Difference between sample results and population results.

Types of Sampling

• Random Sample: Every member has an equal chance of selection.

• Simple Random Sample: Every possible sample of the same size has an equal chance of selection.

• Stratified Sample: Population divided into strata; random samples taken from each stratum.

• Cluster Sample: Population divided into clusters; all members from selected clusters are included.

• Systematic Sample: Select every kth member after a random start.

• Convenience Sample: Select members who are easy to reach; often leads to bias.

Example: Simple Random Sample

• Assign numbers to each member of the population.

• Use a random number table or generator to select sample members.

• Ignore numbers outside the population range.

Examples: Identifying Sampling Techniques

• Stratified Sampling: Divide students by major and randomly select from each major.

• Simple Random Sample: Assign numbers and randomly select students.

• Convenience Sample: Select students from your class; may be biased.

Summary Table: Sampling Techniques

Key Terms and Definitions

• Population: The entire group being studied.

• Sample: A subset of the population.

• Variable: A characteristic or property measured in the study.

• Experimental Unit: The subject or object receiving treatment in an experiment.

• Placebo: A harmless, fake treatment used as a control.

• Bias: Systematic error that skews results.

Important Formulas

• Sampling Error: