Statistics Study Guide: Experimental Design, Data Types, Probability, and Regression

Experimental Design in Statistics

Identifying Subjects and Treatments

In statistical experiments, it is crucial to distinguish between subjects (the individuals or units being studied) and treatments (the conditions or interventions applied).

• Subjects: The individuals or objects participating in the study (e.g., adults in a nutrition study).

• Treatments: The specific conditions or interventions assigned to subjects (e.g., new diet vs. usual diet).

• Example: In a cholesterol study, adults are the subjects, and the new diet is the treatment.

Sampling Methods

Sampling is the process of selecting a subset of individuals from a population to estimate characteristics of the whole population.

• Random Sampling: Every member of the population has an equal chance of being selected.

• Sample Statistic: A numerical summary of a sample (e.g., average crab length).

• Population Parameter: A numerical summary of the entire population.

• Example: Measuring the average length of crabs from a random sample to estimate the population mean.

Random Assignment and Experimental Design

Random assignment is used to allocate subjects to different treatments, minimizing bias and confounding variables.

• Random Assignment: Assigning subjects to treatments by chance.

• Purpose: Ensures groups are comparable and results are attributable to the treatment.

• Example: Assigning adults to either a new diet or their usual diet randomly.

Variables and Relationships

Types of Variables

Variables are characteristics or properties that can take on different values.

• Independent Variable (X): The variable manipulated or categorized (e.g., hours of exercise).

• Dependent Variable (Y): The outcome measured (e.g., blood pressure).

• Example: Studying the effect of exercise (X) on blood pressure (Y).

Discrete vs. Continuous Variables

Variables can be classified as discrete or continuous based on the type of data they represent.

• Discrete Variable: Takes on countable values (e.g., number of children).

• Continuous Variable: Can take any value within a range (e.g., height, weight).

• Example: Rolling a die produces a discrete outcome (1-6).

Probability Distributions

Probability Distribution Table

A probability distribution lists all possible outcomes of a random experiment and their probabilities.

Outcome (x)	Probability P(x)
0	0.1
1	0.2
2	0.3
3	0.2
4	0.2

Additional info: Probabilities must sum to 1.

Sample Space

The sample space is the set of all possible outcomes of a random experiment.

• Example: For rolling a die, the sample space is {1, 2, 3, 4, 5, 6}.

Probability of an Event

The probability of an event is the sum of the probabilities of the outcomes that make up the event.

• Example: Probability of rolling a 5: $P(5) = \frac{1}{6}$

Central Limit Theorem

Statement and Importance

The Central Limit Theorem (CLT) is a fundamental concept in statistics.

• Statement: For a large enough sample size, the sampling distribution of the sample mean approaches a normal distribution, regardless of the population's distribution.

• Formula: $\bar{X} \sim N(\mu, \frac{\sigma^2}{n})$

• Importance: Allows for inference about population parameters using sample statistics.

Regression Analysis

Least-Squares Regression Equation

Regression analysis estimates the relationship between variables. The least-squares regression equation predicts the value of a dependent variable (Y) based on the independent variable (X).

• Equation: $Y = a + bX$

• Intercept (a): The value of Y when X = 0.

• Slope (b): The change in Y for a one-unit increase in X.

• Example: Predicting blood pressure (Y) from hours of exercise (X).

Interpreting Regression Coefficients

• When X increases: Y changes by the value of the slope (b).

• Intercept: Represents the expected value of Y when X is zero.

Essay-Type Questions

Short Academic Explanations

• Discrete vs. Continuous Random Variables: Discrete random variables have countable outcomes; continuous random variables have infinite possible values within a range.

• Random Variable: A variable whose value is determined by the outcome of a random experiment.

• Sample Space: The set of all possible outcomes.

Summary Table: Variable Types

Type	Description	Example
Discrete	Countable values	Number of children
Continuous	Any value in a range	Height, weight