Hypothesis Testing, Confidence Intervals, and Inference in Statistics: Study Guide

Hypothesis Testing

Types of Hypotheses

Hypothesis testing is a fundamental method in statistics for making inferences about population parameters based on sample data. The two main types of hypotheses are:

• Null Hypothesis (H0): States that there is no effect or no difference. It is the hypothesis that the researcher tries to disprove.

• Alternative Hypothesis (Ha): States that there is an effect or a difference. It is what the researcher wants to prove.

For example, to test if the mean price of a single-family home has changed, the hypotheses might be:

• $H_0: \mu = 243,714$

• $H_a: \mu \neq 243,714$

Types of Errors

• Type I Error: Rejecting the null hypothesis when it is actually true.

• Type II Error: Failing to reject the null hypothesis when the alternative hypothesis is true.

The probability of a Type I error is denoted by $\alpha$ (level of significance), and the probability of a Type II error is denoted by $\beta$.

Steps in Hypothesis Testing

1. State the null and alternative hypotheses.

2. Choose the significance level ($\alpha$), commonly 0.05 or 0.01.

3. Collect sample data and calculate the test statistic.

4. Find the P-value or critical value.

5. Make a decision: reject or fail to reject the null hypothesis.

P-value Approach

The P-value is the probability of obtaining a sample statistic as extreme as the one observed, assuming the null hypothesis is true.

• If the P-value is less than $\alpha$, reject the null hypothesis.

• If the P-value is greater than $\alpha$, fail to reject the null hypothesis.

Test Statistics

Common test statistics include the z-test, t-test, and tests for proportions. The formula for a z-test for a population mean is:

• $z = \frac{\bar{x} - \mu_0}{\sigma / \sqrt{n}}$

Where $\bar{x}$ is the sample mean, $\mu_0$ is the hypothesized population mean, $\sigma$ is the population standard deviation, and $n$ is the sample size.

Confidence Intervals

Definition and Interpretation

A confidence interval provides a range of values within which the population parameter is likely to fall, with a certain level of confidence (e.g., 95%).

• For a mean: $\bar{x} \pm z^* \frac{\sigma}{\sqrt{n}}$

• For a proportion: $\hat{p} \pm z^* \sqrt{\frac{\hat{p}(1-\hat{p})}{n}}$

Where $z^*$ is the critical value from the standard normal distribution for the desired confidence level.

Interpreting Confidence Intervals

• If the hypothesized value is outside the confidence interval, there is sufficient evidence to reject the null hypothesis.

• If the hypothesized value is inside the confidence interval, there is not sufficient evidence to reject the null hypothesis.

Inference on Two Population Parameters

Comparing Two Means or Proportions

When comparing two populations, the hypotheses are often:

• $H_0: \mu_1 = \mu_2$ or $H_0: p_1 = p_2$

• $H_a: \mu_1 \neq \mu_2$ or $H_a: p_1 \neq p_2$

The test statistic for the difference between two means (assuming equal variances) is:

• $t = \frac{(\bar{x}_1 - \bar{x}_2) - (\mu_1 - \mu_2)}{\sqrt{s_p^2 (\frac{1}{n_1} + \frac{1}{n_2})}}$

Where $s_p^2$ is the pooled sample variance.

Confidence Interval for Difference Between Proportions

• $(\hat{p}_1 - \hat{p}_2) \pm z^* \sqrt{\frac{\hat{p}_1(1-\hat{p}_1)}{n_1} + \frac{\hat{p}_2(1-\hat{p}_2)}{n_2}}$

Inference on Categorical Data

Chi-Square Test

The chi-square test is used to determine if there is a significant association between categorical variables.

• $\chi^2 = \sum \frac{(O_i - E_i)^2}{E_i}$

Where $O_i$ is the observed frequency and $E_i$ is the expected frequency.

Normal Probability Distribution

Standard Normal Table

The standard normal table provides the area under the normal curve to the left of a given z-score. It is used to find probabilities and critical values for hypothesis tests and confidence intervals.

Sampling Methods

Types of Sampling

• Simple Random Sampling: Every member of the population has an equal chance of being selected.

• Dependent Sampling: Samples are related or paired (e.g., before-and-after measurements).

• Independent Sampling: Samples are unrelated.

Qualitative vs. Quantitative Data

• Qualitative (Categorical) Data: Describes categories or qualities (e.g., political philosophy).

• Quantitative Data: Numerical measurements (e.g., waiting times, diameters).

Organizing and Summarizing Data

Tables and Data Sets

Data can be organized in tables for easier analysis. For example, a table of political philosophies or employment responses can be used to summarize categorical data.

Example Table: Political Philosophy

Conservative	Liberal	Moderate
Count	Count	Count

Describing the Relation Between Two Variables

Correlation Coefficient

The correlation coefficient measures the strength and direction of a linear relationship between two variables.

• $r = \frac{\sum (x_i - \bar{x})(y_i - \bar{y})}{\sqrt{\sum (x_i - \bar{x})^2 \sum (y_i - \bar{y})^2}}$

Critical values for correlation coefficients are used to determine if the observed correlation is statistically significant.

Example Table: Correlation Coefficient Critical Values

Sample Size	Critical Value
5	0.878
10	0.632
20	0.444

Applications and Examples

• Testing Means: Determining if the mean waiting time at a restaurant has changed after a new system is implemented.

• Testing Proportions: Comparing the proportion of adults willing to pay higher taxes between full-time and part-time employees.

• Comparing Two Groups: Analyzing the difference in scores between two groups of students in a board game study.

Additional info: These study notes cover topics from chapters 9-14, including hypothesis testing, confidence intervals, inference on two population parameters, inference on categorical data, and regression/correlation. The original file consists of practice questions, tables, and data sets relevant to these topics.