Estimating Parameters and Determining Sample Sizes: Study Notes

Chapter 7: Estimating Parameters and Sample Sizes

Introduction to Estimation in Statistics

Estimation is a fundamental concept in inferential statistics, where sample data is used to estimate population parameters. This chapter focuses on point estimates, interval estimates (confidence intervals), and determining appropriate sample sizes for statistical inference.

• Point Estimate: A single value estimate of a population parameter (e.g., mean, proportion).

• Interval Estimate: A range of values (confidence interval) likely to contain the population parameter.

• Sample Size Determination: Calculating the number of observations required to achieve a desired level of confidence and margin of error.

Estimating Population Proportion

The sample proportion (p̂) is the best point estimate of the population proportion (p). The sampling distribution of p̂ is approximately normal if certain conditions are met (np ≥ 5 and n(1-p) ≥ 5).

• Formula for Sample Proportion: $\hat{p} = \frac{x}{n}$, where x is the number of successes and n is the sample size.

• Example: If 44 out of 100 patients experience an adverse reaction, $\hat{p} = \frac{44}{100} = 0.44$.

Confidence Intervals for Population Proportion

A confidence interval provides a range of values within which the population proportion is likely to fall, with a specified level of confidence (e.g., 95%).

• General Formula: $\hat{p} \pm z_{\alpha/2} \sqrt{\frac{\hat{p}(1-\hat{p})}{n}}$

• Margin of Error (E): $E = z_{\alpha/2} \sqrt{\frac{\hat{p}(1-\hat{p})}{n}}$

• Critical Value (zα/2): The z-score corresponding to the desired confidence level (e.g., 1.96 for 95%).

• Example: For $\hat{p} = 0.44$, n = 100, 95% CI: $0.44 \pm 1.96 \sqrt{\frac{0.44 \times 0.56}{100}} = 0.44 \pm 0.097$; CI is (0.343, 0.537).

HTML Table: Confidence Interval Components

Component	Description
Point Estimate ($\hat{p}$)	Sample proportion
Critical Value ($z_{\alpha/2}$)	Z-score for confidence level
Standard Error	$\sqrt{\frac{\hat{p}(1-\hat{p})}{n}}$
Margin of Error (E)	Maximum likely difference between sample and population proportion

Determining Sample Size for Proportion Estimates

To estimate a population proportion with a specified margin of error and confidence level, the required sample size can be calculated using:

• Formula: $n = \frac{z_{\alpha/2}^2 \cdot p \cdot (1-p)}{E^2}$

• If p is unknown: Use p = 0.5 for a conservative estimate.

• Example: To estimate a proportion with 95% confidence and margin of error 0.05, $n = \frac{(1.96)^2 \times 0.5 \times 0.5}{(0.05)^2} = 384.16$ (round up to 385).

Estimating Population Mean

The sample mean ($\bar{x}$) is the best point estimate of the population mean ($\mu$). Confidence intervals for the mean depend on whether the population standard deviation ($\sigma$) is known.

• Known $\sigma$: $\bar{x} \pm z_{\alpha/2} \frac{\sigma}{\sqrt{n}}$

• Unknown $\sigma$: $\bar{x} \pm t_{\alpha/2, df} \frac{s}{\sqrt{n}}$, where s is the sample standard deviation and df is degrees of freedom (n-1).

• Degrees of Freedom: Number of independent values in a sample that can vary (df = n - 1).

• Example: For $\bar{x} = 150$, $s = 15$, $n = 36$, 95% CI: $150 \pm 2.03 \times \frac{15}{6} = 150 \pm 5.08$; CI is (144.92, 155.08).

HTML Table: Confidence Interval for Mean

Case	Formula	Distribution
Known $\sigma$	$\bar{x} \pm z_{\alpha/2} \frac{\sigma}{\sqrt{n}}$	Normal
Unknown $\sigma$	$\bar{x} \pm t_{\alpha/2, df} \frac{s}{\sqrt{n}}$	t-distribution

Estimating Population Variance and Standard Deviation

The sample variance ($s^2$) and sample standard deviation ($s$) are used as point estimates for the population variance ($\sigma^2$) and standard deviation ($\sigma$). Confidence intervals for variance use the chi-square distribution.

• Formula for CI of Variance: $\left( \frac{(n-1)s^2}{\chi^2_{\alpha/2}}, \frac{(n-1)s^2}{\chi^2_{1-\alpha/2}} \right)$

• Chi-square Distribution: Used when estimating variance; depends on degrees of freedom.

• Example: For n = 10, $s^2 = 25$, 95% CI: Use chi-square values for df = 9.

Simulation of Confidence Intervals

Simulations can illustrate the behavior of confidence intervals over repeated samples. For example, generating 1,000 confidence intervals for a mean or proportion shows that approximately 95% of intervals contain the true parameter when using a 95% confidence level.

• Application: Used to visualize the concept of confidence level and sampling variability.

• Interpretation: Not every interval will contain the true parameter, but the proportion matches the confidence level over many samples.

Summary Table: Estimation Methods

Parameter	Point Estimate	Interval Estimate Formula	Distribution
Proportion ($p$)	$\hat{p}$	$\hat{p} \pm z_{\alpha/2} \sqrt{\frac{\hat{p}(1-\hat{p})}{n}}$	Normal
Mean ($\mu$), known $\sigma$	$\bar{x}$	$\bar{x} \pm z_{\alpha/2} \frac{\sigma}{\sqrt{n}}$	Normal
Mean ($\mu$), unknown $\sigma$	$\bar{x}$	$\bar{x} \pm t_{\alpha/2, df} \frac{s}{\sqrt{n}}$	t-distribution
Variance ($\sigma^2$)	$s^2$	$\left( \frac{(n-1)s^2}{\chi^2_{\alpha/2}}, \frac{(n-1)s^2}{\chi^2_{1-\alpha/2}} \right)$	Chi-square

Key Terms and Definitions

• Point Estimate: Single value estimate of a population parameter.

• Confidence Interval: Range of values likely to contain the population parameter.

• Margin of Error (E): Maximum likely difference between sample statistic and population parameter.

• Critical Value: Value from a probability distribution corresponding to the desired confidence level.

• Degrees of Freedom: Number of independent values in a sample minus one.

Examples and Applications

• Medical Studies: Estimating the proportion of patients with adverse reactions to a drug.

• Social Science: Determining if events (e.g., holidays) affect mortality rates using confidence intervals.

• Quality Control: Estimating mean and variance of product measurements.

Additional info:

• Simulations using software (e.g., StatCrunch) are shown to illustrate confidence interval coverage.

• Examples include calculation steps and interpretation of results.

• Visualizations (not included here) help understand the distribution of intervals and their coverage.