Analysis of Variance (ANOVA) in Applied Statistics for Health Sciences

Analysis of Variance (ANOVA)

Introduction to ANOVA

Analysis of Variance (ANOVA) is a statistical method used to determine whether there are significant differences between the means of three or more groups. It is widely applied in health sciences to compare outcomes across different populations or treatment conditions.

• Definition: ANOVA tests the null hypothesis that all group means are equal against the alternative that at least one group mean is different.

• Purpose: To analyze the impact of categorical independent variables on a continuous dependent variable.

• Application: Commonly used in clinical trials, epidemiological studies, and psychological research.

Key Concepts in ANOVA

• Between-group variance: Measures variation due to differences between group means.

• Within-group variance: Measures variation within each group.

• F-ratio: The test statistic in ANOVA, calculated as the ratio of between-group variance to within-group variance.

The formula for the F-ratio is:

$F = \frac{\text{Mean Square Between Groups}}{\text{Mean Square Within Groups}}$

Types of ANOVA

• One-way ANOVA: Used when there is only one independent variable (factor) with two or more levels.

• Two-way ANOVA: Used when there are two independent variables, allowing for the analysis of interaction effects.

Assumptions of ANOVA

• The data are normally distributed within each group.

• The sample variances must be equal (homogeneity of variance).

• The data are independent.

Interpreting ANOVA Results

• If the p-value for the F statistic is less than the significance level (commonly 0.05), we reject the null hypothesis and conclude that at least one group mean is significantly different.

• If the p-value is greater than 0.05, we fail to reject the null hypothesis and conclude that there is no significant difference among group means.

Example: ANOVA in SPSS

Researchers may examine whether the level of anxiety differs between three groups: patients with inflammatory bowel disease (IBD), irritable bowel syndrome (IBS), and healthy controls.

• Independent variable: Group (IBD, IBS, control)

• Dependent variable: Anxiety score (continuous)

Steps to verify the results of an ANOVA in SPSS output:

1. Check the Levene's test for homogeneity of variances. If p > 0.05, variances are equal.

2. Review the F statistic and its p-value in the ANOVA table.

3. If significant, examine post-hoc pairwise comparisons to identify which groups differ.

4. Report the effect size (η²):

$\eta^2 = \frac{\text{Sum of Squares Between Groups}}{\text{Total Sum of Squares}}$

• Guidelines: η² < 0.01 (small effect), 0.01–0.06 (medium effect), > 0.14 (large effect).

Sample ANOVA Table (SPSS Output)

The following table summarizes the main components of an ANOVA output:

Source	Sum of Squares	df	Mean Square	F	p-value
Between Groups	SSB	k-1	MSB	F	p
Within Groups	SSW	N-k	MSW	-	-
Total	SST	N-1	-	-	-

Additional info: SSB = Sum of Squares Between Groups, SSW = Sum of Squares Within Groups, SST = Total Sum of Squares, k = number of groups, N = total sample size.

Interpretation Example

• An ANOVA showed that age, educational level, and group membership were significant sources of variance in anxiety scores.

• Post-hoc comparisons indicated that patients with IBD scored higher on anxiety than healthy controls.

Exercises

Practice Exercise: Comparing Anxiety Scores

Given the following data for three groups (IBD, IBS, control), use ANOVA to determine if there are significant differences in anxiety scores:

Group	Mean Anxiety Score	Standard Deviation	Sample Size
IBD	15.2	3.1	30
IBS	13.8	2.9	28
Control	10.5	2.5	32

• State the null and alternative hypotheses.

• Calculate the F statistic.

• Interpret the p-value.

• Conduct post-hoc tests if the result is significant.

Additional info: These exercises reinforce the application of ANOVA in health sciences and the interpretation of statistical output.