Which of the following best defines a residual in linear regression?

The average of all observed y-values.

The slope of the regression line.

The horizontal distance between two data points.

The vertical distance between an observed data point and the predicted value from the regression line.