Question 1

Which of the following best describes the purpose of the least squares regression method in simple linear regression?

Accepted Answer

To minimize the sum of the squared residuals between observed and predicted values.

Question 2

Given the simple linear regression model $$y = \$$beta_0$$ + \$$beta_1$$ x + \epsilon$$, what does $$\$$beta_1$$ represent?

Accepted Answer

The average change in $$y$$ for a one-unit increase in $$x.$$

Question 3

Which formula correctly calculates the estimated slope $$\hat{\beta}_1 in $$simple linear regression?

Accepted Answer

$$\hat{\beta}_1 = \frac{\sum (x_i - \bar{x})(y_i - \bar{y})}{\sum (x_i - \bar{x})^2$}$$

Question 4

In the context of regression, what does the $$R^2$$ statistic represent?

Accepted Answer

The proportion of variance in $$y$$ explained by the model.

Question 5

Which of the following is an assumption of the simple linear regression model?

Accepted Answer

The variance of the residuals is constant for all values of $$x.$$

Question 6

Suppose you fit a simple linear regression model to predict blood pressure from age. If the residual plot shows a clear pattern, what does this indicate?

Accepted Answer

The model assumptions are likely violated.

Question 7

In multiple regression, what does the coefficient $$\$$beta_2$$ in the model y$$ = \$$beta_0$$ + \$$beta_1$$ $$x_1$$ + \$$beta_2$$ $$x_2$$ + \epsilon$$ represent?

Accepted Answer

The effect of $$x_2 on$$ $$y$$, holding $$x_1$$ constant.

Question 8

Which of the following is NOT an assumption of the multiple regression model?

Accepted Answer

The predictor variables are uncorrelated with each other.

Question 9

A researcher wants to test if a particular predictor in a multiple regression model is significant. Which hypothesis test should they use?

Accepted Answer

A $$t-$$test for the individual regression coefficient.

Question 10

Which formula gives the predicted value $$\hat{y} in a $$multiple regression model with two predictors?

Accepted Answer

$$\hat{y} = \hat{\beta}_0 + \hat{\beta}_1 x_1$ + \hat{\beta}_2 x_2$

Question 11

If the $$R^2$$ value for a regression model is 0.85, what does this mean?

Accepted Answer

85% of the variance in $$y is $$explained by the model.

Question 12

Which of the following is a reason to use quadratic regression instead of simple linear regression?

Accepted Answer

The relationship between $$x$$ and $$y is $$not linear.

Question 13

In the context of regression, what is the purpose of an ANOVA F-test?

Accepted Answer

To test whether at least one predictor variable is significantly related to the response variable.

Question 14

Which of the following best describes the residual in a regression model?

Accepted Answer

The difference between the observed value and the predicted value.

Question 15

A hospital uses multiple regression to predict patient recovery time based on age, treatment type, and severity of illness. If the coefficient for severity is positive and significant, what does this imply?

Accepted Answer

Higher severity is associated with longer recovery times, controlling for age and treatment type.

Question 16

Which of the following is the correct formula for the residual sum of squares (RSS) in regression?

Accepted Answer

$$RSS = \sum (y_i - \hat{y}_i)^2$

Question 17

Which of the following statements about the interpretation of regression coefficients is correct?

Accepted Answer

In multiple regression, each coefficient represents the effect of its variable holding all other variables constant.

Question 18

Which of the following is a potential consequence of violating the assumption of constant variance (homoscedasticity) in regression?

Accepted Answer

The standard errors of the coefficients may be incorrect, leading to invalid hypothesis tests.

Study Notes: Simple Linear Regression, Inference, and Multiple Regression

Study Guide - Practice Questions

Study Guide - Flashcards