Multiple Regression Flashcards
Describe what multiple regression is and when it is used
Used when you want to predict the value of a variable based on the value of 2 or more variables.
Need at least 2 predictors.
MR informs you of the relationship between each predictor and the DV, after controlling for the effect of all other predictors in the model
What is the equation for multiple regression and does it differ from the simple regression equation?
y = a+b1x1 + b2x2
Only one intercept, but many slopes for the number of predictors
X = Predictor variable
What are the different forms of multiple regression?
Standard multiple regression - Predictors are entered simultaneously
Hierarchical multiple regression - Predictors are entered in steps.
When conducting multiple regression, which part of the SPSS output do you look at to find out about the goodness-of-fit of the overall model?
ANOVA table
Same as simple regression
When carrying out multiple regression, which SPSS output do you refer to to estimate the overall effects of the predictor on the outcome
Model summary. Shows you the relationship between the predictor variables and the DV
In a model summary table, what does R refer to?
Multiple correlation coefficient
Refers to the correlation between the observed values of Y and the values of y predicted by the multiple regression model.
Large values represent a large correlation between the predicted and observed values of the outcome.
R of 1 = model perfectly predicts the observed data
In the model summary table, what does R square refer to?
Proportion of variance in Y that is explained by the model.
All predictors together.
In the model summary table, what does Adjusted R Square refer to?
Adjustment. Reduced value for R squared attempting to make an estimate of the value of R squared in the population.
Adjusted down to compensate for increase in R square.
Which type of information about effects does the coefficients table provide in a multiple regression?
The unique effects of the predictor (excluding effects shared with other predictors) on the outcome.
In a multiple regression coefficients table, what does B refer to?
Value of the slope for each predictor
Non-standardised.
Two values (1 for each predictor) which are both measured using different values which is why beta is used to standardise them.
In a multiple regression coefficients table, what does std.error refer to?
The standard deviation of the distribution of sample b-values for each predictor
In a multiple regression coefficients table, what does Beta refer to?
Standardised regression coefficients.
This tells us the number of standard deviations that the outcome will change as a result of one standard deviation change in the predictor.
Differs from simple regression as it concerns the unique contribution of the predictor, excluding any overlap with other predictors.
When is a hierarchical multiple regression used?
If you already know the effects of one variable and want to look at another as believe have not been accounted for.
Explain the steps of a hierarchical multiple regression
- Assess a model (model 1) including only one variable as predictor and other as outcome.
- Assess model 2 including both variables and an outcome to see if it explains more variance than the first model.
Enter the predictors in steps with the known predictor added first.
In a hierarchical multiple regression, what does the ANOVA table tell you?
Explain the goodness-of-fit of the regression model.
Each model is tested.