Lecture 7 Flashcards
Multiple regression analysis:
> why is R² smaller than the sum of R² of all predictors?
predictors are mutually correlated
> mutual correlation high = colinearity
2 criteria to find “best” regression model
best regression model
- only has predictors that contribute significantly to the model
- the highest R² of all models that meet criterion 1
how to find the best regression model
> what does not work? why?
> what are alternatives?
> what is the general problem?
how to find best regression model
> adding predictors until no variance is added, does not work
>>> predictors can suppress errors of other predictors, work as a team
> you could test all models and choose the best, but a lot of work
> shortcut techniques (forward selection, backwards elimination, stepwise procedure)
> general problem: the best model in the sample is not necessarily the best model in the population
why is the best model in the sample not necessarily the best model in the population?
because of chance capitalization on idiosyncrasies in the data set
what is hierachical multiple regression?
advantages?
disadvantages?
hierarchical multiple regression - technique to find a model that fits the data but also theory
> step wise entry of predictors on the basis of an a priori theory
advantages:
- no chance capitalization due to idiosyncrasies in data
- fit mode provides evidence for quality of the theory
disadvantage:
- model is perhaps not the best for the dataset at hand
how to implement categorical predictor into MRA?
how to implement interaction term?
use of dummy variable
> 1 / 0 plus regression coefficient
interaction term (with dummy):
> S x A interaction: product of dummy variable and predictor variable created interaction term
ANCOVA
> what is a covariate?
Covariate: variable that is not controlled (or cannot be controlled) but is measured
what is the key characteristic of a quasi experimental study?
> problems?
quasi experimental design:
> independent variable is not manipulated, but its levels are selected (for example clinical vs control group)
problem:
> the groups may differ
quasi experimental design:
> what are ways to increase validity?
quasi experimental design:
- add a real independent variable to the design
- match groups on potentially confounding variable
- measure potentially confounding variables
> use as covariate