Logistic Regression, and an Introduction to Hierarchical Analysis Flashcards
Simplest Linear Model
Just a constant term
Returns the mean of our data
Postive mean = positive change
Beta divided by standard error
One Continuous Regressor
Add one more term returning the intercept and slope of our graph
Explains variation in the score
Beta value divided by standard error - significance difference?
Multiple Continuous Regressors
Add more terms
Returns the slope controlling for the effect of other regressors
Multiple Categories
Add a ‘dummy variable’ for each additional category
Returns the mean for the reference category, and difference from this reference for each other category
Multiple Independent Variables
Add extra sets of ‘dummy variables’ for each additional discrete factor, plus their interaction terms
Logistic Regression
p(y=right) = 1/1+exp(=B0 + B1 x coherence))
Probability to Odds
Odds = p/1-p
Log Odds
Log odds of a binary outcome can be modelled with a straight line
Logarithm of odds
Continuous function
Log odds = log(p/1-p)
2 Ways of Expressing the Same Idea
B1 = impact of coherence
B0 = intercept term
Biases choices
Summary
When the outcome variable is binary, rather than continuous we use logistic regression to predict outcomes
Equivalent to a linear model predicting the log odds of the probability of the outcome
Log odds = link function
Generalises linear models to predict outcomes that are binary in nature
Aggregate Information across Participants
Estimate models ‘hierarchically’
Advantages - interpretability, can apply to any ‘summary statistic’ from each participat, computational simplicity
Disadvantages - requires many observations at ‘first level’ (each participant), assumes each subject is equally reliable, doesn’t explicitly account for ‘correlated observations within participants
Conclusion
Repeat experiment across many different individuals
Aggregate information across individuals by performing a ‘hierarchical’ analysis - estimate a GLM for each subject at first model, and then take the parameters of this model to the 2nd level performing inference across the population
Straightforward and usually valid
Some limitations dealt with by a more sophisticated method of aggregating information across participants, mixed effects model