The Likelihood Ratio Test Flashcards

1
Q

What does the log-likelihood measure?

A

Lack of fit of a model to the data -> the worse the fit, the smaller the likelihood

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is the deviance?

A

A measure of lack of fit -> how poorly does the estimated model fit the data?

D= -2l+c (c is chosen such that D=0 for a saturated model)

We use it to compare two nested models

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is a saturated model?

A

As many parameters as we have observations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is a nested model?

A

A subset of another model (less parameters)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What does the likelihood ratio test do?

A

It estimates both models and retain DR and DU

LR = Dr-Du

if the restrictions are unteasonable, then DR>DU

Is the difference in the deviance sufficiently large to reject the restricted model in favor of the unrestricted?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What does the likelihood ratio test not care about?

A

Parsimony -> The goal of modeling is to sinplify things, improving fit means increasing model conplexity. So Is the loss in parsimony really worth the improvement in fit?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What measures combine fit and parsimony?

A

The Akaike Information Criterion

The Bayesian Information Criterion

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is the AIC?

A

AIC = -2l + 2P = D + 2P

looks at how many parameters we add to the model and if thats worth it

our objective is to minimize AIC by reducing the deviance (model fit) or increasing the parsimony (number of parameters)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is the BIC?

A

BIc = -2l + Pln n = D+ ln n

uses the natural logarithm of n instead of 2P

additional complexity is only worth it if the deviance is much smaller; it is more conservative and puts more weight into simplicity than the AIC

we are favorinh the model with the smallest BIC

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What are Akaike Weights?

A

A transformation of AIC so that the transformed values add to 1 across models. Can be interpreted as model probabilities in a particular set: What is the probability that model Mj is the correct model in the set?

-> converting to relative AIC by conparibg the AIC to the minimum AIC

How well did you know this?
1
Not at all
2
3
4
5
Perfectly