Econometrics - OLS Flashcards

1
Q

What is the general equation for an ordinary least squares (OLS)?

A

Yi = b0 + b1Xi + ui

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is the total sum of squares equal to?

A

explain sum or squares + residual sum of squares (ui)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is the interpretation of the slope coefficient in OLS?

A

When all X variables are 0, Y will be the value of the slope coefficient

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is the interpretation of OLS when Y and X are in levels?

A

A one unit increase in X will lead to a b unit increase in Y

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What are the 5 classical assumptions?

A
  1. Error has a zero conditional mean (implies no relationship between error and explanatory variables)
  2. Linear in the parameters (b1 can’t be a power of X)
  3. Error term has constant variance (homoskedasticity)
  4. Error terms cannot be correlated (serial correlation if correlation of errors is not zero)
  5. Independence of X and u for all periods
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What are 3 practical assumptions?

A
  1. number of observations should be larger than the number of regressors/degrees of freedom
  2. X must take different values
  3. Normality of random error
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is the additional OLS assumption needed for time series data?

A

Strict exogeneity - the error term is uncorrelated with each explanatory variable in every time period, so that unbiased estimates are yieled

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is the Gauss Markov Theorem?

A

OLS is BLUE - Best Linear Unbiased Estimator

Best = minimum variance
Linear = can be proven mathematically that OLS yields results that are linear estimates
Unbiased = expected value of the estimated value would be equal to the true underlying value

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is the problem with the Gauss Markov Theorem?

A

Often faced with failing of 3 BLUE assumptions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What other property is relied on when Gauss Markov is violated?

A

Consistency - if you have a large sample and the variance of the estimator becomes smaller AND the value of the estimator approaches the parameter value, then the estimator is consistent

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

How is the t-stat for an coefficient estimate calculated?

A

estimate of coefficient / standard error of estimate of coefficient (*assuming a t-distribution with n-2 degrees of freedom)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

When can you reject the null hypothesis using 5% sig level?

A

if p-value < 0.05 then reject null

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What does R-squared show? How can you interpret its value?

A

Goodness of fit, if R-squared is large then best fit line “fits” sample data closely.
R-squared can be interpreted as % of variation explained by model e.g. 0.6 = 60% explained

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

How is R-squared calculated?

A

Explained sum of squares / total sum of squares

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is adjusted R-squared?

A

Takes into account number of observations and number of explanatory variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is the formula for the adjusted R-squared?

A

1-(1-R-squared)*((n-1)/(n-p-1))

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

How do you interpret a multiple linear regression (multiple OLS)

A

If X1 changes by 1 unit, then Y will change by b2 units holding all other X fixed

18
Q

What is the general F-test reported by software?

A

Test on overall significance of all explanatory variables in regression

19
Q

What test does a restricted/unrestricted model to test for whether additional variables have explanatory power use?

A

F-test

20
Q

How do you calculate the F-stat?

A

F-stat = [(RSSr - RSSUu)d] / [RSSu / (n-k) ]
where r = restricted and u = unrestricted

21
Q

What is multicollinearity?

A

High linear relationships between explanatory variables, movements in one X are closely matched by moves in other X

22
Q

What are the problems with multicollinearity?

A

Isn’t possible to estimate effectively the separate effects of X variables, as standard errors become large.
Variances will be large, as will confidence intervals and have statistical insignificance

23
Q

What is the difference between perfect and imperfect multicollinearity?

A

Perfect is where 2 Xs are exactly linearly related, it is v rare and usually due to a dataset compilation error. Imperfect is where Xs are linearly related to a high degree but not an exact relationship

24
Q

What are the 2 ways you can detect multicollinearity?

A

Partial (pairwise) correlation coefficients OR variance inflation factors (VIFs)

25
Q

What are the solutions to multicollinearity?

A

More/better data
Re-specify model (add/drop variables)

26
Q

What is the Chow test used for?

A

To test whether the coefficients of a model remain constant over the sample, whether there is a structural break

27
Q

What is the null and alternate hypothesis of the Chow test?

A

h0: coefficients are constant across sample
h1: at least one coefficient changes

28
Q

How is the test statistic for the the Chow test calculated?

A

CHOW = [(RSSr - RSS1 - RSS2)/K]/[(RSS1+RSS2)/(n-2k)
where r=whole sample, 1=period 1 subsample, 2 = period 2 subsample

29
Q

How do you interpret coefficients in a log-log OLS?

A

A 1% change in X is associated with a b% change in Y

30
Q

How do you interpret coefficients in a log-linear OLS?

A

A 1 unit increase in X is associated with an change of 100b% in Y

31
Q

How do you interpret coefficients in a linear-log OLS?

A

A 1% change in X results in a b/100 units change in Y

32
Q

How do you calculate the elasticity in a linear OLS?

A

b * (x/y)

33
Q

How do you calculate elasticity in a log-log OLS?

A

b

34
Q

How do you calculate elasticity in a log-linear OLS?

A

bx

35
Q

How to calculate elasticity in a linear-log OLS?

A

b*(1/y)

36
Q

What does the RESET test for? How does it work?

A

Functional form misspecification. Takes the squared fitted values and adds them back into regression and tests for significance of additional variables. Null hypothesis is that the coefficient on additional squared terms = 0 (no misspecification)

37
Q

What test underpins the RESET test?

A

F-test

38
Q

What does the Davidson-Mackinnon Test check?

A

Used to decide whether to use an X variable in levels or logs

39
Q

What is the critical value for a 1-tailed t-test at 5% sig?

A

2.015

40
Q

What is the critical value for a 2-tailed t-test as degrees of freedom exceeds 100 at 5% sig?

A

1.96

41
Q

When do you reject the null that the coefficient = 0 (test for significance?
i.e. null = b is not significant

A

When the t-stat is greater than the critical value of 1.96