Part 3 Flashcards
Assumptions Classical linear regression model (3)
Residual is on average 0, linearly independent and normal
Consequences of ignoring autocorrelation
Regular standard error estimates inappropriate, typically too
small.
R^2
is likely to be inflated relative to its “correct” value for
positively correlated residuals.
Causes of autocorrelation. (2)
Omission of relevant variables, which are themselves
autocorrelated.
Model is misspecified by using an inappropriate functional
form.
Issue with Multicollinearity and give solution
Explanatory variables are very highly correlated with
each other. Drop one of the collinear variables
measurement error
measurement error in one or more of the explanatory variables
will violate the assumption that the explanatory variables are
non-stochastic
1 ways measurement errors occur
Macroeconomic variables are almost always estimated
quantities (GDP, inflation, and so on), as is most information
contained in company accounts
– Sometimes we cannot observe or obtain data on a variable we
require and so we need to use a proxy variable - e.g. expected inflation
Parameter stability meaning
Parameter stability is the idea that coefficients in models (and
therefore the relationships between variables) must remain stable
over time
Why is it desirable to remove insignificant variables from a
regression?
Insignificant variables refer to variables in a statistical model that do not show a statistically significant relationship with the variable you are trying to predict or understand. This means the evidence is not strong enough to conclude that their effect is different from zero.
Leaving them in the regression uses up degrees of freedom
Solutions for the presence of autocorrelation in the residuals
includes
- Use HAC robust standard errors, such as Newey-West.
- Use a dynamic model to account for the autoregressive
tendencies in the data.
Normal distribution properties (3)
A normal distribution has zero skew and
▶ a kurtosis of 3;
▶ Skewness and kurtosis are the (standardised) third and fourth
moments of a distribution.
what do outliers have an
effect on?
: Outliers tend have a large effect on the OLS
estimate
solutions for outliers (3)
Remove outliers (need good reason!)
▶ Use of dummies
▶ Robust regression