Lecture 1 - Intro Flashcards
What is a simple linear regression?
Regresses the dependent variable on 1 indepdent variable and assumes their relationship bewteen the dependent and independent are linear
Example of a linear regression:
- y = return variable
- x = defalted earnings change
- we estimate a and b by finding the line of best fit / a(hat) and b(hat) is determined by OLS in a way that minimises the trend lines and sample observations
What is the Ordinary Least Square?
Used to estimate intercept and slope coefficient - drawing a random sample of observations from an underlying population
In a simple regression, observations are y and x value
What is a multiple linear regression?
Regresses dependent variable on several independent variables and assumes the relationship between the dependent variable and independent variable is linear
Example of multiple linear regression:
What does R^2 measure?
The degree to which variations in the independent variables explains variation in the dependent variable
Values lie between 0 (no explanatory power) and 1 (perfectly explanatory)
The larger the estimated error terms (residuals - e(hat)) the smaller the R^2
What is a t-test?
A statistic used to determine if there is a significant difference between the means of two groups and how they’re related
What is the usual question answered by a t-test?
How likely is it to obtain the value a(hat) or b(hat) if the true value of the slope coefficient/interecept is 0?
If the probability is less than a certain value (5%) then one concludes the true population vaue is different from 0
What is the measurement error in dependent variables?
Measurement error in the dependent variable results in lower explanatory power for R^2
What is the measurement erorr in independent variables?
Measurement error in independent variables reduces the explanatory power and leads to an estimate of the slope coefficient that is downward biased (too low relative to value)
What is a dummy variable?
0 or 1 - indicates the absence or presence of some categorical effect that may be expected to shift the outcome