1. Simple Linear Regression Model Flashcards

1
Q

What can stats methods be used for?

A
  • testing economic theories
  • estimating the magnitude of relationships
  • forecasting
  • policy evaluation
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

7 steps for econometric

A
  1. Formulate the question
  2. Develop economic model
  3. Specify the model
  4. Set out hypotheses
  5. Estimate the economic model
  6. Conduct hypothesis test
  7. Interpret results and draw conclusions
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Types of data

A
  • cross sectional data
  • time series data
  • pooled cross sectional data
  • panel (longitudinal) data
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What does the simple linear regression model look like?

A

y= B0+ B1x+ u

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What does u represent?

A

Factors other than x which aftect y

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Assumptions about u in simple linear regression model

A
  1. On average the disturbance term is zero. E(u)=0. For any single observation it will be positive or negative
  2. The disturbances are unrelated to the explanatory variable E(u|x)=E(u)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Why is the zero conditional mean assumption important?

A

If E(u|x) =0 then E(y|x)=B0+ B1x

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is the conditional mean assumption?

A

That E(u|x)=0

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Population regression function

A

A linear function of x where a one unit increase in x changes y by P. For any value of x, the distribution of y is centred about E(y|x)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What does PRF tell us?

A

How the expected value of y changes with x

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What doesn’t the PRF tell us?

A

y=B0 + B1x for every observation. y is not always equal to E(y|x)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

OLS

A

Ordinary Least Squares

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

OLS advantages

A

Works well

Simple

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What does OLS do?

A

Finds values of B0 and B1 that minimise the sun of the squared vertical distances between the points and the line

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is another name for the OLS regression line?

A

SRF

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

How does the SRF relate to the PRF?

A

The SRF is an estimate of the PRF

17
Q

Properties of OLS estimators

A
  • unbiased

* efficient

18
Q

What are the two parts of the estimator of B1?

A
  • a non random (deterministic) part that captures the true underlying relationship
  • a random (stochastic) part responsible for variations around the population parameter
19
Q

What is the sampling distribution of the estimator of B1?

A

If the estimator of B1 is unbiased then it is normally distributed around B1 as the expected value

20
Q

Assumptions for unbiasedness of OLS parameters

A
  1. Linear in parameters
  2. Random sampling
  3. Sample variation in explanatory variable
  4. Zero conditional mean
21
Q

What happens to the estimate of B1 if there is a positive covariance of x and u?

A

The expected value of the estimate of B1 is greater than B1 so the estimate is biased upwards

22
Q

How realistic is the assumption of linear in parameters?

A
  • It is a good first approximation.

- Non linear relationships are quite common but they can be accommodated for

23
Q

How realistic is the assumption of random sampling?

A
  • It isn’t always valid
  • important to understand how data was generated
  • we will assume random sampling
24
Q

How realistic is the assumption of sample variation in explanatory variable?

A
  • Almost always valid

- It is possible x won’t vary much, this will affect the accuracy of our estimates

25
Q

How realistic is the zero conditional mean assumption?

A

-It often isn’t valid usually because factors affecting y and correlated with x have been omitted from the model

26
Q

What does OLS estimators being efficient mean?

A

They are the best linear unbiased estimators, they have the smallest dispersion and the minimum variance

27
Q

Homoskedasticity

A

The assumption that the error U has the same variance given any value of the explanatory variable Var(u|x)= ó^2

28
Q

Heteroskedastic

A

When the var(u|x) varies as x varies so it isn’t equal to a constant

29
Q

How realistic is the assumption of homoskedasticity?

A

Not very realistic. Typically the greater x, the greater the variance

30
Q

What factors determine our estimate of the variance of B1

A
  • As n (sample size) increases, variance decreases
  • if the variance of u increases then so will the variance of our estimate of B1
  • more variation in x will decrease the variance
31
Q

What are the standard errors?

A

They are the standard deviation of our estimates of B0 and B1

32
Q

Properties of standard errors

A
  • unbiased

* random variables that take a different value for each sample of data

33
Q

Standard error of the regression (root mean square)

A

The standard deviation of u. This is a measure of the accuracy of the measure as a whole

34
Q

How do OLS estimators minimise the standard error of the regression?

A

OLS estimators minimise the sum of the squared residuals. This makes up part of the standard error of the regression so if this is minimised so will the standard error of the regression