Weeks 7 & 8: Regression Flashcards

1
Q

What does the X variable do?

A

X - Independent variable explains the changes in Y (dependent variable), by falling back on statistical power and validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is X variable?

A

Independent variable - does not change

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is Y variable?

A

Dependent variable - what we are trying to measure, influenced by X.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What kind of model is Regression?

A

Causal model - prediction on target time series is linked to other time series. You can causally explain why the prediction may be adequate

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Advantages of Regression

A
  • Can create scenario & strategy based predictions
  • If assumptions satisfied & model correctly specified, OLS forecasts will be unbiased and efficient
  • Can identify the relationship between two or more variables
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Disadvantages of Regression

A

Requires more data, resources and theoretical knowledge

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What happens with the within-sample-data?

A

Unlike traditional models (e.g MA), the within-data is NOT redundant. It will be extrapolated to make future forecasts

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What are the OLS Assumptions?

A
  1. Correct functional form

CHECK RESIDUALS:
1. Zero mean
2. Constant variance
3. Independently derived
4. Randomly scattered

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is B0?

A

The intercept.

Estimated Yt when X = 0

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is B1?

A

The estimated constant increase in Yt when X increases by 1 unit.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is R2?

A

Coefficient of determination is a measure of how well the model fits the data

-The proportion of variation in Y is accounted for by the X values

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

How to calculate R2?

A

SSR/SST

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is a good R2?

A

Closest to 1, but rule of thumb = 70%

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is Standard Error used for?

A

Used to compare model performance

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

How to calculate Standard Error?

A

SQRT(MSE)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is Overall Model Significance?

A

F test (overall model fitness), shows if relationship between ALL X & Y variables exist

  • If F Significance <0.05 - it has explanatory model power
17
Q

How to test Individual Coefficients?

A

If the slope coefficient (B1) is 0, the X variable does not influence Y

  • It could be an irrelevant variable and can be removed through Stepwise Regression
18
Q

What is an Individual Variable Significance test?

A

T test - show if there’s a relationship between X and Y. If p-value below 0.05, variable has power to explain changes in y variable

19
Q

The larger the t stat… the….?

A

lower the p value