4.1

Question 1

Gold Standard

Answer 1

Experimental research, often considered to be the ‘gold standard’ in research designs, is one of the most rigorous of all research designs

• Experiments are praised for their ability to isolate causal effects of X on Y and go beyond correlation
• Yet, it is not always possible to run experiments in the lab or in the field

Question 2

What is a Quasi-Experiment in the Field?

Answer 2

When a “treatment” happens (quasi-randomly) in the field

Question 3

Difference in Difference (DiD) Strategy

Answer 3

Essentially a within-group or subject comparison

Question 4

Difference in Difference (DiD) Strategy

The control group basically tells us…

Answer 4

what would have happened to the treatment group, had the treatment group not gotten the treatment

Question 5

Three essential assumptions to identify a causal treatment effect

Answer 5

1. Common Trend Assumption (CTA)
2. Stable Unit Treatment Value Assumption (SUTVA)
3. Conditional Independence Assumption (CIA)

Question 6

1. Common Trend Assumption (CTA)

Answer 6

It looks like there is a treatment effect after the intervention

But, if the two groups do NOT move in parallel before the treatment, the effect you measure after the intervention could be by coincidence.

When both groups, however, move in parallel before the intervention, there is reason to believe that is was actually the intervention that had a causal effect

Question 7

Stable Unit Treatment Value Assumption (SUTVA)

Answer 7

1. The treatment status of any unit does not affect the potential outcomes of the other units (non-interference)
2. The treatments for all units are comparable (no variation in treatment)

1. Non-interference
2. No variation in treatment

Question 8

Conditional Independence Assumption (CIA)

Answer 8

After controlling for differences in X, participation in the treatment program does not depend on potential (or latent) outcomes Y.

Question 9

𝛽 3 identifies the DiD effect

Answer 9

The average treatment effect on the treated (ATT)

(C-A)-(D-B) Difference in changes over time

Question 10

The best way to test the common trend assumption is by…

Answer 10

having data for many time periods before and after the intervention. Then you basically implement many interactions of the treatment variable with the time dummies.

Question 11

What about staggered introduction?

Answer 11

• In the scenario with one treatment that happens everywhere at the same time, one unobserved other factor that happens at the same time can be a threat to the identification of the causal effect
• DiD models can also be used, when you have a treatment that is introduced at different locations at different times
• This has the great advantage that biasing factors need to be correlated over time AND location to make your identification invalid

Question 12

Fixed effects can be to answers if you are…

Answer 12

concerned that your panels differ with regards to variables that you cannot observe (culture, mentality, etc)

Question 13

Fixed effects

Answer 13

• This is basically a dummy variable for every panel. Can be easily implemented in R using plm() or lfe() (instead of using lm())
• You can have multiple fixed effects in the same model (e.g. country-, city-, year- fixed effects)

Question 14

What fixed effects effectively does

Answer 14

• Fixed effects averages the slopes of all the panels. In this way, it only (not meant in a negative way) leverages variation in Y within the panels
• That is why they are also called within models

Question 15

We can use DiD strategy to…

Answer 15

analyze quasi-experimental data in the field

Question 16

DiD: The credibility of the results always depend on…

Answer 16

whether the crucial assumptions hold. Every study deploying a DiD analysis should present a compelling evidence and reasoning for this.