Methods Flashcards

1
Q

Clinical studies: Def & Types

A
A detailed story, often involving a combination of qualitative data, anecdotal evidence, and sometimes quantitative data, about a specific situation or phenomenon
Types:
- Teaching case
- In-depth clinical papers
- Empirical large-sample papers
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Clinical Studies: Purpose

A
  • To tell theorist what to model
  • To guide on how to model these things
  • To asses possibility theorems
  • To provide evidence of a certain type for testing theory
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Areas for Conern

A

Representativeness, Bias, Replicability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is insider econometrics?

A

Insider econometrics is an empirical research strategy for investigating these questions about the effects of management practices on productivity and the determinants of the choice of management practices

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is insider econometrics? (Questions)

A
1.Why do firms in the same industry adopt
different management practices?
2.Does the adoption of a new
management practice raise productivity?
3.If so, why does the new management
practice raise productivity?
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Insider econometrics (Broken Down Defintion)

A

Insider refers to the use of micro-level data on workers or workgroups inside firms that share a common production function. Also refers to the use of insights from insiders (from managers or employees ) that inform what’s happening inside the firm to contribute to the research

Econometrics refers to the use of statistical tests. (Average treatments effects, treatment of the treated effect, treatment of the non-treated effect, etc)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

How to do an Insider Econometrics Research? (1/2)

A

1) Estimate a productivity regression in which
productivity is a function of some management practice.
2) Identify why management practices raise
productivity and where the practice has
larger and smaller effects on productivity.
3) Model the adoption of the management practices.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

How to do an Insider Econometrics Research? (2/2)

A

4) Analyze micro-level data on production units

5) Formulate testable hypotheses and interpret results.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Treatment Effects and the Econometrics of Insider
Studies : Two common options
1) First Differences

A

Estimates the treatment of the treated using data on only the treated group, before and after the treatment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Treatment Effects and the Econometrics of Insider
Studies : Two common options
2) Difference-in-Differences Estimator:

A

Estimates the average gain in productivity if the treatment were applied randomly across all i, using data on both the treated group, before and after the treatment, and on the non-treated group

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Analytical Challenges of Insider Econometric Research

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q
Key Research Design Decisions for Insider
Econometric Studies (1-3)
A

1) Identify a Treatment and Measure It Accurately
2) Test a Generalizable Principle by Modeling Economic Behavior
3) Balance Homogeneity and Heterogeneity in the Sample

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q
Key Research Design Decisions for Insider
Econometric Studies (4-5)
A

4) Collect Information on Why the Treatment Was Adopted

5) Collect information on how behavior changes and why the treatment was successful

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What do Experimental Economics do?

A

Ask human subjects respond to incentives in a controlled laboratory environment which represents the essential economic features of a theoretical or naturally

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

When Experimental Economics can be useful?

A
  1. To test theory (Under precisely controlled and/or measured conditions that are typically unavailable in field data.)
  2. To evaluate assumptions
    Other: To identify stylized facts / To compare institutional designs / To explain newly observed regularities
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Experimental Economics: A Time-Line

A

1) Formulate a research question
2) Address the research question
3) Prepare an experimental outline
4) Seek funding
5) Ethical approval

17
Q

Details: Prior the experiment

A
  • Write instructions for each treatment and an overall “script”
  • Prepare a questionnaire (useful for controls). If computerized, make sure the software is capable
  • Organize money(when/how to pay)
  • Recruit for pilot
  • Run pilot experiment
18
Q

Details: During the experiment

A
  • Improve the design/instructions based on the pilot experience
  • Recruit subjects
  • Run the experiment
  • Analyze data and write the paper
19
Q

Experimental Economics: Other practical matters

A
  1. Make sure you limit the things that can react with your treatment
  2. Eliminate distractions and enable privacy
  3. Deception is not allowed
  4. Preserve anonymity
20
Q

Experimental Economics: Preserving Anonymity

A

Single blind: no one other than the researchers will be able to ever identify subjects’ actions or subjects’ payoffs.
Double blind: no one can link subjects’ decisions to their identity even the researchers
Abandoning anonymity: if abandoning anonymity is important for the experiment, then subjects should know and have the option to withdraw if they want

21
Q

Field vs Laboratory

A

Field:

  • More external validity built-in
  • The subject pool is spot-on
  • Test if a change have a sizeable effect
  • More bias

Laboratory:

  • More control over the incentives
  • Easier to get strict instructions regarding time and effort
  • More transparency and more replicable
  • Easier to overcome ethical issues
  • More expensive to obtain large samples
22
Q

What makes an experiment organizational?

A

In an organizational experiment, two or more subjects engage in a productive enterprise where the impact of the structure of the organization and incentives on productivity are the variables of central interest.

23
Q

What makes an organizational experiment good?

A

1) Control over all relevant factors in the experimental environment
2) Internal validity
3) Statistical integrity
4) Generalizability

24
Q

Four areas of interest to organizational studies

A

1) Incentives and Worker Effort
2) Coordination
3) Voluntary Effort and Reciprocity
4) Leadership and Hierarchy

25
Q

Organizational experiments: Voluntary effort and reciprocity in organizations

A
  • Results are heterogeneous. Do not directly refute or confirm the theory.
  • In some cases, are highly supportive and encouraging, while in others not.
  • For example, leadership over larges firms does not guarantee achieving an efficient equilibrium.
26
Q

What is a RCT ?

A

An experiment designed to isolate the influence that a certain intervention or variable has on an outcome or event

27
Q

Questions RCT

A
  1. How would individuals who participated in a program behave in the absence of the program?
  2. How would those who were not exposed to the program have behave in the presence of the program?
    - > No answer to these questions
28
Q

Impact of the program or pre-existing differences

A

Treatment individuals may have had different outcomes on average even if they had not been treated

29
Q

Sample size, design, and the power of experiments

A

Power of the design: probability of reject the null hypothesis when in fact is false

30
Q

Should one randomize over individuals or some larger group?

A

The choice of the level at which to randomize is very context specific, depends on the nature of the intervention as well as the nature of the interactions between the individuals to be treated.

  • Some factor could be taken into account:
    1) Spillovers from treatment to comparison groups can bias the estimation of treatment effects. In such case, the randomization should occur at a level that captures these effects
    2) Randomization at the group level may some times be much easier from the implementation point of view, even if it requires larger sample sizes
31
Q

What is the value of a baseline survey?

A

1) Generate control variables that will reduce the variability in final outcomes and therefore reduces sample size requirements, reducing costs
2) Make it possible to examine interactions between initial conditions and the impact of the program, to verify that the randomization was conducted apppropriately and to test and refine data collection procedures.

32
Q

Field Experiments with Firms: Motivation

A
  • Firms operate in complex environments
  • Some characteristics are hard to measure or uncertain
  • Implies huge challenges at uncovering casual relationships when understating the behavior of firms based on observational data
33
Q

How do they do?

A

Do firm choices maximize profits subject to constraints?
If so, which constraints bind and inform decision-making in firms? If not, why are firms operating inside the frontier?
- Experiments within firms
- Experiments between firms

34
Q

Field Experiments within Firms how can firms solve agency problems and motivate their employees?

A
  • Monitoring
  • Paying for performance
  • Increasing motivation through better social relations or status rewards
35
Q

Field Experiments within Firms how can firms solve agency problems and motivate their employees?

A
  • Monitoring and Shirking
    Employees decide their level of effort considering marginal costs and marginal benefits of shirking and firms choose compensation and monitoring policies.
36
Q

Field Experiments within Firms how can firms solve agency problems and motivate their employees?

A

Monetary Incentives and the Social Organization of the Workplace.
- Productivity is 50% higher under piece rates

37
Q

Field Experiments within Firms how can firms solve agency problems and motivate their employees?

A

Increasing motivation through better social relations or status rewards

38
Q

Field Experiments across Firms

A

Field experiments that take the firm as the unit of observation often seek to exogenously vary the availability of key inputs and in this way seek to uncover the constraints faced by firms

Identifying constraints faced by firms allows understanding the development process

39
Q

Conclusion field experiments

A

The design of fields experiments ought to be supported by economic theory and hypothesis must be testable

  • Selection of unit over the experimentଵ (static vs dynamic)
  • Methodology: the utility of difference-in-differences estimator.
  • Field experiments are a powerful tool of empirical studies. They allow a better understanding of how firms works and how agents react to incentives.