Lecture 3 - Part I And II Flashcards

1
Q

What is the null hypothesis?

A

A statement of no relationship among the variables being tested

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is the research / Alternative Hypothesis?

A

The predicted relationship between the variables being tested

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is research validity?

A

Truthfulness of a causal inference that is made from the results of a research study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is internal validity?

A

Degree of confidence that the causal relationship being tested is trustworthy and not influenced by other factors or variables within the context of the present study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is external validity?

A

The extent to which results from a study can be generalized to other
1. People
2. Settings
3. Treatments
4. Outcomes
5. Times

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What are the 5 types of external validities?

A
  1. Population validity
  2. Ecological validity
  3. Treatment population validity
  4. Outcome validity
  5. Temporal validity
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What are the 3 conditions for making the claim of causation?

A
  1. A must be correlated with B
  2. Changes in A must precede changes in B
  3. No plausible alternative explanation exists for the relationship between A and B
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

In the ABCD framework, what does each letter represent?

A

A: Independent Variable
B: Dependent Variable
C: Mechanism for how A affects B
D: Alternative Explanation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is an observational study?

A

Researchers collect data by observing and making inferences based on that data. No interference from researchers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is an experimental study?

A

A study where researchers control the assignment of treatments to subjects using a chance mechanism

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What are the benefits of the experimental approach?

A
  1. Causal inferences can be drawn from the data collected
  2. Experimental approach grants researchers greater control over the other variables
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What are the cons of the experimental approach?

A
  1. Does not test the effect of non-manipulated variables
  2. There may be ethical or practical problems with variable control
  3. The environment does not allow for generalization to real-life situations
  4. Cost
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Why can’t lab findings be generalized to real life situations?

A
  1. Subjects know they are observed by researchers
  2. Subjects are placed in an unfamiliar situation and asked to make unfamiliar decisions
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is a laboratory experiment?

A

A controlled scientific investigation in a laboratory environment, often situated in a university computer lab or classroom often with college students participating.

Participants typically make decisions within an artificial context.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is a field experiment?

A

Research using some controlled elements of traditional laboratory experiments, but takes place in natural/real world settings

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is an artefactual field experiment?

A

Same as conventional lab experiments but with a non-standard subject pool

17
Q

What is a framed field experiment?

A

Similar to artefactual field experiments but with field context in either the commodity, task or information that the subjects use.

18
Q

What is a natural field experiment?

A

Same as framed field experiment but subjects do not know they are participants in an experiment

19
Q

What are the 2 properties of good measurement?

A
  1. Reliablity : consistency and stability of scores
  2. Validity : accuracy of inferences, interpretation, or actions made on the basis of test scores
20
Q

What are 2 rules for economic-specific validity?

A
  1. Decisions should be properly incentivized
    - earnings based on participant’s decisions
    - paid no lower than average hourly rate
  2. Use of deception is not allowed unless strictly necessary
21
Q

What is the name for the experimental design involving 2 treatment variables?

A

2x2 factorial design

22
Q

What is a 2 level and 3 level experimental design?

A

2 level: 1 control 1 treatment condition
3 level: 1 control 2 treatment conditions

23
Q

What is a recommended minimum number of observations in each cell for a 2x2 design?

A

30

24
Q

What are the 2 principles of manipulating a variable?

A

1) the manipulation indeed varies variable A
2) the manipulation only varies variable A

25
Q

What are the 4 steps for manipulating variables?

A
  1. Determining the number of treatment/manipulated variables
  2. Determine the manipulation of the variables
  3. Manipulation check
  4. Control techniques
26
Q

What are the 5 control techniques?

A
  1. Between subject design or within subject design
  2. Randomization
  3. Order effect
  4. Demand effect
  5. Wealth/income effect
27
Q

What is the difference beween within-subject and between-subject?

A

Between: each individual exposed to only 1 treatment condition
Within: each individual exposed to more than one treatment condition

28
Q

What are the benefits of within-subject experiment?

A
  1. Can control for many factors which may disturb your results
  2. Requires a smaller sample size than between subjects, leading to increased statistical power
29
Q

What are the negatives of a within-subject design

A
  1. Carryover effect
    - effect of prior experimental conditions
  2. Demand effect
    - participants try to interpret experimenter’s intentions and act accordingly
30
Q

Advantage of between subject experience

A

Each participant enters the study fresh and naive with respect to the procedures to be tested

31
Q

What is the effect of randomization on groups

A

It provides indirect control of uncontrolled variables by ensuring their eventual independence of treatment variables.

32
Q

What is a common technique for creating equivalent groups?

A

Random assignment
Everyone has an equal chance of being placed in any of the groups, typically using a chance mechanism to determine which condition a subject is assigned to.

33
Q

What is the order effect?

A

An influence on a particular trial that arises from its position in a sequence of trials.

34
Q

In a session with multiple decision making tasks, where should the key task of interest be positioned?

A

At the outset

35
Q

What are solutions to the demand effect?

A
  1. Use a between subject design
  2. Create incentives that make it costly to deviate from true preferred choices
36
Q

What is the wealth effect?

A

In the incentive to exercise paper, one group exercised more and this reason could be due to experiment payout being higher than other groups, creating a wealth effect

37
Q

Solution to wealth effect

A

All subjects receive an equal amount of payment regardless of treatment condition

38
Q

How does wealth effect come into play in experiments with multiple rounds?

A

Participants earnings in prior rounds may influence their subsequent decisions

39
Q

Solution to wealth effect in experiments with multiple rounds?

A

Subjects are paid according to results from a randomly selected period