03 experimental research 2 Flashcards

1
Q

What are confounding vairables?

A

Confounding variables are variables that are not the primary focus of the study but may interfere with the analysis, leading to incorrect conclusions about the relationship between the variables of interest

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is an experiment?

A

is taken to mean a scientific investigation in which an investigator manipulats or controls one or more independent variables and observes the dependent variables for variation concomitant to the manipulation of the independent variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is the main idea behind experiments?

A

we want to manipulate our wordl in order to learn its secrets

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is the distinction of experiments in regards to other methods?

A

In experiments we have a active manipulation of the independent variables that is the focal distinction to other methods

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What kind of techniques exist to control for confounding variables?

A

Control for confounding variables:
- Controlled conditions
- Experimental laboratories
- Control groups
- Random assignment to experimental conditions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Two forms of experimental studies to detect relations between two constructs or variables?

A
  1. Non-experimental: A and B are observed (external validity) “observe nature in raw” -> no intervention
  2. Experiments: A is manipulated and effect on B observed (internal validity)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

The two types of confounds?

A

Respondents-related:
- Age
- Income
- Education
- Motivation
- Memory
- Intelligence

Situation-related:
- Time of study
- Researcher
- Location of study
- Nationality
- Light

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is randomizatiion?

A

Controlling for respoondents-related confounds via randomization

randomization: controls for the effects of observable/unobserverable characteristics and makes group equivalent (on average) on all variables

–>it helps to assess whether differecnes after treatment are larger than would be expected due to chance

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What does it mean if we have random asisngment in an experiement?

A

Random assignment in two groups:
1. 50 get daily vitamin C tablets
2. 50 get daily placebo tablets

–>because of this random assignment, we can make the reasonable assumption that any differences you observe is only due to the manipulation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Can we use experiments to inferre causal relationships?
(4 coniditions)

A
  1. Dinstinct entities: depends on the conceptual considerations, no specific experimental mechanism
  2. Association:Yes–>DV are observed for different levels of IV
  3. Temporal precedence: Yes –>DV are observed temporarily after the manipulation of IV
  4. Eliminating rival causal explaination: Randomization creates structual equality for all variables that are not manipulated, also use confound checks and process measure possible
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Process of conducting experimental studies?

A
  1. selection of research variable
  2. Choice of experimental design
  3. Creating the experimental stimuli
  4. Data collection
  5. Data analysis
  6. Presentation of findings
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What ar the 3 aspects to consider by designing an experiment

A

environment setting:
- Field experiment (realistic) vs. Laboratoy experiment (Physical re-enactment/ scenario description)

randomization:
- Random experiment (Complete) vs. Quasi-experiment

Point of reference:
- Within subjects design (same participants) vs. between subjects design (different participants –>better)
–>+ N-factorial design

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What are possible reasons for drawing false causal inferences in experiments:
External validity threats

A

Sample selection bias: occurs when the sample selected for the study is not representative of the larger population
–>Impact: Findings may not be generalizable to the broader population

Low group sizes: –>related to statistical power
–>Impact: results may lack generalizability, more vulnerable to random variation
—> larger sample size, provides more reliable and representative data

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What are the 8 threats for interanl validity?

A
  1. Group threats (selection bias)
  2. History
  3. Testing effects
  4. Regression to the mean
  5. Maturation
  6. Mortality
  7. Instrument change
  8. Reactivity and experimenter effects
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is: Group threats, history and testing effects? (Internal validity threats)

A

Group threats (selection bias): occur when you do not randomize and let peiple decide on the group

History: external events occuring during the study that could affect the outcomes
–>Impact: discounts at the same time, might have an impact on the results)

Testing effects: Important for repeated measurements: Changes in participants behavior due to the act of being tested or assed rather than the experimental treatment itself

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is: regression to the mean, maturation, or mortality?

A

Regression to the mean: the tendency of extremce scores on a variable to move toward the average on subsequent measurements

Maturation: Changes in participants over time that are not a direct result of the experimental treatment but simply natural maturation, for i.e. change behavior due to conducitng multilpe experiments

Mortality: loss of participants from a study over time

17
Q

What is instrument change, reactivity and experimenter effects?

A

Instrument change: Alterations in the measurement instruments or tools used during the study

Reactivity and experimenter effects: unitentional biases or cues from the experimenter that influence participants behavior

18
Q

What is a field experiment?

A

Field experiment:
- Takes place in a realistic setting
- Subjects are mostly unaware of their participation in an experiment

19
Q

What is an Laboratory experiment?

A

Laboratory experiment:
- Takes place in environment created especially for the experiment
- Subjects are aware of their participation in the experiment (often actual research question is hidden)

20
Q

What are the advantages of a field experiment?

A

Advantages field exppeirment:
- high degree of authenticity increases the possibility of making generalizations about the experimental findings (high external validity)
- No awareness of participation

21
Q

What are the disadvantages of an field experiment?

A

Disadvantages:
- Very expensive
- ethically problematic
- Barely replicable (decreases generalizability)
- Little control over potential confounding variables (low internal validity)
- Manipulation of independent variables often very difficult
- Access to organizations often difficult

22
Q

What are the advantages of laboratory experiments?

A
  • Time and costs
  • High control over potential confounding variables (high internal validity)
  • Easy to replicate
  • High level of control over manipulation of the independent variables
23
Q

What are the disadvantages of laboratory experiment?

A

Disadvantages laboratory:
- Little authenticity (low external validity)
- Subjects are aware of taking part in an experiment

24
Q

What are the two forms of laboratory experiemnts? (Also describe)

A

Physical re-enactment:
- exerpimental conditions are physicall re-enacted in the experimental laboratory
- COmbiens survey methods and observational methods

Scenario description:
- subjects are asked to image themselves in a certain fictional situation and then to describe their own behavior
- specific form of survey methodology

25
Q

What are the advantages of a phsical re-enactment?

A

Advantages phycisal re-enactment:
- Higher degree of authenticity increases the possibility of making generalizations about experimental findings (higher external validity)
- Observation of physical reactions (especially behavior) possible

26
Q

What are the disadvantages of physical re-enactment?

A

Disadvantages:

  • Relatively costly
  • Many organizational situations cannot be recreated in a lab (e.g., decisions about high-priced purchases)
  • Sometimes ethically ambivalent (e.g., when researching negative experiences)
27
Q

What the advantages of scenario descriptions?

A

Advantages scenario descriptions:
- Less costly (can be conducted online)
- Possibility to examine negative experiences

28
Q

What are the disadvantages of scenario descriptions?

A

Disadvantages scenario descriptions:
- Little authenticity (low external validity)
- Scenarios cannot be very detailed – high degree of subjective assessments by the participants
- Behavior cannot be readily observed → risk of Common Method Effects
- Usually restricted to visual stimuli

29
Q

What is the difference between quasi-experiments and randomized experiments?

A

Quasi-experiments: experiments that lack random assignment of units to conditions but that otherwise have similar purposes and structural attributes to randomized experiments

Randomized experiments: randomly allocating the subjects across the experimental conditions (randomization

30
Q

What is the difference between random assignment and random sampling?

A

DIfferent objectives:

random sampling: structural equivalence of sample and population

Random assignment: structural equivalence between the different experimental conditions (groups)

31
Q

What is the goal of randomization?

A

Goal randomization:

  • Alternative causes are not confounded with the treatment
  • Reduces the liklihood of threats to validity by randomly distributing them across experimental conditions
  • All experimental conditions have the same expected value of all variables, measured or not
  • Allows the researchers to know and model the selection process correctly
  • Allows compuation of valid estimate of error variance that is uncorrelated with the experimental treatment
32
Q

What is a facortial design?

A

Factorial design:
- dominant in business research
- several IV (factors) each with at least two attribute levels
- each combination of the factor levels corresponds to one experimental condition (cell)

Notation in case of two IV with two levels each: R: randomization, X: treatment, O:observation

Number of experimental conditions (Cells):
- product of factor attribute levels (crossed design)
- Can lead to large designs
- Possibility of Nested designs: each attribute level of one factor is only combined with a specific level of the other factor

33
Q

What are the advantages of factorial design

A

Advantages of factorial design:
- smaller sample sizes (each particippant exposed to several IV)
- allows for testing interactions between the IV

34
Q

What are the important factors by designing the experimental stimuli?

A
  1. realism: how closely the experimental stimuli mirros the real-world
  2. Unobtrusiveness (unauffdringlichkeit) of the issue being research: refers to the degree to which the experimental stimuli avoid interferring with or alteirng natural behavior
  3. Simplicitiy involces the clarity, straightforwardness, and lack of uncessary complexit
35
Q

What are the 3 stage of the experimental manipulation process?
(Design of experimental stimuli)

A

1.Treatment delivery: researcher privde the specified treatment (stimulli, intervention, condition)
2.treatment receipt: Researcher asses whether participants exposed to and excounter the treatment
3.Treatment adherence: assess whether pariciants comply with instructions, requirements or protocols

36
Q

How to check the effeectiveness of manipulation in the design of experimental stimuli

A

Manipulation checks: examine wheethe the manipulation sucessfully influenced the varibale of interest

Realism checks: participants are asked about perceived authenticity or believability of experimental setup

Confound checks: (assess whether any unintended influences or confounding varibales may affect the experimental manipulation

37
Q

Sample size and sample structure: What can be down against the problem: participants drop out?
(Risk and solutions)

A

Problem: participants drop out
- especially serious in case of overlap with research question
- Risk: random experiments convert into quasi-experimetns

Solutions/options:
- minimize the amount of tme between agreement to participate, manipulation, and measurement
- Get consent of participants to participate in all possible experimental conditions
- Analyze

38
Q

What are the ethical principles of experimental research?

A

Informed Consent:
– Inform participants about experimental content
– Participants always have the opportunity to end the experiment
– In case of observations/field studies: Protection of personal rights/privacy
Deception:
– Truthful instructions
– No misguidance of participants
– No active support of failure
Debriefing:
– After conducting the experiment, inform participants about the goal of the study
Confidentiality:
– Protection of personal rights/privacy
– Analysis of results on an aggregate level
Protection from physical and psychological harm:
– Avoidance of stress, fear, shame etc.
– Avoidance of physical damage