Lecture 5 Flashcards
What are 3 keys to controlling threats to internal validity?
• Random assignment; Randomization
– Real randomization
– Matched pairs (not matched groups)
– Randomizing treatments or counterbalancing
- Placebos
- Blind setups
What are 4 threats to external validity?
- Selection bias:
Participants or group selected in a biased manner react to the treatment in a unique way - Testing:
The administration of a pre- test may affect the response to the treatment and subsequently outcomes. - Experimental setting:
Factors like the situation, time of day, location, researchers’ characteristics, etc. limit generalizability of the findings. - Multiple treatment interference:
the administration of more than one treatment to the same subject (s), the effect of one treatment may be influenced by the effect of another treatment
What is the key to controlling threats to external variability?
• Random selection
• Selecting from a larger population
– Participants
– Treatments
– Situations
What are 3 methods of control?
• Physical manipulation
• Selective manipulation
– Matched pairs and block designs
– Counterbalanced designs
• Statistical techniques
• Best way to control extraneous variables
• Researcher attempts to control all aspects of the
research, except the experimental treatment.
• Difficult to control all variables
What type of manipulation is this?
Physical manipulation
• Intent is to increase the likelihood that treatment groups are similar at the beginning of study.
– Matched pairs design
– Counterbalanced design
What type of manipulation is this?
Selective manipulation
• Applied when physical manipulation or selective manipulation is not possible
• Differences among treatment groups are known to exist at beginning of study.
– Groups may differ on initial ability.
• Analysis of covariance (ANCOVA)
– Adjusts scores at the end of the study based on initial differences
What type of manipulation is this?
Statistical techniques
– Hawthorne effect – Placebo effect – John Henry effect – Rating effect – Experimenter bias effect
What are these examples of?
Common sources of error
- A specific type of reactive effect in which merely being a research participant in an investigation may affect behaviour
- Suggests that, as much as possible, participants should be unaware they are in an experiment and unaware of the hypothesized outcome
What type of effect is this?
Hawthorne effect
• A threat to internal validity wherein research participants in the control group try harder just because they are in the control group
What type of effect is this?
John Henry effect
• The intentional or unintentional influence that an experimenter (researcher) may exert on a study
What type of effect is this?
Experimenter bias effect
• A variety of errors are associated with ratings of a participant or group – Halo effect – Overrater error – Underrater error – Central tendency error
What type of effect is this?
Rating effect
• Participants may believe that the experimental treatment is supposed to change
them, so they respond to the treatment with a change in performance.
What type of effect is this?
Placebo effect
What is the difference between a single blind and double blind study?
In a single-blind study, patients do not know which study group they are in (for example whether they are taking the experimental drug or a placebo).
In a double-blind study, neither the patients nor the researchers/doctors know which study group the patients are in.
What experimental code was developed during Nazi experimentation in WW2?
Nuremberg Code – basic principles to govern research involving human subjects