Experimental Design Flashcards
IV
- independent variable
- systematically varied/manipulated by researcher
- 2 comparison levels
- SITUATIONAL (ie. bystanders in helping beh study)
- TASK VARIABLES (ie. groups w/differing logical problems to solve)
- INSTRUCTIONAL (ie. groups instructed to memorise objects via images OR no instructions)
DV
- dependent variable
- outcome/measurement the effects upon which are observed by researcher
Manipulating IV
- non-systematic random allocation (ie. coin toss), ruling out systematic differences (ie. IQ, personality), to either:
- CONTROL GROUP/CONDITION: no manipulation
- EXPERIMENTAL GROUP/CONDITION: manipulation
- direct manipulation often impossible so…
- INDIRECT MANIPULATION: theoretical variables affected indirectly then checked via “manipulation check”
MIV: Indirect Manipulation (Example)
- IV = attribution for failure (internal/external)
- purposeful failure exposure (ie. test) followed by reflection of INTERNAL contribution (ie. character)
- other pps asked for reflection of EXTERNAL contribution (ie. lack of revision/luck)
- manipulation check (ie. scale of internal/external failure after reflection) to see if outcome is desired (ie. internal reflectors answer on internal scale)
- DV difference testing now possible
EV
- extraneous variable
- not of interest but influence DVs and threaten validity of findings via obscuring measurement of interest
- if uncontrolled, they may systematically influence DVs, leading to a confounding result
- not all are possible confounds (ie. as long as age is similar in a sample, it’s fine) BUT still negatively impact study:
IE. A study w/only 60y+ pps can have limited EXTERNAL VALIDITY; findings ungeneralisable beyond age (ie. kids)
CV
- confounding variable (“special EV”)
- unintended/accidental EVs associated w/IV, providing alternative result interpretation
- a systematic effect of EV on DV could be mistaken for effect of IV
Measuring DV
- refer to previous research
- PILOT STUDY to find:
- CEILING EFFECT; task too easy/overly high scores; disguised pp differences
- FLOOR EFFECT; task too hard/overly low scores; disguised pp differences
- SOLUTION; task moderate; found via pilot testing
MDV: DV Selection Issues (Example)
- DV selection can often be complicated by practical constraints
IE. Researcher looking at impact of alcohol consumption on roach fatalities: - IV manipulated via experimental groups consuming various alcohol quantities BUT unethical
- irresponsible/unethical/illegal for DV manipulation (aka. pps in driving accidents)
MDV: DV Selection Solutions (Example)
- high alcohol group consume legal limit but then DV (accidents) isn’t sufficiently sensitive to detect IV impact and still unethical
- DVs must be relevant to outcome but sensitive to IV, so…
- RELEVANCE-SENSITIVITY TRADE OFF looking at reaction times (critical determinant of safe driving)/VR driving simulator removing legal/ethical concerns
MDV: Relevance-Sensitivity Trade-Off
- the more sensitive DV is to IV changes, the less relevant it may be to IRL phenomena
- DV + IRL link may be strenuous, undermining EXTERNALL VALIDITY as “proxy measures” may not imitate target variable enough
QED: Variables
- include gender/age/cultural group/IQ/personality traits; unmanipulated/self-selected but can be basis of group allocation
- require additional considerations to avoid possible confounds
QED: Self-Selection Bias (Example)
- think putting yourself forward as a volunteer; automatically you have qualities which may affect the DV in the study
- WALD (1939); WWII; aircraft came home w/bullet holes; suggested reinforcement of areas must susceptible to damage; Wald said these were the planes RETURNING, so the other areas must be reinforced as that’s where grounded planes were being hit
Quasi-Experimental Design
- some studies compare variables; IV differences but are untouched
- causal inference unestablished
- CANNOT claim IV causes DV; only that IV groups differ when interacting w/DV
- think opposite of experimental designs.
QED VS ED
IE. Studying effect of self-esteem on altruistic behaviour.
ED) Manipulate self-esteem (ie. praise); random allocation to high/low esteem conditions, then altruism measured.
OUTCOME = can argue high self-esteem causes altruistic behaviour; opportunity of causality to explain relationship; possible contribution to relevant theory.
QED) Measure self-esteem; group based on scores (ie. high/low) then altruism measured.
OUTCOME = only claim that high self-esteem pps where more likely to behave altruistically than low self-esteem pps; no inferred causality so limited/impossible theory contribution.
QED: ED Interaction
- manipulated and QED variables often blend in studies
- BANDURA’S BOBO DOLL (1973); EV = type of exposure to violence; QEV = gender (self-selected)