Quiz 2 Experimental Design Flashcards
What is a confounding variable
An extraneous variable that potentially ended up affecting the dependent variable (variable that was not controlled for)
Ex. Experiment on amount of sunlight and its effects on plant growth without controlling for water amount
What is a lurking variable?
One that affects both IV and DV
(Ex. ESL learners who have iPads found to have higher English proficiency than those who don’t—doesn’t mean iPad improves English, so lurking variables could be at play such as financial well-being of family)
What is pretest- post test design?
- DV measured before intervention—intervention is made—DV measured again
- control group doesn’t receive experimental intervention
- if DV not measured pre-intervention, not a PP design!
Can surveys be involved in experimental design?
No, they are just observational
What is the first step in creating an experimental design?
- list variables
What is within-subject design?
- each participant exposed to all conditions of IV (ex. Rate of speech both fast and slow)
What is between-subject design?
- each participant exposed to only one condition of IV (ex. Only slow rate of speech or only fast)
What are the advantages of within-subject design?
- does not require a large pool of participants
- good for longitudinal or observational studies over extended period of time, controlling for individual variations
What are the disadvantages of within-subject design?
- carryover effect: participants get faster and more accurate with practice from first test
- participants figure out what is being tested
- takes time (often long time to measure change in people over time)
What is a situation where you would need to have between-subject design?
You want to compare the perceptions of different ages/genders/ethnicities/social class/etc on rate of speech
What are the advantages of between-subject design?
- no carryover effect
- shorter duration of study (since not looking at individuals’ change over time)
What are the disadvantages of between-subject design?
- needs a larger pool of participants
- not much control over individual variations
What is factorial design?
- when there are more than one independent variables in a single experiment
When would you want to use factorial design?
- when you want to investigate the effect of 2 or more IV’s (=factors) without needing to run separate experiments
- when you want to know the MAIN effects of individual factors
- when you want to see the interaction effects between factors (“interaction effect” refers to combined effect of multiple IV’s on the DV)
- ex. Experiment to evaluate 2 groups: 10 yr old boys and 10 yr old girls and how the effects of taking summer enrichment course or not affects math test scores
What is single-factor design?
- a single factor/IV in the experiment
What is a univariate design?
- a single DV
What is a single-factor univariate design?
- has one IV and one DV
Ex. Do women talk faster than men?
DV- rate of speech
IV- women vs men
What is 2x2 factorial design?
2 IV’s with 2 levels in each
Ex. 2 dialects (A and B), 2 age groups (old, young)
Interaction effect
When 2 or more variables interact in such a way that the combined impact on the outcome (DV) is different from what would be expected if you simply added their individual effects.
What is the difference between experimental and non-experimental design?
Experimental allows us to establish a causal relationship between 2 variables
What is the purpose of non-experimental design?
- to observe and describe phenomena
What kind of control is involved in experimental design?
- high control over IV’s through manipulation
What kind of control is involved in non-experimental design?
- no manipulation of variables—variables observed as they naturally occur
What kind of assignment is used in Experimental vs non-experimental design?
Experimental: participants randomly assigned to control vs experimental groups
Non-experimental: no random assignment—groups pre-existing or naturally occurring
How many groups are usually involved in experimental vs non-experimental designs?
Experimental: 2 groups (control and experiment)
Non-experimental: often just one group
When does it make sense to use an experimental design?
- when you have a hypothesis about a causal relationship between 2 variables
- when you are able to manipulate the IV
- when you can randomly assign participants to different groups in the IV
Take note of random SAMPLING vs. Random ASSIGNMENT
When does it make sense to use a non-experimental design?
- if you are interested in a single variable (ex. How high are the high vowels in dialect A?)
- if you are interested in a non-causal statistical relationship between 2 variables (ex. Is there a CORRELATION between speech rate and pitch)
- you have an exploratory research question (ex. What sounds are topologically most attested in world languages)