Experimental Research Flashcards
True or false? Experimental research is the best technique to test causal relationships.
True; best if Classical
What must you consider when selecting a research question for experimental research?
- Must confront ethical and practical limitations of intervening in human affairs
- Researcher must be able to manipulate conditions (intrusive!)
- It is NOT an experiment unless YOU are manipulating something
- Best for micro-level concerns; narrow-scope with few variables that can be controlled
- Hard to address questions that require looking at conditions over time or entire society
- Researcher cannot examine numerous variables at once
- May limit one’s ability to generalize to larger settings due to artificial control
Is it an experiment if you take a group of people that smoke and a group of people that don’t smoke and see who develops lung disease?
No; you need to be actively manipulating the situation!
What is random assignment?
Dividing subjects into groups using a random process, so the experimenter can treat the groups as systematically equivalent
What is the point of random assignment? Why is it random and unbiased?
- Facilitates comparison in experiments by creating similar groups that differ only in treatment
- Random means a case has an equal chance of ending up in each group
- Unbiased because a researcher’s desire to confirm a hypothesis does not enter into the selection process
What is matching and its challenges?
- An alternative to random assignment
- Matching the characteristics of cases in each group to get equivalent groups
- Challenges ⟶ what are the relevant characteristics to match on, can one locate exact matches
What is random sampling?
Researcher selects smaller subset of cases from a larger pool
What is science of the sophomore?
A term that refers to the potentially limited external validity of studies based on undergraduate samples
What are the 7 components of the classical experiment process?
- Random Assignment
- Treatment/Independent Variable (X)
- What the researcher manipulates - Dependent Variable (O)
- Physical conditions, social behaviours, attitudes, feelings, or beliefs of subjects that change in response to a treatment - Pretest
- Measurement of dependent variable prior to treatment - Post-test
- Measurement of dependent variable after treatment - Experimental Group
- Group that receives treatment - Control Group
- Group that does not receive treatment
What is deception and how does it work?
- When an experimenter lies to subjects about the true nature of an experiment or creates a false impression through their actions/setting
- Allows the researcher to control subjects’ definition of the situation
- By focusing participants’ attention on a false topic, the researcher induces the unaware subjects to “act naturally”
What are confederates?
People who pretend to be other subjects or bystanders but who actually work for the researcher and deliberately mislead subjects
When is deception acceptable and how should it be done?
- Only acceptable if research cannot be achieved otherwise
- Type and amount should not go beyond what is minimally necessary
- Participants should be debriefed
What are the 3 main types of experimental design?
- Classical
- Pre-Experimental
- You have control over independent variable (eg. intervention), but lacking aspects of full classical design (NO random assignment) - Quasi-Experimental
- Less control over independent variable (real life), but still stronger than PED for establishing causation
- Stronger than pre-experimental designs for establishing causal relationships
What are the 3 types of pre-experimental designs?
NO RANDOM ASSIGNMENT
- One-Shot Case Study (One Group Post-Test Only)
- One group gets treatment, post-test
- Eg. students writing an exam - One Group Pretest Post-test Design
- One group gets treatment, pretest, post-test
- Eg. fitness regime for weight loss - Static Group Comparison (Post-Test Only Non-Equivalent Group)
- Two groups (one gets treatment), post-test
What are the 6 types of quasi-experimental design?
- Two-Group Post-Test-Only
- Random assignment, two groups (one gets treatment), post-test - Interrupted Time Series
- One group (no random assignment), dependent variable is measured at many time points (to get a baseline), and treatment occurs in the middle - Equivalent Time Series
- One group (no random assignment), several repeated pre-tests, post-tests, and treatments over a period of time
- Building credibility by making sure effect is due to intervention - Latin Square
- Random assignment, multiple groups, treatments in different sequences, group outcomes compared at the end
- See whether order of treatment has an effect
- Eg. taking courses in different semesters - Solomon Four-Group
- Random assignment, 2 control groups and 2 experimental groups, only 1 experimental group and 1 control group get pre-test
- Addresses the issue of pretests affecting dependent or treatment variable - Factorial Design
- Treatment is combination of several independent variables simultaneously
- Interaction effect: the effect of 2 independent variables that opereate together to create a “boost”
