Week 1 Flashcards
Overview of Experimental Design Basics
Structure of a typical experimental article
Introduction
Conceptual Development
Methods
Results
General Discussion
Theoretical Contributions
Managerial Implications
Limitations/Future Research
Interchangeable Term: Manipulation
Treatment, Intervention
Interchangeable Term: Independent Variable (IV)
Factors
Interchangeable Term: Groups
Conditions, Levels, Cells
Interchangeable Term: Respondents
Participants
Interchangeable Term: Dependent Variables (DV)
Dependent Measures, Outcomes
Define Experimental Design
researchers examine impact of 1 or more IV’s independently (and also collectively if multiple IV’s) on 1 or more DV’s
How do you create 2 or more distinct groups/conditions within a given IV
IV’s are either strategically manipulated by researchers or measured “naturally”
What do all respondents do regardless of the condition
Answer the same questions
How do you tell if respondents differ based on their condition?
Analyze their answers
It is NOT an experimental design if -
if you do not manipulate anything (i.e. just measure)
True or False: Manipulation is always first in a survey
True
What is manipulation?
Researchers purposefully alter or change the IV(s) (i.e., apply a “treatment”) to see if it leads to a corresponding change in the DV(s)
The manipulation is conceived based on ______
Theory (i.e., theory suggests that a particular change in an IV would result in a particular change in some DV).
The goal of experimental design is to _____
isolate & observe effect of IV(s) on DV(s), WHILE controlling for effects of other variables on DV(s).
The ONLY difference between groups should be:
the difference we purposefully manipulate/allow for
Randomly assigning respondents to groups helps _____
helps to cancel out any naturally occurring differences between all of our respondents so that we can conclude that differences in responses are attributable (only) to the manipulation(s)
What lets us more confidently conclude that any change in our DV’s are directly due ONLY to the change in the IV(s)?
Random assignment of respondents to groups – coupled with ensuring that the only difference(s) between the groups are the ones we create (i.e., our manipulation[s])
What is internal validity?
refers to the extent to which a study or experiment is free from biases, confounding variables, and errors, ensuring that the observed effect is truly due to the independent variable and not other extraneous factors (i.e., what we see is caused by what we did – and not something else)
What is an interaction?
An interaction looks at effects of different combos of the IV’s on your DV’s
If you don’t have any ________, then you don’t have a true experiment and can’t infer causality - WHY?
manipulated factors in your design - why: due to lack of random assignment to different groups based on your manipulation
True or False: A measured IV by itself is fine and considered an experiment.
False
What is an interchangeable term for Manipulation?
Treatment, Intervention
What is an interchangeable term for Factors?
Independent Variables (IVs)
What is an interchangeable term for Groups?
Conditions, Levels, Cells
What is an interchangeable term for Respondents?
Participants
What is an interchangeable term for Dependent Variables (DVs)?
Dependent Measures, Outcomes
What are the main sections of a typical experimental article?
Introduction, Conceptual Development, Methods, Results, General Discussion, Theoretical Contributions, Managerial Implications, Limitations/Future Research
What defines an experimental design?
Researchers examine the impact of one or more IVs independently (and collectively if multiple IVs) on one or more DVs.
What is the role of IVs in experimental design?
IVs are either manipulated by researchers or measured naturally to create distinct groups/conditions.
Why is manipulation important in experimental design?
Without manipulation, the design is not experimental, and conclusions cannot be confidently drawn.
How is a manipulation defined in experimental research?
Purposeful alteration of an IV to observe its effect on a DV.
What is the primary goal of experimental design?
To isolate and observe the effect of IVs on DVs while controlling for other variables.
Why is random assignment important?
It ensures that differences between groups are only due to manipulation, improving internal validity.
What does high internal validity indicate?
It means the observed effects are caused by the manipulation and not by external factors.
What is an example of controlling for extraneous variables?
If testing coffee’s impact on alertness, other lifestyle changes (e.g., starting an exercise program) should be avoided.
What is an ‘interaction’ in experimental design?
When two or more IVs are manipulated together to examine their combined effects on a DV.
Describe an example of a basic experimental design.
Manipulating mindset (concrete vs. abstract) to study its effect on healthfulness evaluations of food.
What is the difference between concrete and abstract thinking?
Concrete thinking focuses on surface details. Abstract thinking focuses on fundamental principles.
How can mindset manipulation be implemented in an experiment?
Have participants read different types of stories to induce concrete or abstract thinking.
What is an alternative to manipulating an IV in an experiment?
Measuring it naturally and creating groups based on self-reported data.
Why is it necessary to manipulate at least one IV for a true experiment?
Without a manipulated IV, causality cannot be inferred due to lack of random assignment.
What is an example of an experiment on hunger and purchasing behavior?
Manipulating hunger by restricting food intake for one group while allowing another group to eat.
What are the two ways to handle an IV like hunger in an experiment?
Manipulate hunger by controlling food intake. Measure hunger levels through self-reporting.
What type of scale can be used to measure hunger in an experiment?
A 7-point Likert scale, e.g., 1 = not hungry at all, 7 = extremely hungry.
How do researchers compare the effects of an IV on a DV?
By calculating mean scores and checking statistical significance (e.g., p < 0.05).
What type of experimental design is used for comparing different groups’ responses?
Between-Subjects
This design involves different participants in each group being compared.
What experimental design is utilized for measuring individual differences across conditions?
Within-Subjects
In this design, the same participants are used in all conditions.
What is the name of the experimental design that balances both between-subjects and within-subjects methods?
Mixed Factorial
This design allows researchers to analyze multiple factors with different levels of each factor.
What type of design is used for studying real-world effects without randomization?
Quasi-Experimental
This design does not involve random assignment to groups.
What is the design called that measures changes over time?
Pretest-Posttest
This design involves measuring participants before and after an intervention.
What type of experiment is conducted in natural settings?
Field Experiments
This design allows researchers to study behavior in real-world environments.
What experimental design is best for conducting fast, scalable studies?
Online Experiments
This design leverages the internet to reach large participant samples quickly.
