03 experimental research 2 Flashcards
What are confounding vairables?
Confounding variables are variables that are not the primary focus of the study but may interfere with the analysis, leading to incorrect conclusions about the relationship between the variables of interest
What is an experiment?
is taken to mean a scientific investigation in which an investigator manipulats or controls one or more independent variables and observes the dependent variables for variation concomitant to the manipulation of the independent variables
What is the main idea behind experiments?
we want to manipulate our wordl in order to learn its secrets
What is the distinction of experiments in regards to other methods?
In experiments we have a active manipulation of the independent variables that is the focal distinction to other methods
What kind of techniques exist to control for confounding variables?
Control for confounding variables:
- Controlled conditions
- Experimental laboratories
- Control groups
- Random assignment to experimental conditions
Two forms of experimental studies to detect relations between two constructs or variables?
- Non-experimental: A and B are observed (external validity) “observe nature in raw” -> no intervention
- Experiments: A is manipulated and effect on B observed (internal validity)
The two types of confounds?
Respondents-related:
- Age
- Income
- Education
- Motivation
- Memory
- Intelligence
Situation-related:
- Time of study
- Researcher
- Location of study
- Nationality
- Light
What is randomizatiion?
Controlling for respoondents-related confounds via randomization
randomization: controls for the effects of observable/unobserverable characteristics and makes group equivalent (on average) on all variables
–>it helps to assess whether differecnes after treatment are larger than would be expected due to chance
What does it mean if we have random asisngment in an experiement?
Random assignment in two groups:
1. 50 get daily vitamin C tablets
2. 50 get daily placebo tablets
–>because of this random assignment, we can make the reasonable assumption that any differences you observe is only due to the manipulation
Can we use experiments to inferre causal relationships?
(4 coniditions)
- Dinstinct entities: depends on the conceptual considerations, no specific experimental mechanism
- Association:Yes–>DV are observed for different levels of IV
- Temporal precedence: Yes –>DV are observed temporarily after the manipulation of IV
- Eliminating rival causal explaination: Randomization creates structual equality for all variables that are not manipulated, also use confound checks and process measure possible
Process of conducting experimental studies?
- selection of research variable
- Choice of experimental design
- Creating the experimental stimuli
- Data collection
- Data analysis
- Presentation of findings
What ar the 3 aspects to consider by designing an experiment
environment setting:
- Field experiment (realistic) vs. Laboratoy experiment (Physical re-enactment/ scenario description)
randomization:
- Random experiment (Complete) vs. Quasi-experiment
Point of reference:
- Within subjects design (same participants) vs. between subjects design (different participants –>better)
–>+ N-factorial design
What are possible reasons for drawing false causal inferences in experiments:
External validity threats
Sample selection bias: occurs when the sample selected for the study is not representative of the larger population
–>Impact: Findings may not be generalizable to the broader population
Low group sizes: –>related to statistical power
–>Impact: results may lack generalizability, more vulnerable to random variation
—> larger sample size, provides more reliable and representative data
What are the 8 threats for interanl validity?
- Group threats (selection bias)
- History
- Testing effects
- Regression to the mean
- Maturation
- Mortality
- Instrument change
- Reactivity and experimenter effects
What is: Group threats, history and testing effects? (Internal validity threats)
Group threats (selection bias): occur when you do not randomize and let peiple decide on the group
History: external events occuring during the study that could affect the outcomes
–>Impact: discounts at the same time, might have an impact on the results)
Testing effects: Important for repeated measurements: Changes in participants behavior due to the act of being tested or assed rather than the experimental treatment itself