Which Stats Test? Flashcards
What stats tests could be conducted with below example:
Q - what is the effect of group status on perceptions of intergroup conflict
H - group members less likely to perceive conflict with another group when their ingroup has high status
IV - ingroup status (2 conditions: high & low)
DV - perceptions of intergroup conflict (measured by questionnaire)
Independent-samples t-test
OR
One-way ANOVA
What stats tests could be conducted (and any jamovi notes) with below example:
Q - what is the effect of group status on perceptions of intergroup conflict
H - group members less likely to perceive conflict with another group when their ingroup has high or equal status (relative to an outgroup)
IV - ingroup status (3 conditions: high vs equal vs low)
DV - perceptions of intergroup conflict (measured by questionnaire)
There’s 3 conditions in the IV so there is only one analysis option: One-way ANOVA
- because it allows an overall test of the effect of the independent variable
- and it tests the specific comparisons between individual conditions (eg high vs low, equal vs low)
When setting this up in jamovi, you’ll want to change ‘simple’ in the dropdown box to ‘helmert’ which will ask for contrasts of low vs equal and high combined, and then equal vs high
What stats tests could be conducted (and any jamovi notes) with below example:
Q - what is the effect of group status on perceptions of intergroup conflict
H - group members less likely to perceive conflict with another group when their ingroup has high status, BUT only when addressing an outgroup audience rather than ingroup
IV - ingroup status (2 conditions: high vs low), and audience (ingroup vs outgroup)
DV - perceptions of intergroup conflict (measured by questionnaire)
This is a more complex design with 2+ IVs -
Two-way ANOVA
- tests the main effects of the two IVs (effect of status collapsed across audience, and vice versa)
- tests the interaction between the two IVs (extent to which effect of status varies depending on audience)
What analysis do we need to conduct to understand if high ingroup status would only affect perceived conflict in the outgroup audience condition
We need the analysis of the effect of status of each level of the audience variable
Simple main effects analysis
- tests the main effect of IV1 at each different level at IV2
What stats tests could be conducted (and any jamovi notes) with below example:
Q - what is the effect of group status on perceptions of intergroup conflict
H - group members less likely to perceive conflict with another group when their ingroup has high status, BUT only when addressing an outgroup audience rather than ingroup, AND when perceived threat is low rather than high
IV - ingroup status (2 conditions: high vs low), audience (ingroup vs outgroup), and threat (high vs low)
DV - perceptions of intergroup conflict (measured by questionnaire)
Three-way ANOVA
- tests the main effects of the 3 IVs
- tests the 3 two-way interactions between each pair of IVs (status x audience, threat x audience, status x threat)
- tests the three-way interaction between all 3 IVs
As a rule of thumb - what type of stats test would you use for categorical Independent Variables (like experimental manipulations)
ANOVA
As a rule of thumb - what type of stats test would you use for continuous Independent Variables
Regression
As a rule of thumb - what type of stats test would you use for a mix of continuous and categorical Independent Variables
Regression
What type of stats test would we use for repeated-measures designs?
Mixed models (aka hierarchical/multilevel modelling)
What are your analysis options for the following design?
Q - does students’ alcohol consumption change over the course of a term
H - alcohol consumption will be lower later in a term
DV - self-reported alcohol consumption
IV - two time points (which the DV is measured at): week 2/time 1, and week 9/time 2
paired-samples t-test
OR
one-way mixed model
What are your analysis options for the following design?
Q - does students’ alcohol consumption change over the course of a term
H - alcohol consumption will be lower later in a term, compared to early in and midway through a term
DV - self-reported alcohol consumption
IV - three time points (which the DV is measured at): time 1, time 2 and time 3
one-way mixed model is the only option
- allows an overall test of differences over time
- allows tests of specific comparisons between individual time points and specific trends across time points
What are your analysis options for the following design?
Q - does students’ alcohol consumption affect performance on hand-eye coordination tasks
H - alcohol consumption will reduce performance on hand-eye co-ordination tasks, BUT only for difficult tasks and not for easy tasks
DV - performance on hand-eye coordination tasks
IV - alcohol consumption (have or haven’t consumed)
- task difficulty (hard or easy)
Two-Way Mixed Model
- tests the main effects of the two IVs (effect of alcohol collapsed across task difficulty and vice versa)
- tests the interaction between the two IVs (extent to which effect of alcohol varies depending on task difficulty)
Simple Main Effects Analysis also needed
- tests the main effect of IV1 (alcohol) at each different level of IV2 (task difficulty)
What are the independent variables for the following design?
Q - does students’ alcohol consumption change over the course of a term
H - alcohol consumption will be lower later in a term compared to early on and midway through it, BUT not for members of sports clubs
DV - Alcohol consumption
How does an interaction effect relate to this?
IV1 = time point (time 1, time 2, time 3), repeated measures
IV2 = sports club membership (yes vs no), between-participants
The effect of IV1 depends on IV2 - this is an interaction effect
What are your analysis options for the following design?
Q - does students’ alcohol consumption change over the course of a term
H - alcohol consumption will be lower later in a term compared to early on and midway through it, BUT not for members of sports clubs
DV - Alcohol consumption
IV - time point, and sports club membership
Two-Way Mixed Model
-tests the main effects of the 2 IVs (effect of time collapsed across sports club membership, and vice versa)
- tests the interaction between the 2 IVs (the extent to which differences across time vary depending on sports club membership)
What are your analysis options for the following design?
Q - does students’ alcohol consumption affect performance on hand-eye coordination tasks
H - alcohol consumption will reduce performance on hand-eye coordination tasks, BUT only for difficult tasks not easy tasks, AND especially amongst those who don’t play sports involving hand-eye coordination
DV - performance on hand-eye coordination tasks
IV - alcohol consumption, task difficulty, sport membership
Three-Way Mixed Model
- tests the main effects of the 3 IVs
- tests the 3 two-way interactions between each pair of IVs (alcohol x task, alcohol x sports, task x sports)
- tests the three-way interaction between all 3 IVs
