Research methods C Flashcards
Types of rationale (4)
From previous researches methodological problems
Considering different theories to explain past research
Replication
Unique theory based on general observations
Types of design (3)
Simple comparisons - one IV, two conditions
One way designs - one IV, three or more conditions
Factorial designs - more than one IV, multiple simultaneous experiments
Example of factorial design
Effect of rain (IV 1) and wind (IV 2) on perceived pleasantness (DV)
How many interactions and conditions are there with two factors
One interactions and 4 conditions
How many interactions are there with 3 factors
4 interactions, one being all of them together
What does an ANOVA do
Is an analysis of the variance (SD^2), it determines if two or more groups are from the same population of scores
What do ANOVAs compare… and if they are similar?
The within group error variance to the between group error variance
… if they are similar then the groups are from the same population
When might ANOVAs be significant
If the between group variance is substantially larger than the within group variance
Why do within group designs tend to be more sensitive to ANOVAs than between group designs
Has smaller error variance so more likely for the between group variance (caused by IV) to be significantly larger than within group variance
(assuming minimal carry-over effects)
Sources of variance (2)
Error - different people producing different scores
Effect of variables / different conditions
F-ratio =…
Between group variance / within group variance
General rule for F-ratios showing significance
If they Re greater than 1, most likely significant
How to read F-ratios
The larger the more significantly the between group variance is larger than the within group variance
What a significant ANOVA tells us and what it doesnt
At least one group is significantly different from at least one other
Doesn’t tell us which groups
How to determine which groups significantly differ after a significant ANOVA
Comparing means And SDs indicates which ones
But post-hoc comparisons to find simple effects does so statistically
Problem with post-hoc comparisons
Familywise error rates
How to carry out post hoc comparisons
Use the appropriate t-test to compare each separate pairs of conditions
Type 1 error
Concluded significant when it is not
Went to find wolf but there wasn’t one
Type II error
Conclude no significance when there is
Didn’t go to wolf but there was
Explain family wise errors
Chance of type I errors = p, if comparing 3 groups then 3 comparisons needed… what would usually be 1/20 (.05) is now 3/20 (.15), meaning significance threshold too high
P =.25 threshold if 5 comparisons (**though threshold would still say .05!!)
How to avoid family wise errors
Use bonferroni correction - divide .05 by number of comparisons to make new criterion for significance
parametric assumptions (3)
normally distributed
Homogeneity of variance
Interval or ratio data
If one is not met, a non parametric test is needed
Limitations of non parametric tests (2)
Provide limited information (no means or variance)
Greater chance of type II errors as less sensitive
How to report non parametric tests (3)
State that (and how) assumptions for parametric tests were violated Report medians and range information (maybe IQR) Report test statistics
How to rank data
Order scores and number them in size order. If more than one of the same number, calculate their mean rank
Non parametric equivalent to a one way independent ANOVA
Kruskal-Wallis test
Features of Kruskal-Wallis test (4)
Uses independent groups
Compares 3 or more groups (different participants each group)
Sample sizes do not have to be equal
Uses ranked data
How Kruskal-Wallis test works
Rank all scores across all groups
Determine if rank for one condition is systematically higher or lower than another condition
If so, then a real difference. If non significant then ranks from each sample will be mingled together
How to do a post-hoc comparison after a significant Kruskal-Wallis test
Do a Mann-Whitney U test (non parametric equivalent to independent t-test), using a Bonferroni correction
Non parametric equivalent to a one way repeated measures ANOVA
Friedman’s test
Features of Friedmans test (3)
Compares 3 or more related conditions
Uses rank differences
Uses repeated measures design (same participants for each condition)
Hypothesis for Friedman’s test
Ranks of differences between a pair of conditions are systematically higher / lower than the ranks of differences between another pair of conditions
How to do a post-hoc comparison after a significant Friedman’s test
Conduct a Wilcoxon test (non parametric equivalent of a repeated measures t-test) on each pair of conditions, using a bonferroni correction
What is a mixed ANOVA?
At least one factor is within-participants and one factor between participants
Example of a mixed ANOVA
Two groups in different conditions (e.g. self compassion and control intervention), being tested before and after intervention.
How many independent variables can an ANOVA have?
One
What is levels of treatment
Number of groups in one factor
How many 1) factors 2) levels of treatment and 3) conditions does a 2 x 3 ANOVA have?
1) 2
2) 2 and 3
3) 6
Sources of variance in a two factor ANOVA (4)
Error variance
Main effect 1
Main effect 2
Interaction of factors
How does it get exponentially more complicated with studies with more factors
Number of interactions increases exponentially
Number of interactions in ANOVA = …
2^k - k - 1
k = number of factors
How to determine interactions from a graph
If the lines of factors are parallel then there is no interaction. The less parallel, the greater the interaction. Though significance of interactions cannot be determined by eye
What is an interaction
Variation in scores not due to error variance or the main effects
How many 1) main effects, 2) interactions and 3) sources of variance does a 2 x 2 x 4 ANOVA have?
1) 3
2) 4
3) 8
What is a simple effect
Difference between two conditions of one factor in a single condition of the other factor
Example of a simple effect in ANOVA (laptop vs hand written) x (review vs no review of notes)
With participant reviewing notes, the laptop was significantly less effective than hand written
Maximum number of simple effects in a 2 x 2 ANOVA
4
What to consider regarding research ethics? (4)
Provide consent form
Confidentiality / Anonymity
Stress optional, no pressure to participate
Debrief before or after study
Underlying assumptions of qualitative research
Descriptions / interpretations that move away from the realism / objectivity of quantitative, focusing on experience and subjectivity
Theoretical approach (generally) of qualitative research
An inductive approach whereby theories are shaped after the data is looked at, rather than having preconceptions
Explain how qualitative research has high reflexivity
Researchers interpretations is more embedded into the outcome of results
Characteristics of qualitative research (4)
High realism (naturalistic setting)
Low reliability
Loose structure
High reflexivity
Ontology
Theories about the nature of reality
Epistemology
Theories about the nature of knowledge