Statistics Flashcards
Definition
one type of inferential statistics. It is used to determine whether there is a significant difference between the means of two groups. With all inferential statistics, we assume the dependent variable fits a normal distribution
T test
What is the internal and external validity rated for an quasi-experimental study?
Internal: medium
External: medium
What is a two-way ANOVA?
An ANOVA with 2 factors (IVs)
What is contrasts?
The between treatment variability is explained by the experimental manipulation – i.e., is due to participants being assigned to different groups
What do you do if homogeneity is violated in an ANOVA?
- If sample sizes are large and equal…
- ANOVA can handle normality violation
- If sample sizes are small or not equal…
- Use the Brown-Forsythe or Welch F ratio (and their associated p and df; Welch is more powerful) instead of the regular F ratio
Define
T test
one type of inferential statistics. It is used to determine whether there is a significant difference between the means of two groups. With all inferential statistics, we assume the dependent variable fits a normal distribution
What are some threats to external validity?
- Generalising across participants or subjects
- Generalising across features of a study
- Generalising across features of the measures
Definition
the validity of applying the conclusions of a scientific study outside the context of that study. Tt is the extent to which the results of a study can be generalized to and across other situations, people, stimuli, and times
External validity
Definition
F = variance between sample means / variance expected by chance
F statistic
t-Tests are “difference tests”. Used to compare mean differences between up to ____groups or conditions
t-Tests are “difference tests”. Used to compare mean differences between up to two groups or conditions
Define
Type I error
the rejection of a true null hypothesis (also known as a “false positive” finding or conclusion)
Definition
a collection of statistical models and their associated estimation procedures (such as the “variation” among and between groups) used to analyze the differences among group means in a sample
ANOVA
What do you use in a post hoc test is there are unequal variances?
Games-Howell
Define
Confounding variable
factors other than the independent variable that may cause a result
What does witihin treatment variance look like on this graph?
What is the experiment-wise error rate of an analysis that uses 3 comparisons at an alpha level or .05?
αEW = 1 - (1 - αTW)c
αEW = 1 - (1 - .05)3
αEW = 1 - .953
αEW = .14
14% chance of comitting at least 1 type I error
What test is used to assess normality?
Shapiro-Wilk
Definition
An experimental design that that looks a bit like an experimental design but lacks the key ingredient – random assignment
Quasi-experiment design
What is the internal and external validity rated for an experimental study?
Internal: high
Externl: low
Definition
A type of reseach used to assess changes over an extended period of time
Developmental research
How do you minimise participant attrition?
- Increase sample size and measure/ compare participants who do/don’t withdraw
What does a positive t-value tell you?
That the mean for condition/sample 1 is higher than the mean for condition/sample 2
What is the non-parametric alternative to a one-way repeated-measures ANOVA?
Friedman’s test
How do you minimise environmental variables?
- Standard experimental procedures, setting, and experimenter
What are threats to both internal and external validity?
- Experimenter bias
- Demand characteristics and participant reactivity
How do you calculate the F ratio using sum of squares and degrees of freedom?
Mean squared deviation (MS) = Sum of Squares (SS) / df
F = MSBETWEEN / MSWITHIN
What is the biggest threat to internal validity?
Confounding variables
Definition
factors other than the independent variable that may cause a result
Confounding variable
Why choose repeated-measures?
- A repeated-measures ANOVA uses a single sample, with the same set of individuals measured in all of the different treatment conditions
- Thus, one of the characteristics of a repeatedmeasures (aka within-subjects) design is that it eliminates variance caused by individual differences
- Individual differences are those participant characteristics that vary from one person to another and may influence the measurement that you obtain for each person
- e.g., age, gender, etc.
What is the formula used to determine the experiment-wise error rate?
αEW = 1 - (1 - αTW)c
Where c = number of comparisons
During a post hoc test, if assumptions are met and sample sizes are equal what do you use?
Turkey’s HSD
What are examples of non-experimental designs?
Observational, cross-sectional or longitudinal studies
In a one-way repeated-measure ANOVA, what is the F ratio made up of?
F = (treatment effect + other effect) / other effect
Numerator = between treatment variance
Denominator = within treatment variance
Individual differences not considers due to repeated measures
What is the internal and external validity rated for an non-experimental study?
Internal: low
External: high
Define
Experiment-wise error rate (αEW)
The probability of making at least on type I error amongst a series of comparisons
Define
ANOVA
a collection of statistical models and their associated estimation procedures (such as the “variation” among and between groups) used to analyze the differences among group means in a sample
What type of follow up test do you use if there is a specific hypothesis? What about when there is no hypothesis?
Specific hypothesis: Planned comparisons
No hypothesis: Post hoc tests
How do you minimise generalising across features of a study?
- Conduct naturalistic research
- Switch from between-subjects to a withinsubjects or matched-subjects design.
- Replicate study in different setting/with different experimenter
What does contrast 1 and contrast 2 test?
What effect size value is used for ANOVA? How do you calculate it?
Eta-squared (η2)
η2 = SSbetween / SStotal
How do you minimise generalising across features of the measures?
- Use multiple response measures (e.g., selfreport, observation, physiological).
- Systematically vary time of measurement as an IV and measure effect on DV and other IV.
What does a negative t-value tell you?
That the mean for condition/sample 1 is lower than the mean for condition/sample 2
What do you do if sphericity is violated?
If assumption is violated, apply a correction factor (of epsilon) to the degrees of freedom – This will in turn adjust the p value for the ANOVA
If Greenhouse-Geisser epsilon is less than .75 then use Greenhouse-Geisser
If Greenhouse-Geisser epsilon is greater than .75 then use Huynh-Feldt epsilon correction
What value of the MANOVA should you report in most situations?
Pillai’s trace
For the F ratio to be reliable and valid, what assumptions must be met?
- Independence of observations
- The observations within each sample must be independent
- Interval/ratio level of data
- Normality
- Poplations must be normally distributed as determined by Shapiro-Wilk
- Homogeneity of variance
How do you minimise time-related variables?
- Add control group for comparison purposes
- Switch from a within-subjects to a betweenor matched-subjects design
- Control/limit time between testing
- Counterbalance order of presentation of conditions across participants
What are the key elements of an experiment
- Manipulation of the independent variable (IV) to create two or more treatment conditions (levels).
- Measurement of a dependent variable (DV) to obtain a set of scores for each treatment condition (level)
- Comparison of the DV scores for each treatment condition (level)
- Control of all other (extraneous) variables to ensure that they do not confound the relationship between IV and DV.
- Random assignment of participants to each condition so that the groups can be considered truly equivalent.
Definition
The alpha level used for each comparison
Test-wise error rate (αTW)
Distributions like this would violate which assumption?
Homogeneity
Definition
the ratio of the between group variance to the within group variance
F-ratio
Define
Internal validity
the extent to which a piece of evidence supports a claim about cause and effect, within the context of a particular study
If there are 4 time points, how many orthogonal contrasts are there?
k = 4
orthogonal contrasts = k - 1
Therefore, there are 3 orthogonal contrasts
What are two reasons for between treatment variance?
- Treatment effects: the differences are caused by the treatment(s)
- Chance: the differences are simply due to chance
What Shapiro-Wilk result suggests normality assumption is met
p > .05, shape is not significantly different from normal, this normality assumption is met
How do you report one-way independent measures ANOVA test results?
- F* (dfbetween, dfwithin) = value, p = value
i. e. F(2, 12) = 23.49, p < .001
With an F-ratio of around 1 what does that suggest? Why?
With an F-ratio of around 1 we would conclude that there is no treatment effect
Definition
A type of ANOVA used to determine whether three or more group means are different where the participants are the same in each group
One-way repeated-measures ANOVA
True or False:
Repeated-measures designs are powerful
True
Repeated-measures designs are powerful because they remove individual differences
η2 = .059 is what size effect?
Medium
In terms of the F-ratio for a repeated measures design, the variance between treatments (the numerator) does/does not contain any individual differences
In terms of the F-ratio for a repeated measures design, the variance between treatments (the numerator) does not contain any individual differences
During Post hic tests, if sample sizes are slightly different then use _________ procedure because it has greatest power, but if sample sizes are very different use _________
During Post hic tests, if sample sizes are slightly different then use Gabriel’s procedure because it has greatest power, but if sample sizes are very different use Hochberg’s GT2
Definition
the rejection of a true null hypothesis (also known as a “false positive” finding or conclusion)
Type I error
Definition
A test used to determine whether there are any statistically significant differences between the means of two or more independent (unrelated) groups
One-way independent measures ANOVA
Define
External validity
the validity of applying the conclusions of a scientific study outside the context of that study. Tt is the extent to which the results of a study can be generalized to and across other situations, people, stimuli, and times
Why is an ANOVA preferred over t-tests for over 2 groups?
Each time you run a hypothesis test, you run the risk of commiting a type I error
Define
Developmental research
A type of reseach used to assess changes over an extended period of time
True or False:
ANOVA tests only non-directional hypotheses
True
What do you use to calculate the effect size for a post hoc test?
Cohen’s d
d = mean difference / SD
True or False:
You should not perform planned comparisons as well as post hoc tests for a one-way repeated-measures ANOVA
True
True or False:
This is the results of an ANOVA
False;
This table relates to MANOVA rather than ANOVA
Definition
any variables that you are not intentionally studying in your experiment or test
Extraneous variables
What do you do if normality is violated in an ANOVA?
- If sample sizes are large and equal…
- ANOVA can handle normality violation
- If sample sizes are small or not equal…
- Transform your data
- Run a Kruskal-Wallis test as the nonparametric alternative to a one-way independent-measures ANOVA