Exam 2 Flashcards
What can ANOVAs compare that t-tests cannot?
2 or more treatments or groups.
How is alpha defined?
It is the probability of making a type 1 error.
Why don’t we just do multiple tests?
What adjusts for this?
Because multiple tests create inflation and ANOVAs adjusts for this.
t-tests are to looking at mean differences as ANOVAs look at ___________.
What does ANOVAs determine?
ANOVAs look at the amount of overlap in variability and compare it to what is unique in the variability of each group. It determines if the groups are different from each other.
If overlaps are far enough from one another in an ANOVA, what does this mean?
There is a difference between the variance in the sample means.
Define Factor
It is the IV or the quasi-IV
What is quasi-independent?
Factors that are pre-existing like gender, ethnicity; etc
What is Levels?
Levels is the individual conditions or values that make up factor.
What are the 3 ways to apply the ANOVA to different research designs??
- Independent measures design
- Multiple Comparisons: Repeated measures design
- Factorial ANOVA: Studies that involve more than 1 factor
ANOVA Logic: What are we measuring in Total Variability?
Combine all scores into one general measure of variability
ANOVA LOGIC: What question are we answering in Between-treatment Variability?
-How much diff. exists between the treatment conditions and if it is bigger than what we expect by sampling error.
ANOVA LOGIC: What question are we measuring in Within Variability?
-How much difference to expect from random and unsystematic factors- or naturally occurring differences that exist with no treatment effect.
What are the 2 types of Variability?
1. Systematic Treatment Differences
- Random, Unsystematic Differences
• Systematic Treatment Differences: difference
between the sample learning performance
means is caused by the difference room
temperatures (between)
• Random, Unsystematic Differences: differences that exist even if there is no treatment effect (within0 – Individual differences – Experimental error
Write out formula for the following ANOVA notations:
i j k n N
• i = individual
• j = treatment condition
• k = number of treatment conditions
• n = number of scores in each treatment condition or Group size
• N = total number of scores in the entire study
– N = k(n)
In the ANOVA Structural model, each score can be broken in to 3 components.
Write it out.
The Structural Model
• Each score can be broken into three components
Score = grand mean + condition component + uniqueness
Identify the IV and DV:
Recall of verbal material as a function of level
of processing
– IV: Level of Processing (Counting, Rhyming,
Adjective, Imagery, Intentional)
– DV: Words Recalled
What is the end product of an ANOVA?
F-ratio
F = variance between/variance within
Each variance in the F-ratio is computed as:
ss/df
variance between treatments = ssbetween/dfbetween
variance within treatments - sswithin/dfwithin
Define “orthogonal”
Independent from one another and unrelated.
Variance amount attributed to group 1 is difference from group 2 and so on.
Define covariate
What’s the grouping variable after something is controlled for, such as someone’s major being accounted for.
Why don’t we just do multiple t-tests instead of ANOVAS?
To adjust for type 1 error inflation.
T or F: ANOVA is just T-test squared.
Why or why not?
True. If the ANOVA contains only 2 groups.
What can we conclude about the distance between variances?
If variances are far apart from each other, we can conclude there are significant differences.
If we are looking at the effect of room temperature on learning, what is the factor, levels, and DV?
The factor or IV is room temperature.
IV Conditions and the 3 diff. levels:
1) mu of 90 degrees
2) mu of 80 degrees
3) mu of 50 degrees
DV is learning.
If we reject the null hypothesis in an ANOVA what does this mean?
The treatment had an effect on the DV. At least 1 of the population is diff. from the other.
What is k?
Number of groups
What is x bar dot dot?
x..
mean of means or the Grand mean
= overall individuals for overall groups
What does it mean when the variances between the groups are difference but the MEANS are roughly the same?
Set 1: m1 -m3 = 20,30,35
Set 2: m1-m3= 28,30,31
ex) variance in g1 is 58.33 and g2 is 2.33.
mean 1 is 28.33 and mean 2 is 29.67
There is an overlap in set 2.
The range of set 1 is 15, range of set 2 is 3.
The first set of means is more variable than the 2nd set of means.
When looking at the F table, the top column is the ___________ and the left row is ________.
Top is numerator
Left is denominaor
What is the formula for post-hoc FWR? What does this formula show us?
1 - (1-alpha) subscript k-1
It is the error rate which shows how much the alpha has been inflated, instead of the standard .05.
What is the formula for post-hoc Bonferroni?
alpha/comparisons (all comparisons that can be made, refer to the star preston draws)
SStreatment is synonymous with
SSbetween
What is the formula for effect size, eta squared?
sstreatment (between)/ sstotal
What is MSbetween?
SSbetween/df between
What is MSwithin?
SSwithin/df within
How is the F calculated?
MSbetween/MSwithin
+SSbw, SSw, SSt
+DFbw, DFw, DFt
Conceptual: What are we trying to find when we calculate MSbetween (mean squared between)?
We are looking at the differences in the variability between group means.
Answering how much difference exists between each treatment condition.
If the difference we calculate is bigger than what would be expected due to just sampling error (the within treatment in ANOVA).
We compare the Group mean to the Grand mean.
Conceptual: What are we trying to find when we calculate MSwithin?
We are looking at the variability within each group.
We compare each individual mean (xij) to their own group. mean.
How much difference there is, and if it’s reasonable due to unsystematic differences or individual differences.
What is multiple comparison tests?
What are the 2 types?
Multiple comparisons tests are additional hypothesis tests done after an ANOVA to see exactly where the differences are.
- A priori - planned, test based on specific hypothesis (mu 1 = mu 2 but not equal to mu 3 = mu 4 = mu 5).
- Post-hoc - unplanned. All possible mean comparisons to hope the significant difference is found somewhere.
It indicates that all population means are not equal.
How many comparisons can be made between 2,3,4,5,6,7, 8 groups?
What is the pattern?
2 groups = 1 comparison 3 groups = 3 comparisons 4 groups = 6 comparisons 5 groups = 10 comparisons 6 groups = 15 comparisons 7 groups = 21 comparisons 8 groups = 28 comparisons
What does orthogonal mean?
It means independent. Equal group sizes, all groups are orthogonal and no overlap in variance
Our sample sizes are equal, therefore the groups are independent, so there are no overlaps in variance.
This means that any difference is due to the treatment and not the sample sizes.
What is the idea of a confidence interval?
“confidence intervals is to construct a range of values within which we think the population value falls.”
What type of tests do we run for an a priori test?
In an a priori, we run multiple independent t-tests to compare each groups since we are only comparing 2 groups to each other.
If we have a directional or a specific hypothesis before the ANOVA, we would run an a priori to run the tests based on our original hypotheses.
What information do we need in order to solve for MS?
We need to compute the Sum of squares AND the Degrees of Freedom.
What does the probability (p value) in an F test tell us?
It is the probability that the F value will be greater than the critical value.
What is a covariate?
It is a variable that we don’t look for but COntrol for.
How is ANOVA Structural model is related to regression?
They are identical in computation (3 components: grand mean, uniqueness, and treatment) in examining an assumption but organized differently.
Regression will just use dummy coding instead of ss, within variability for the diff. treatment conditions.
Computations: If we restructure what we’re doing into 3 components (treatment, uniqueness, grand mean), it replicates the individual score.
What do we analyze with an ANOVA?
*hint: overlap between…
Overlap between the groups and it’s uniqueness will tell us if the groups are different from one another
xij
each individual
x.j
each group mean
Interpret post-hoc in R:
What is ‘a’
What is ‘b’
What is ‘ab’
a = not different from each other
b= not diff. from each other but diff. from others
ab = not diff. from a or b, it is equal to both
Know how to “tree-out” and what that contrast means.
It is an orthogonal contrast…