topics Flashcards
distribution for CI
t-distribution
distribution for minimal sample size
z-distribution
2E and E
- 2E = full range of CI
- E = half of CI range = margin of error
power
- probability of correct decision
- higher sample sizes yield higher power
influence of sample size
the same deviation from H0 with more data yields a lower p-value
bootstrap CI
- sample from the original dataset
- enlarging B will reduce the variation
bootstrap test
- sample from H0 distribution
- compare t-value of original data to surrogate T* values
- p-value is determined by proportion of T*-values exceeding the t-value of the data
sign test: test statistic
- number of observations that are different from m0
- binomial test is done on this outcome
wilcoxon signed rank test
- requires symmetric population
- one sample or (difference between) matched pairs (wilcox.test() with 1 argument)
- lose a lot of information but is really robust
paired sample permutation test:
- what is permuted
- what is logic behind this
- permute original (x,y) labels
- under H0 of no difference between distributions of X and Y within pairs, permuting the labels should not chsnge the distribution of T
how to test dependence in two paired samples
- pearson’s correlation test
- spearman’s rank correlation test
two paired samples tests
- sign test
- wilcoxon signed rank test
- uses wilcox.test() with 1 argument - permutation test
- t.test(x,y,paired=TRUE)
two independent samples tests
- mann-whitney test
- kolmogorov-smirnov test
- t.test(x, y)
mann whitney test
- based on ranks
- uses wilcox.test() with 2 arguments
kolmogorov-smirnov test
- tests in distributions are the same
- differences in histograms
- T - max vertical difference in summed histograms
one-way ANOVA
- NI experimental units
- I = 2 = two-sample t-test
- always right sided
SSa and RSS
- SSa: variance due to factor
- RSS: variance not explained by factor in the model
kruskal wallis test
- nonparametric anova
- based on ranks
- distribution of W under H0 = X^2(I-1)
independent samples permutation test
- what is permuted
- what is logic behind this
- 1way ANOVA
1. group labels are permuted
2. permutation of groups should not affect group means if there is no effect
two way ANOVA
- NIJ experimental units
- main and interaction effects are tested
- I + J + 1 linear restrictions: treatment and sum parametrizations
F statistic
- always right sided
- explained variance/unexplained variance
interaction plot
interaction shows up as nonparallel curves
testing interaction
- model that includes interaction –> only significance of interaction effect is relevant
- model without interaction –> additive model. check for presence of main effect
block designs in 2way anova
- randomized block design
–> block = variable not of interest
–> dont look at significance of block variable in output - repeated measures
–> block = ID
–> exchangeable case: errors within a single unit are exchangeable, meaning that ordering is irrelevant
–> lack of exchangeability makes the block design invalid - friedman test
–> nonparametric for 2 designs above
block designs for random effects
- crossover design
–> 2 outcomes per experimental unit (paired samples)
–> apply treatment in opposite orders between conditions
–> treatment, learning, and sequence effects - split plot design
–> 2 treatment factors (independent samples)
–> subplot and whole plot
- to get p-values, anova(reduced model, full model)
- (1|f) for random effect block
unbalanced design
- order of variables in the model matters
- variable of interest goes last
- otherwise, p-values are unreliable
difference RBD and split-plot design
RBD:
- 1 level of blocks
- fixed effects
SPD:
- 2 levels of (randomized) blocks (whole and subplots)
- mixed effects
fixed and mixed designs
fixed
1. one way ANOVA
2. two way ANOVA
3. randomized block design
4. repeated measures block design
mixed
1. crossover design (paired)
2. split-plot design (independent)