Lecture 9 Flashcards
What is a type I error?
(alpha - related to significance level) When Ho is true but it is rejected, giving a false positive.
What is a type II error?
(Beta) when Ho is false but it is accepted, giving a false negative.
How can we control the number of type 1 errors?
By controlling out significance level alpha!
What are the two main groups of methods for accounting for multiple tests?
Adjustment of p-values and determining p-values
What is involved with adjustment of p-values?
Controlling family wise type 1 error rates (FWER)
Controlling false discovery rate (FDR)
What is involved with determination of p-values?
Permutation test
Define Per-comparison error rate in equation form.
PCER=E(V)/m
Define family-wise error rate in equation form.
FWER=P(V≥1)= 1-P(V=0)
Define False discovery rate in equation form.
FDR=E(V/R|R>0)*P(R>0)
Define Proportion of false positives
PFP=E(V)/E(R)
Which ‘rate’ is related to all tests?
FWER
What ‘rate’ is related to only rejected hypotheses?
FDR
Define single step procedures.
Equivalent adjustments are performed for all hypotheses
What are examples of single step procedures?
Bonferroni and sidak adjustments
Define stepwise procedures
Adjustments based not only on m but also on outcome of all the tests
Give examples of stepwise procedures
Benjamin and Hochberg adjustment