Hypothesis Testing and Bayes Factor Flashcards
What is the null/alternative hypothesis in a one sided test?
H0 : θ ≤ θ0
H1 : θ > θ1
What is the null/alternative hypothesis in an at least one simple hypothesis test?
H0 : θ = θ0
H1 : θ ≠ θ0
How do you perform a one sided test?
Compute the two quantities:
- P(H0|x1,…,xn) = integral(-inf to θ0) π(θ|x1,…, xn) dθ
- P(H1|x1,…xn) = integral (θ1 to inf) π(θ|x1,…, xn) dθ
Accept hypothesis with greater probability
In a one sided test of a normal model with known variance, when is H0 accepted?
Φ( (c-a) / b ) ≤ 0.5
How do you perform an at least one simple hypothesis?
if c ∈ [a ± Z(α/2)*b] accept H0
Give the Bayes factor for model selection?
B = P(x| M1) / P(x|M2)
where P(x|Mi) = integral(over θi) P(x| θi , Mi) * π (θi|Mi) dθi
When does the Bayes factor become substantial evidence?
3 < B
Give the Bayes factor for hypothesis testing?
B = [P(H1|X) * P(H0)] / [P(H0|X) * P(H1)]
Give the formula for BIC
−2 log L(θˆ|x) + p log n
Given two models, based on BIC values which model should be taken?
The model with lower BIC