Bayesian Analysis Flashcards
Other than Linear, GLM, Logistic, there is another way to estimate parameters, which is?
Bayesian Analysis
Bayesian analysis method is
Treat unknown var as a random var, use prior distribution
How does prior dist work?
It combine the distribution and the prior dist of the parameter
What is posterior mean?
Weighted average of prior mean and MLE
Relationship between weight of MLE vs amount of data
Increase, increase
Relationship between weight of prior mean vs δ
increase, increase
Posterior mean (E(λ|D)) formula?
hint: λ|D ~ Dist Type ( α, δ)
α/δ
λ|D ~ Dist Type (α, δ) is?
Prior dist
What happen if var in prior dist decrease?
Become more relevant prior info
What is diffuse/non-informative prior?
letting both α and δ go to 0 and mean unchanged and var is very large
what does conjugate prior leads to?
posterior having the same type of dist as prior
Predictive distribution is
To predict the next one, so n+1
PDF of predictive dist
Look at fromula sheet the pareto dist,
misal: first parameter a, second parameter is b
so, [a times b^a]/[b + x]^a + 1
Predicitve mean formula?
use the pareto dist formula sheet, b/(a-1)
Bayesian estimate loss function
Diff between true val and estimate, choose that minimize the loss function