Estimation Flashcards
What methods can we use for estimation
- Method of Moments
- Maximum Likelihood
- REML
- Bayesian Methods
- Non-informative priors
- MC
- MCMC
- INLA
What is method of moments
In the method of moments we take sample moments and make those ‘equal’ to the theoretical moments from our model.
Maximum Likelihood
The likelihood can be thought of as the probability of getting the sample values given a set of parameters.
It is the joint distribution of the sample as a function of the
parameters
Restricted Maximum Likelihood (REML)
As is well known MLE in the Normal distribution produces a biased estimator for the variance (although it is unbiased asymptotically)
[Bias means that the expectation of the estimator is not equal to the true the value of the parameter]
One way around this problem is REML.
REML transforms the data/model so that the two parameters are in effect estimated separately and without bias
Method of moments process using variogram
- Calculate the sample variogram
- Choose a shape for the variogram
- Fit that variogram to the sample variogram by weighted least squares
How do we fit the theoretical variogram to the sample variogram
Least squares
Look at equation sheet for the formula
How do we discretise the variogram for least squares estimation
Divide it into bins
Options for weighting the bins of the variogram
- number of pairs in each bin
- the theoretical variogram
- equal weights
What is Hawkins and Cressie
An estimator for the sample variogram to solve the problems of ‘noise’
See equation sheet for formula