Lecture 4 Flashcards
Model Comparison: Which model would you trust more?
R², AIC, and Model Fitting
Calibration in Models
Why Calibration is Needed
Parameter Sensitivity
Calibration Techniques
Measurement of Deviation
What are the key metrics used to measure deviation in model performance?
Mean Absolute Error (MAE)
What does it represent?
- MAE takes the absolute value of errors, treating all errors equally.
- RMSE squares the errors, penalizing larger errors more heavily.
Interpretation:
- MAE gives the average size of the error in the same units as the data.
- RMSE emphasizes larger deviations, making it more sensitive to outliers.
Mean Absolute Percent Error (MA%E)
What does it indicate?
Root Mean Square Error (RMSE)
what does it emphasize?
Allometric Relationships
Power laws describe how one variable changes as a power of another. They are fundamental in understanding relationships across a wide range of natural and human systems, from metabolic rates to city sizes and wealth distributions.
Automatic Calibration Algorithms
“minima” is desirable in this context because it represents the point at which the Residual Sum of Squares (RSS) is minimized.
- The global minimum is the point where RSS is minimized across the entire parameter space, resulting in the best possible model fit.
- A local minimum, however, might trap the optimization process if the algorithm converges there, leading to suboptimal parameter values and a less accurate model.
Nash-Sutcliffe Efficiency
Model Optimization
Efficiency and Model Usefulness
What is the purpose of calibration?
To adjust parameters to minimize the difference between model predictions and observed data.
What steps are involved in calibration?
- Choose initial parameter values.
- Iteratively adjust parameters to minimize errors.
- Evaluate the fit using metrics like R-squared and RMSE.
What is cross-validation?
A method that divides datasets into training and testing subsets for evaluation.
What is k-fold cross-validation?
A repeated cross-validation process that reduces bias and improves reliability.