Resampling Flashcards
1
Q
Test error
A
The test error is the average error that results from using a statistical learning method to predict the response on a new observation, one that was not used in training the method.
2
Q
Training Error
A
In contrast, the training error can be easily calculated by applying the statistical learning method to the observations used in its training.
3
Q
Which error dramatically underestimates the other?
A
Training error to Test error
4
Q
Training- versus Test-Set Performance
A
5
Q
Validation-set approach
A
6
Q
Drawback of Validation set approach
A
7
Q
K-fold Cross-validation
A
8
Q
K-fold Cross-validation in detail
A
9
Q
The Bootstrap
A