Chapter 7 Overfitting and Underfitting: The cause of poor performance

Question 1

HOW CAN WE KNOW IF A MODEL IS OVERFITTING? P32

Answer 1

To understand this goal, we can look at the performance of a machine learning algorithm over time as it is learning a training data. If we train for too long, the error on the training dataset may continue to decrease because the model is overfitting and learning the irrelevant detail and noise in the training dataset. At the same time the error for the test set starts to rise again as the model’s ability to generalize decreases.