Introduction to Machine Learning

Question 1

Which of the following statements is valid for an overfitted model? (Multiple
choice)
a) High training error, low test error
b) Low training error, high test error
c) Usually, some weights are high
d) Usually, all weights are low

Answer 1

b) Low training error, high test error

c) Usually, some weights are high

Question 2

Given the below ROC plot constructed for two models (Random Forest in red,
Logistic Regression in Green). Which of the models (or random guessing)
performs best? (Look on picture in PDF file)

a) Random Forest
b) Logistic Regression
c) Random guessing

Answer 2

a) Random Forest