Quiz - 23/24 Flashcards
If the accuracy is on the training set is high, but the accuracy on the test set is low, which of the following strategies are reasonable?
- Use a larger training set
- Increase regularisation
- Increase dropout
What datasets are suited for kernel methods?
Datasets with small n and large p
Which of these is the best tool to decide which threshold to use on a Logistic Regression binary classifier?
ROC
Which of the following statements are correct?
- GD is guaranteed to converge to global or local min.
- Mini-batch size has no influence on convergence speed.
- Learning rate is high, conv. will be faster.
- Learning rate high, GD might overshoot.
3, 4
What does a high value of logit mean in logistic regression
- Observation is far from decision boundary.
- Likelihood for the observation to belong to class 1 is high.
What is a unit?
A unit is a differentiable function.
What is an artificial neuron?
A linear combination of i/p followed by an activation function.
When is a neural network ‘deep’
A neural network is deep if it is made of, at least, 2 hidden layers with non-linear activations.