Advanced Optimization Solutions Flashcards
1
Q
Gradient descent with momentum
A
b is between 0 and 1
2
Q
Gradient descent with Adagrad
A
3
Q
Gradient descent with RMSProp
A
4
Q
Gradient descent with Adam
A
t is the iteration index
5
Q
Hessian of squared loss
A
6
Q
Point-Specific Hessian of Squared Loss
A
7
Q
Linear, SVM and logistic models with and without line search
A
