Neural Nets Flashcards
1
Q
What is the most common training algorithm for NN?
A
Backpropagation
2
Q
What does backpropagation enable?
A
It makes gradient descent feasible for multi-layer neural networks
3
Q
Failures of backpropagation
A
- vanishing gradients
- exploding gradients
- dead relu units
