W6 Neural Networks Flashcards
1
Q
What is neuron(node), structure?
A
2
Q
What is Layer, structure?
A
3
Q
What is Neural Network(Multi Layers), structure?
A
4
Q
Activation function cases and corresponding types for Last Layer activation?
A
5
Q
Supervised learning on NN?
A
6
Q
Back propagation and correct dimension construction, write down!
A
7
Q
Initialization?
A
Random, not to big!
8
Q
Activation and loss functions, all
A
Activation functions: linear, ReLU, sigmoid, softmax
Loss functions: hinge, negative log likelihood (NLL a.k.a. cross-entropy), quadratic (mean squared)
