Loss Functions

Question 1

nn.CrossEntropyLoss

Answer 1

• Combines both softmax and cross-entropy in a single, more numerically stable expression. CrossEntropyLoss requires raw, unnormalized values from the NN (also called logits).
• Equivalent to softmax + cross-entropy loss.