C5W3 (Sequence Models And Attention Mechanism) Flashcards
What is Beam search?
Algorithm for sampling most likely output sentence from model
Input parameters for Beam algorithm?
B - Beam width
A - degree of normalisation
Why do you need to normalise Beam search?
Because otherwise Beam search will prefer shorter sentences
How to carry error analysis?(RNN)
Run model with “correct” and “actual” output.
If probability of “correct” is greater, then problem is in Beam search. Otherwise, in the model itself
Bleu score
Bilingual Evaluation Understudy.
Used to evaluate model’s performance against equally good sentences
What is attention models?
Improvement of regular RNN.
It has attention weights applied to the Encoder output. The weights are learned by another NN