NLP Flashcards
1
Q
In political biases trails in NLP models - what method did they use for mapping mask filling to agreement score?
A
They had predefined positive and negative lexicons. They took the 10 highest probability of the tokens & summed them. If the result was bigger than 0.3 then the response was a strong agreement (and mirrored)