Introduction to Language Models Flashcards
1
Q
Define corpus
A
It determines the language model’s vocabulary and what words it can generate
2
Q
What is the corpus like for LLM (Large language Models)?
A
The corpus is a combination of texts from different sources such as chat rooms, Wikipedia, novels, and more