LLMs and Generation Flashcards
Explain what is meant when an AI us described as super-autocomplete. Temp
Generative AI uses statistical probabilities and temperatures to ‘autocomplete’ the remainder of the sentence after every word
What is “context” and why result in better AI performance
Helps the AI understand what is trying to be achieved. It helps narrow the probabilities.
What is “emergence” in the context of AI. Give Example
Large language models are able to perform qualitatively different tasks as they get larger e.g do maths
Where does training data come from and what problems does this create?
Possible bias, data poisoning, privacy, uneven representation, needs updating
What is “prompt” engineering” and why is it undertaken?
Designing a prompt to help fine-tune the AI inputs for high-quality and relevant outputs.
Value of iteration and refinement in prompt engineering?
Helps to specify the requirements of the output of the AI to get a more helpful answer.
What is the value of telling Generative AI your goal when writing a prompt?
Help fine-tune the output
What is the value of providing specific context in prompt engineering?
Help fine-tune the output
What is the value of including examples in prompt
Help fine-tune the output
Could you use AI to create a prompt for itself? How could this work and would it be useful?
Yes
- ask more