LLMs and Generation Flashcards

1
Q

Explain what is meant when an AI us described as super-autocomplete. Temp

A

Generative AI uses statistical probabilities and temperatures to ‘autocomplete’ the remainder of the sentence after every word

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is “context” and why result in better AI performance

A

Helps the AI understand what is trying to be achieved. It helps narrow the probabilities.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is “emergence” in the context of AI. Give Example

A

Large language models are able to perform qualitatively different tasks as they get larger e.g do maths

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Where does training data come from and what problems does this create?

A

Possible bias, data poisoning, privacy, uneven representation, needs updating

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is “prompt” engineering” and why is it undertaken?

A

Designing a prompt to help fine-tune the AI inputs for high-quality and relevant outputs.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Value of iteration and refinement in prompt engineering?

A

Helps to specify the requirements of the output of the AI to get a more helpful answer.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is the value of telling Generative AI your goal when writing a prompt?

A

Help fine-tune the output

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is the value of providing specific context in prompt engineering?

A

Help fine-tune the output

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is the value of including examples in prompt

A

Help fine-tune the output

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Could you use AI to create a prompt for itself? How could this work and would it be useful?

A

Yes

  • ask more
How well did you know this?
1
Not at all
2
3
4
5
Perfectly