Prompting

Question 1

Fine Tuning

Prompt Engineering

Answer 1

Crafting an input prompt. Trial-and-error process. Helps define which training data should be used to formulate the response.

Question 2

Key Elements of Context

Answer 2

1. Persona/Role
2. Purpose
3. Clear/Precise
4. Concise
5. Specific
6. Details
7. Examples

Question 3

Persona / Role

Answer 3

Works best when:
* Quality of answer is subjective.
* You’re trying to emulate a specific style.

Question 4

Purpose

Answer 4

Define the purpose of the prompt:
* Tone, e.g., funny, professional, casual?
* Format: paragraph, bulleted list, essay, code, etc.
* Audience: who is this for?

Question 5

Clarity / Precision

Answer 5

Get rid of unnecessary information, jargon, confusing phrases, or mistakes.

They can lead AI down the wrong path.

Question 6

Conciseness

Answer 6

Less words –> less tokens –> less cost.

Question 7

Chain of Thought Prompting

Answer 7

Request AI show its thought process (or provide the thought process in the prompt) as it solves a given problem. This technique forces an AI to reason about a problem and solve it in a way a person would, by breaking it down and solving it step-by-step. Also, by asking the AI to show us its thought process, we can identify where something went wrong if the AI were to give an incorrect answer. Use “show me your thought process” or something similar in the prompt.

Question 8

Use Cases for Chain of Thought Prompting

Answer 8

• solving multi-step/complex problems requiring logical reasoning
• addressing tasks that require logical deduction
• solving mathematical or analytical challenges
• explaining complex concepts or processes

Question 9

Complex Tasks

Answer 9

Avoid making assumptions. Instead, break down complex tasks into simple sub-problems with a logical order and relationships.

• Improves understanding: allows AI to focus on one task at a time, reducing the thought processing required and increasing accuracy.
• Reduces errors: the step-by-step nature of this technique facilitates error detection and correction during task execution.
• Better accuracy: clear instructions for each subtask ensure the AI applies appropriate logic and principles, improving overall accuracy.
• Better logical flow: A structured, step-by-step approach maintains a coherent and understandable flow in problem-solving.

Question 10

Iteration

Answer 10

Trying multiple prompts until you get an adequate response.

Question 11

Specificity

Answer 11

Include specific limitations or requirements. However, avoid too much information as it may confuse the AI or cause it to focus on less important aspects of your request.

Question 12

Details & Context

Answer 12

Include any details essential to understanding the request, such as historical context or related concepts.

Example: lines of code and error message.

Question 13

Examples

Answer 13

Adding examples clarifies what you mean and gives the AI a baseline to work from.

Question 14

Types of Prompting

Answer 14

1. Zero Shot
2. One Shot
3. Few-Shot

Question 15

Zero-Shot Prompting

Answer 15

No examples provided. Use for simple tasks where answer is straightforward.

Question 16

One-Shot Prompting

Answer 16

One example provided. Use when trying to specify specific format, context, or style.

Question 17

Few-Shot Prompting

Answer 17

Allows a model to learn from a very small number of examples or “shots” (typically 2-5) for a new task. Examples are provided directly in the prompt or input to the model, rather than through additional training.

Does not modify the underlying model weights or architecture. Fast to implement and flexible to adapt to new tasks or classes on the fly. Can be integrated with fine-tuning for better results. Valuable in scenarios where obtaining large labeled datasets is expensive, time-consuming, or impractical. Example: facial recognition, diagnosing rare diseases, or translation for low resource languages.

Question 18

Retrieval Augmented Generation (RAG)

Answer 18

Combines old and new data, blending different bits of information to generate better answers. Can use fresh data in real-time to supplement training data. This means AI can give us more accurate responses to our questions, even if they’re about recent events or custom data.

Either complex, API-based or uploading docs to chatbot.

Question 19

RAG Components

Answer 19

1. Retriever Model - processes the query by converting it into computer-understandable format (numerical) and searches the knowledge base to find the most relevant documents.
2. Knowledge Base - repository of documents, articles, research papers, etc. to supplement training data.

Question 20

RAG Steps

Answer 20

1. Query
2. Retriever Model searches for relevant text in Knowledge Base
3. Retriever Model adds relevant text to Query
4. LLM generates a response.

Question 21

Benefits of RAG

Answer 21

1. Precise, reliable answers from up-to-date data.
2. Tailors AI responses for personalized information.
3. Information can be instantly updated without retraining.
4. Saves time for users and business.
5. Improves user satisfaction due to accurate, relevant responses.
6. Can ask AI to point out where it found answers/details.

Question 22

Fine Tuning

Answer 22

Process of taking a pre-trained model and further training it on a smaller, targeted dataset to adapt it for specific tasks, domains/industries, or company needs, e.g., medical research, legal analysis, customer support. Leverages the general knowledge and skills of a large, powerful model and applies them to a specific field or objective. Reduces training time and computational resources compared to training a model from scratch. There are different types of fine tuning.

Question 23

Benefits of Few-Shot Prompting

Answer 23

1. Fast to implement
2. Slight latency
3. Flexible to adapt to new tasks; rapid prototyping
4. Personalization
5. Doesn’t require a lot of data
6. Can be integrated with fine-tuning for better results.
7. Minimal maintenance

Question 24

Downsides of Few-Shot Prompting

Answer 24

1. Slightly higher ongoing cost (longer prompts)
2. Lower accuracy (less examples, may not be up-to-date)
3. Worse for complex tasks
4. Slight latency

Question 25

When Few-Shot Prompting is Valuable

Answer 25

Scenarios where obtaining large labeled datasets is expensive, time-consuming, or impractical. Quick adaptation to new tasks; rapid prototyping; personalization; rare scenarios.

Ex: facial recognition, diagnosing rare diseases, or translating low res

Question 26

When RAG is Valuable

Answer 26

Question-answering systems/chatbots w/ access to specific Knowledge Basis; content-generation w/ factual accuracy; summarization requiring external information; tech support w/ product docs.

Question 27

When Fine Tuning is Valuable

Answer 27

Specialized chatbot or virtual assistant; domain-specific text generation; domain-specific sentiment analysis; customized summarization; translation.

Question 28

Downsides of RAG

Answer 28

1. Increased latency due to retrieval
2. Medium training cost
3. Medium implementation speed
4. Must maintain Knowledge Base
5. Medium accuracy

Question 29

Downsides of Fine Tuning

Answer 29

1. Requires lots of data (100K+)
2. Must adjust model weights
3. Slower speed to implement
4. Higher training cost
5. Periodic retraining