Bedrock and GenAI Flashcards
What is Bedrock used for?
To create GenAI applications on AWS
Is Bedrock fully managed?
Yes
What is Amazon’s foundation model?
Amazon Titan
How many foundation models does Bedrock support?
At least seven including their own.
When you choose a foundation model in Bedrock, is it shared?
No, it makes a copy of the foundation model which is only available to you which you can further fine tune with your own data.
When using a foundation model in Bedrock, is your data ever sent back to train the model?
No. Your data is never used to train the model?
What is the playground in Bedrock?
A place for you to test a specific model based on your input. It helps you select your
Can you access Titan through an API?
Yes
What types of inputs does Amazon Titan support?
Image, Text, and multmodal
Can Amazon Titan be customized with your own data?
Yes
What are the pros and cons of smaller foundation models?
They are cheaper, but know less.
What is the maximum amount of tokens for Amazon Titan?
8K
What is a continued pre-training job in Bedrock?
It continuously trains your model on the newest data.
What is a fine-tuning job in Bedrock?
It is a one-time training job on your custom data.
Are all foundation models able to be fine-tuned or trained on custom data?
No
Where does custom data for fine-tuning jobs for Bedrock need to be stored?
In S3
What are hyperparameters?
They are configuration parameters
Where is validation data for a fine-tuning job stored?
In S3
Does fine-tuning require provisioned throughput?
Yes. This is expensive.
What does model fin-tuning do under the hood?
It changes the weight of the base foundation model.
What is instruction-based fine-tuning?
It improves the performance of a pre-trained model on domain specific tasks. It uses labeled examples that are prompt-response pairs.
What is continued pre-training?
This is also called domain-adaption fine-tuning. It makes a model an expert in a specific domain. E.g., ingesting all AWS documentation.
What is single-turn messaging?
Part of instruction-based fine-tuning.
What is multi-turn messaging?
Part of instruction-based fine-tuning. Good for larger context.