BiasWesley Flashcards
What type of bias occurs when a dataset favors a specific viewpoint, like only including customer queries about certain insurance policies?
Confirmation bias
If a chatbot is trained on data from several years ago and struggles with current customer queries, what type of bias is likely present?
Historical bias
What type of bias arises when the labels applied to customer query data are subjective, inaccurate, or too generic?
Labelling bias
A chatbot trained primarily on formal written language struggles to understand informal language. What kind of bias is this?
Linguistic bias
If a training dataset for a chatbot only includes customer queries from one demographic, what type of bias is present?
Sampling bias
What type of bias occurs when training data is chosen based on specific criteria instead of being randomly selected?
Selection bias
Define bias in the context of chatbot datasets.
A systematic error that can lead to unfair or inaccurate predictions.
Why is it important to address biases in chatbot datasets?
To ensure fairness, accuracy, and avoid perpetuating existing societal biases.
Give an example of how historical bias could negatively impact a chatbot’s performance.
The chatbot may not accurately understand or respond to current slang, trending topics, or changes in customer needs.
What are some general strategies for mitigating bias in chatbot datasets?
Use diverse datasets, carefully review and correct labels, and regularly audit the chatbot’s performance for bias.