Domain 2 Flashcards
Understanding AI Impacts on People and Responsible AI Principles
What are the OECD AI Principles?
- Inclusive growth, sustainable development and well-being
- Human centered values and fairness
- Transparency and Explainability
- Robustness, safety and security
- Accountability
Give examples of documented AI ethical considerations.
- CNIL
- OECD AI Principles (2019)
- 2021: White House Office of Science and Technology Policy Blueprint for an AI Bill of Rights
- UNESCO Principles
- Asilomar AI Principles
- CNIL AI Action Plan
- IEEE Initiative on Ethics of Automomous and Intelligent Systems
Common principles
- Data minimization or collection limitation
- Use limitation
- Safeguards/ security
- Notice/ openness
- Access/individual participation
- Accountability
- Purpose specification
- Data quality and relevance
An organization is deploying an AI system to assist with hiring decisions. During the initial testing phase, the system exhibits bias against certain demographic groups, raising ethical concerns. What should the organization do to ensure fairness and accountability in the development and use of the AI system?
Options:
A. Focus solely on improving the accuracy of the AI model through additional data.
B. Outsource the entire project to a third-party AI vendor.
C. Develop a cross-functional and demographically diverse oversight body to monitor and address issues related to bias and ethics.
D. Rely on the AI vendor’s documentation and guidelines without internal oversight.
C. Develop a cross-functional and demographically diverse oversight body to monitor and address issues related to bias and ethics.
An organization plans to implement an AI-powered facial recognition system for security purposes. During initial planning, concerns are raised about privacy risks, potential misuse, and compliance with regulations. What is the most appropriate next step for the organization?
Options:
A. Proceed with deployment and address issues as they arise through user feedback.
B. Focus exclusively on technical testing to ensure the AI system functions correctly.
C. Assess whether the organization has appropriate policies and procedures in place to manage the associated risks before deployment.
D. Delegate responsibility for compliance and risk management entirely to the AI vendor.
C. Assess whether the organization has appropriate policies and procedures in place to manage the associated risks before deployment.
Who may be affected by core risks and harms posed by an AI system?
- individuals
- groups
- society
- companies/institutions
- ecosystems
Bias types
- implicit bias
- sampling bias
- temporal bias
- overfitting to training data
- edge cases and outliers
What is an example of temporal bias in an AI system?
Options:
A. An AI model trained on outdated data fails to recognize new slang in a sentiment analysis task.
B. An AI system gives preference to one demographic group over another due to an imbalanced dataset.
C. An AI-powered hiring tool consistently favors male candidates for leadership roles.
D. An AI chatbot struggles to understand dialects from different regions.
A. An AI model trained on outdated data fails to recognize new slang in a sentiment analysis task.
Temporal bias
This occurs when an AI system is based on data that becomes outdated over time, leading to decreased accuracy and relevance.
Noise is an example of what kind of bias?
Edge cases
Examples of Individual harms
- bias and discrimination
- Privacy concerns
- economic opportunity and job loss
Part 1:
An AI-powered hiring system rejects a qualified candidate for a managerial position. After an investigation, it is found that the algorithm disproportionately favors candidates from certain universities, leading to an unfair disadvantage for others. What type of individual harm does this scenario represent?
Options:
A. Discrimination in employment and hiring
B. Discrimination in credit approval
C. Discrimination in housing applications
D. Discrimination in education opportunities
A. Discrimination in employment and hiring
What should the organization do to mitigate employment and hiring discrimnation and ensure fairness in its hiring process?
Options:
A. Regularly audit the AI system for bias and ensure the training data is representative of diverse educational backgrounds.
B. Disable the AI system and revert to manual hiring decisions.
C. Focus solely on increasing the speed of the AI’s decision-making process.
D. Outsource the hiring process to an external recruitment agency.
A. Regularly audit the AI system for bias and ensure the training data is representative of diverse educational backgrounds.
What group harms may be posed by an AI system?
- facial recognition
- mass surveilance
- civil rights
- deepening of racial and socio-economic divides
Which of the following is NOT considered a group harm posed by an AI system?
Options:
A. Facial recognition leading to racial profiling
B. Mass surveillance disproportionately targeting specific communities
C. Denial of a loan due to biased credit scoring algorithms
D. Deepening of racial and socio-economic divides
C. Denial of a loan due to biased credit scoring algorithms