Domain 3: How to Govern AI Flashcards
AI Development Lifecycle (4 stages)
Plan
Design
Develop
Deploy
AI Dev Lifecycle - Plan stage
Business problem
Mission
Gaps
Data
Scope
Governance
AI Dev Lifecycle - Design stage: Data strategy
Data quality
Data gathering
Data wrangling/prep
Data cleansing
Data labeling
Data privacy
Scope considerations for AI Dev planning (3)
Impact
Effort
Fit
Data wrangling 5 V’s
Variety
Value
Velocity
Veracity
Volume
AI Dev Lifecycle - Design: Consideration
Desired accuracy, interoperability
Objective of data
Business problem
Compliance and business requirements
Constraints (time, money, expertise)
AI Dev Lifecycle - Development
Define the features of the model
AI Dev Lifecycle - Dev: Purpose of engineering features
Explains how the model reaches decisions
- Improve model performance
- Reduce computational costs
- Boost model explainability
Key principles of explainability
Fair
Privacy
Reliability
Robustness
Trust
Types of Impact Assessments (5)
Algorithmic
Privacy or Data Protection
Human rights, Democracy, and Rule of Law
Fundamental rights
Ethical
HUDERIA: Preliminary Context-based Risk Analysis (PCRA)
provide initial indication of context-based risk for human rights, freedoms and democracy
HUDERIA: Risk Index Number (RIN)
Gravity potential + Rights-holders affected = Severity
Severity * Likelihood = RIN
HUDERIA: Risk Index Number (RIN): Gravity
Gravity potential
1: moderate
2: serious
3: critical
4: catastrophic
HUDERIA: Risk Index Number (RIN): Rights-holders affected
Rights-holders affected
.5: <= 10k
1.0: 10k < x <= 100k
1.5: 100k < x <= 1m
2.0: >1m
HUDERIA: Risk Index Number (RIN): Likelihood
Likelihood
0: not applicable
1: unlikely
2: possible
3: likely
4: very likely
HUDERIA: Risk Index Number (RIN): Risk levels
Low: <=5
Moderate: 5.5-6
High: 6-7.5
Very high: >=8
HUDERIA: Risk Index Number (RIN): Relevant categories
Avoid
Reduce
Restore (rehab)
Compensate
Confusion matrix
Actual vs predicted
Actual
Pos Neg
Pos True Pos | False Pos
Predicted
Neg False Neg | True Neg
Risk classifications (4)
Prohibitive
Major
Moderate
Low-risk
Severity levels for risk (3)
Critical
Moderate
Marginal
Probability levels for risk (3)
Probable
Occasional
Improbable
Risk scoring
assigning a quantitative value to a risk
Severity x Probability
Operational controls
Assign system responsibilities
Conduct audits and reviews
Establish feedback mechanisms
Respond to feedback and appeals
Elevate issues within the org
Assign “kill switch” responsibilities
Three approaches to global AI regulations
Specific area of focus (ADM, sector)
Amend existing laws (Brazil)
Comprehensive regs (EU AI Act)