Module 6 Flashcards
AI adoption generally falls within one of two broad categories, name them
- To perform an existing function in a new way
- To accomplish a new process that has not been done or was not possible before AI
When using AI to perform an existing function in a new way, what laws and regulations would it have to adhere to?
- Safety standards
- Software liability
- Consumer protection requirements
- Data retention and disclosure rules
- Any other existing frameworks it would otherwise be accountable under if the work were conducted manually by a human
List 3 important questions that AI has raised in the context of law and regulation
- How do the principles and protections of copyright laws apply to AI?
- Can the output of AI be considered original and therefore warrant copyright protection?
- How much human intervention/participation is necessary to meet the threshold of invention or development that can be patented? Where is the line and how do we measure it?
What issues have been raised in relation to how the principles and protections of copyright laws apply to AI?
Data scraping and collection practices leveraged to train generative AI systems have already been putting pressure on our understanding and expectations around intellectual property protections
What decision was recently made in relation to AI and patents in the US?
A recent U.S. federal court decision determined AIs cannot be listed as “inventors” for the purposes of obtaining a patent
What laws in the US will have to be interpreted to determine how and when they apply to AI technologies?
Related to employment:
- Title VII
- EEOC regulations
Related to consumer finance:
- Equal Credit Opportunity Act
- The Fair Credit Reporting Act
- SR 11-7
OSHA’s guidelines for robotics safety and “hazard analysis”
The Food and Drug Administration’s systemic approval processes for software as a medical device
What is SR 11-7?
A regulatory standard set out by the U.S. Federal Reserve Bank that gives guidance on model risk management
A joint statement was published by the FTC and other US agencies clarifying that existing legal authorities apply to automated systems and innovative new technologies. Which authorities did they list?
- The Consumer Financial Protection Bureau
- The Department of Justice’s Civil Rights Division
- The Equal Employment Opportunity Commission
- The Federal Trade Commission
What laws in the EU will have to be interpreted to determine how and when they apply to AI technologies?
- European Union’s Digital Services Act
- Local intellectual property and competition laws
- Product safety laws
Provide 2 examples where the EU Digital Services Act overlaps the GDPR with regard to transparency
- Recommender systems, which is ML that recommends products: online platforms should ensure users are informed about how recommender systems impact the way information is displayed, and how and what information is presented
- Online advertising: recipients should have information directly accessible from the online interface where an ad is presented, such as parameters used for determining why an ad was directed to them (the logic used and whether it was based on profiling)
When was the GDPR enacted?
May 2018
What is the subject of Article 22 of the GDPR?
Automated decision-making
When does Article 22 of the GDPR apply?
Where there is an impact for individuals that might be adverse or material
What is the requirement of Article 22 of the GDPR?
The data subject shall have the right not to be subject to a decision based solely on automated processing, including profiling, which produces legal effects concerning him or her or similarly significantly affects him or her
Describe the prohibition on automated decision-making in Article 22 of the GDPR
- There is a general prohibition on automated decision-making that can have a serious effect on an individual
- Some exceptions exist, for example where there is the fulfilment of a contract or explicit consent or necessity, but generally, the prohibition is pretty broad
- Not easy to understand what a significant effect might be, and they are evaluated on a case-by-case basis
- We are still trying to understand through court cases and how it is applied within different organizations
What are the challenges in implementing Article 22 of the GDPR?
- Getting explicit consent
- Data Subject Rights
- Automated decision-making that requires a manual review of the AI decision
Describe how getting explicit consent may be challenging, in the context of Article 22 of the GDPR
For GDPR compliance, there must be explicit, freely given and informed consent; and you must have an option to opt-out
- Where you are going to get that consent, and where will individuals be able to opt-out
- What is the context of the decision – you have to provide broad interpretation of fairness, lawfulness and transparency to ensure the data subject knows they are talking to a chatbot or robot, so they are fully aware of the implications of continuing on and providing personal information
Describe how data subject rights may be challenging, in the context of Article 22 of the GDPR
How are you going to enforce accuracy, correction and right to erasure
- If you remove or correct the data from the training set, right now the only way to correct the model is to have the model go through re-training
- AI models are not set to dynamically update their inference based on new training data without going through a formalized training process
Describe how automated decision-making that requires a manual review of the AI decision may be challenging, in the context of Article 22 of the GDPR
- The reviewer must be competent with the AI technology to know what to look for and make an accurate decision of whether or not the AI decision needs to be overturned
- If the AI is a black box, then it makes it very difficult for anyone to honor the automated decision right to review the outcome, they don’t understand how the AI came to that decision
What is the process of redress?
A way for data subjects to register a formal complaint or request a review of an automated decision
What is the subject of Article 25 of the GDPR?
DPIAs of high-risk processing
The current draft of the EU AI Act includes a requirement to perform what assessment?
AI conformity assessment
What does the requirement to perform an AI conformity assessment in the EU AI Act depend on?
The risk to health, safety and fundamental rights of individuals
In the EU AI Act, can an AI conformity assessment be required when there is no personal information being processed?
Yes