GenAI Flashcards
What are some AI use cases?
Creating new content such as text, images, videos, code, 3D renderings
Examples include writing articles, generating images, and producing video content.
What is a risk associated with AI use?
Hallucination - algorithms produce outputs that aren’t real or don’t match training data
This can occur due to data bias, misinformation, and inaccurate training data.
How can GenAI be weaponized?
Creating compelling content for phishing, learning coding, malicious script generation, intelligence gathering
Threat actors may use GenAI for various malicious activities.
What are examples of technical attacks against live running systems?
Adversarial machine learning attacks, Gen AI system attacks, supply chain attacks
These attacks aim to modify AI behaviors or bypass restrictions.
What should organizations consider before using GenAI?
Analyze AI usage, rethink data privacy, training data, employee awareness, evolving regulations
Rushing into AI can lead to costly mistakes.
What risks do deepfakes pose?
Coerce and influence, defraud, unauthorized account access
Deepfakes can manipulate individuals or systems for malicious purposes.
What is poisoning in the context of AI?
Modify AI model behavior by altering training data
Techniques include gaming prompts and code injection.
What are key attributes of Biden’s Executive Order on AI?
Ethical use framework, impose restrictions on high-risk AI, transparency requirements, regulatory authority
Aims to protect consumers and address algorithmic discrimination.
How can GenAI benefit an InfoSec program?
Content creation, behavior prediction, knowledge articulation
Applications include generating case descriptions and predicting privacy risks.
Fill in the blank: The process of modifying AI models by altering training data is known as _______.
poisoning
This can involve various attacks aimed at manipulating AI outputs.
True or False: Rushing into AI implementation can lead to costly mistakes.
True
A thorough analysis is required before adopting AI technologies.
List some malicious uses of GenAI.
Spear phishing, malicious script generation, intelligence gathering, malware creation
These uses can significantly impact security and privacy.
What is a major consideration regarding employee training in organizations using GenAI?
Awareness of AI implications and risks
Employees need to understand how to safely interact with AI technologies.
