AI for security

Question 1

How do AI and cyber security relate?

Answer 1

AI for cybersecurity: AI is used to improve defensive cybersecurity

Malicious AI: Used to enhance offensive cybersecurity and malicious abuse of AI to manipulate capabilities of AI systems

Cybersecurity for AI: Cybersecurity is used to protect AI systems and users

Question 2

What is an impotant research direction covering all 3 dimensions?

Answer 2

Protecting AI systems and users from malicous AI using AI

Question 3

What is the purpose of AI for cybersecurity?

Answer 3

Improving security solutions and predict future attacker’s behaviour

Question 4

Name an example of AI-driven cybersecurity approaches

Answer 4

Automated cyber defense and cyber threat intelligence operations for prevention, analysis, detection and response to cyber threats and incidents

Question 5

What are the benefits of the AI-driven security approaches?

Answer 5

Less manual effort and less time consuming

Better cope with increasingly and interconnected modern environments

Learn weak signals unnoticed by humans

Question 6

What is the 5 stages of NIST syber cecurity framework?

Answer 6

Identify
Protect
Detect
Respond
Recover

Question 7

Where is anomaly detection used?

Answer 7

Across domains where identifying unusual patterns or deviations from the norm is crucial

Question 8

What is the purpose of malicious AI?

Answer 8

Expanding the cyber threat landscape

Question 9

What are the benefit of the approach of malicious AI?

Answer 9

Sophistication - more targeted
Speed - Automated
Scale

Question 10

Give an example of malicious abuse of AI

Answer 10

Adversarial machine learning

Trying to subvert existing AI systems to alter their capabilities

Question 11

What can an attacker do to a generic ML based system (7)

Answer 11

Insert sensor errors

Modify input image (digital attack)

Alter model weight (model poisoning attacks)

interfere outputs (Output attacks)

Hack learning algorithm (algorithm poisoning attack)

Poison training data (data poisoning attack)

Modify scene (physical attacks)

Question 12

Define AI-based cyber attacks

Answer 12

The application of AI-driven techniques in the attack process, which can be used in conjunction with conventional attack techniques to cause greater damage

Question 13

What is malicious use of AI

Answer 13

AI-based cyber attacks

Improving attacker’s capabilities

Question 14

Name some use cases for AI-based attacks (5)

Answer 14

next-generation malware (highly targeted, evasive)

Voice synthesis (imitating someone’s voice)

password based attacks (learn password distribution)

Social bots (tailored phishing messages)

Adversarial training (automated generation of adversarial examples)

Question 15

What is the purpose of cybersecurity for AI

Answer 15

Protecting AI systems and users against different types of threats

Question 16

What are the 2 main approaches on securing AI?

Answer 16

A narrow and traditional scope: The protection of AI systems against attacks across the AI lifecycle

A broad and extended scope: Holistic view on protecting AI systems through trustworthiness features

Question 17

What are some benefits of securing AI?

Answer 17

Contribute to a more secure, safe and fair design, development and operation of AI systems

More robust solutions when using AI for cyber security

Question 18

What are some challenges on securing AI?

Answer 18

1. Revisiting threat models of AI systems from both other AIs and conventional methods
2. Considering AI systems in the real world
3. Assessing the human factor
4. Concept drift: AI systems may evolve over time, thus security properties may degrade.
5. Interactions and trade offs between security and other AI trustworthiness principles