AIPI 540 Flashcards

AIPI 540: Deep Learning Applications

1
Q

What is deep learning?

A

Deep learning is a subset of representation learning, which is a subset of machine learning, which is a subset of AI

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Key concept of Deep learning is that?

A

it utilizes neural networks

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

The “Deep” in Deep Learning refers to the?

A

Refers to the number of layers through which the data is transformed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Deep Learning Algorithms Automatically discover and learn what?

A

Features from the data

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Deep learning is contradictory to machine learning in which way?

A

With Machine Learning features are hand-engineered vs being discovered by the deep learning algorithms

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What task are deep learning particularly useful for?

A

Image recognition, Natural Language Processing, and Complex decision-making

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Early AI Research started in

A

1943 with McCulloch & Pitts proposing of a simple model of neuron

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

When was the first artificial neuron published?

A

1957 by Rosenblatt

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

When was the first successful Neural Network developed

A

1958 Stanford Researchers Widrow & Hoff

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

When was the first and second AI Winters

A

1970’s and early 2000’s

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

When were the Bi-directional neural network research efforts revived?

A

1982 by CalTech Researcher Hopfield

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

When did three independent Groups develop Back-propagation?

A

1986

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

When was the first ImageNet competition created by Fei-Fei Li of Stanford University

A

2009

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Who won ImageNet in 2012 leading to widespread use of GPU’s and CNN Architectures?

A

AlexNet

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What year did Deep ResNet Architecture greatly advance performance?

A

2015

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

When to use a Neural Network?

A

Vast amounts of Training data
Very large number of Features -E.G. unstructured data
Complex relationships between features and the target
Low concern for explainability

17
Q

What are some issues with Neural Networks

A

Computationally expensive
very power hungry
difficult to train
difficult to interpret the outputs of deep neural networks
easy to overfit, particularly on small data sets

18
Q

What is the learning rate

A

the size of the steps that are taken to reach the minimum

19
Q
A