DeepLearning-Introduction

Question 1

Factors leading to rise of deep learning.

Answer 1

1. Big Data
2. GPUs: parallelizable algorithms
3. New algorithms

Question 2

Perceptron

Answer 2

y= g(w_o + X*W)

Where g is a sigmoid function, X is in the input vector, W is the weight vector

Question 3

Examples of a non-linear sigmoid function

Answer 3

g(z) = 1/(1 +e^(-z))

tf. math.sigmoid
tf. math.tanh
tf. math.relu

Question 4

Why do we care about non-linear activation functions?

Answer 4

Introduces non-linearities into the network.