Neural Networks

Question 1

Artificial neuron

Answer 1

*

Question 2

examples for activaiton functions

Answer 2

Question 3

two types of neural networks

Answer 3

*

Question 4

two useful properties of neural networks

Answer 4

• Universal approximation:
  
  • with enough neurons, a neural network can represent any nonlinear function
• compact representation:
  
  • in practice, a finite number of neurons is sufficient to imprement the nonlinear function

Question 5

regularizing Neural Networks

Answer 5

• Dropout algorithm
  *