Initialization

Question 1

What is Initialization?

Answer 1

The process in which we set the initial values of weights

Question 2

What happens if you have an inappropriate initialization?

Answer 2

you end up with an unoptimizable model

Question 3

How do we initialize the weights?

Answer 3

1. Equal probability of being selected
2. Non linearity - sigmoid

Question 4

What is Xavier initialization?

Answer 4

or Glorot Initialization