Essentials

Question 1

What is the formula for the entropy of a discrete probability distribution?

Answer 1

Question 2

What is the formula for KL-divergence for two probability distributions?

Answer 2

Question 3

What is the formula for the entropy of a continuous probability distribution?

Answer 3

Question 4

What is the formula for the KL-divergence of a continuous probability distribution?

Answer 4

Question 5

What is the entropy of a Gaussian Distribution?

Answer 5

Question 6

What is the entropy of a d-dimensional Gaussian distribution?

Answer 6

Question 7

What is the KL-divergence between two d-dimensional multivariate Gaussian Distributions?

Answer 7

Question 8

What is the Wasserstein difference for two multivariate Gaussian Distributions?

Answer 8

Question 9

What is the cross entropy error for a binary classification task?

Answer 9

Question 10

What is the Gaussian Distribution equation?

Answer 10

Question 11

What is the multivariate Gaussian Distribution equation?

Answer 11

Question 12

For softmax, what is Prob(i)?

Answer 12

Question 13

For softmax what is log Prob(i)

Answer 13

Question 14

What is the equation for the gradient using softmax?

Answer 14

Question 15

What is the true value (V*) of the current state?

Answer 15

Question 16

What is the formula for Q*(s,a)?

Answer 16

Question 17

What is the formula for number of weights per filter?

Answer 17

(filter width) x (filter height) x (input depth) + 1 (for bias)

Question 18

Number of neurons in this layer?

Answer 18

(output width) x (output height) x (depth), width= ((input width - filter width)/stride)+1

Question 19

Number of connections into the neuron’s in a layer?

Answer 19

(num neurons) x (connections per neurons / filter wights - bias)

Question 20

Number of independent parameters?

Answer 20

(num filters) x (num weights)