Week 5

Question 1

What is the definition of appoximation error?

Answer 1

Question 2

What is the universal approximation property?

Answer 2

Question 3

Are universal approximators always successful?

Answer 3

Question 4

What is the intuition of approximation error?

Answer 4

Question 5

What is the intuition of estimation error?

Answer 5

Question 6

What is the definition of estimation error?

Answer 6

Question 7

How to decompose exess risk into estimation error and approximation error?

Answer 7

Question 8

What is the trade-off between estimation and approximation?

Answer 8

Question 9

What is zero classification? Name an example.

Answer 9

Question 10

What is the definition of a finite and an infinite model?

Answer 10

Question 11

What is the upper-bound for zero-error classification with a finite model?

Answer 11

Question 12

Proof the upper-bound for zero-error classification with a finite model.

Answer 12

Question 13

1. What is the global upper-bound of the estimation error?
2. Proof it.
3. How to interpret it?

Answer 13

Question 14

What is the estimation error upper-bound for ERM with finite models and bounded cost function?

Answer 14

Question 15

Interpret the estimation error upper-bound for ERM with finite models and bounded cost function.

Answer 15