Formal Model

Question 1

What are the 6-key point of the Formal Model? What is the loss function?

Draw the learning process.

Answer 1

see images

Question 2

Define the ERM paradigm and the training error.

Answer 2

look image

Question 3

ERM with inductive bias.

What is the advandage of using finite hypothesis classes?

What are the assumptions when we use finite hypothesis classes?

Answer 3

…

Question 4

(Simplied) PAC learning.

Informal description.

Theorem.

Theroem explanations.

Proof.

Answer 4

…

Question 5

What is PAC learnability? (Formal definition)

Answer 5

…

Question 6

What is sample complexity and what is its value for the PAC?

Answer 6

…

Question 7

What is Agnostic PAC learning? (informally)

What are its empirical and true error?

Answer 7

…

Question 8

What is the Bayes optimal predictor?

Answer 8

…

Question 9

Formal Definition of Agnostic PAC learnability.

Answer 9

…

Question 10

What is the general loss function?
general risk function?
general empirical risk?
What are some common loss functions?

Answer 10

…

Question 11

What is Agnostic PAC Learning (for generalized loss functions)?

Answer 11

…