Decision Trees

Question 1

(True or False) Decision trees can be used for both classification and regression problems.

Answer 1

True

Question 2

(True or False) Decision trees are not an ingredient of random forests (bagging) or xgboost (boosting) machine learning algorithms.

Answer 2

False

Question 3

Name given to the set of observations before first decision of a decision tree.

Answer 3

Roots

Question 4

Name given to the set of observations after last decision of a decision tree.

Answer 4

Leafs

Question 5

Name given to the decisions in a decision tree.

Answer 5

Branches

Question 5

Name given to the decisions in a decision tree.

Answer 5

Branches

Question 6

It is the approach that progresses from roots to leaves.

Answer 6

Greedy top-down-approach

Question 7

Pruning is used to avoid _____ .

Answer 7

Overfitting

Question 8

(True or false) Decision trees are pruned from root to leaf.

Answer 8

False. They are pruned from leaf to root always.

Question 9

(True or false) Pruning a tree will increase its apparent error rate for the training data.

Answer 9

True

Question 10

They prevent the tree from creating too small leafs.

Answer 10

Stopping rules