C3W1 ML Strategy Flashcards
Key ideas how to improve performance
Collect more data
Diverse training set
Train longer
Try ADAM
Try bigger network
Try smaller network
Try dropout
Try L2 regularisation
Change network architecture (activation function, hidden units)
Precision and recall
Precision - (of all recognitions as cats, how many actual cats?)
Recall - what percent of all cats are correctly recognised?
F1 score
~Average of precision and recall
Harmonic mean
2 / (1/p + 1/r)
Optimising and satisfying metrics
Optimising - accuracy - the lower the better
Satisfying - running time (set threshold- less than specific amount)
You should have only one optimising metric
Two steps
- Define metric
- How to do well on the metric
Base optimal error
The best level of performance
How to achieve human level performance?
Get labeled data from humans
Gain insight from manual error analysis
Better analys of bias variance