Path3.Mod1.f - Automated Machine Learning - Evaluate and Compare Models In ML Studio Flashcards

1
Q

DA BM, EM VE

  • ML Studio > AutoML Experiment > Overview Page - Two things this page shows you
  • ML Studio > AutoML Experiment > Models Page - What you can Explore and what you can View…
A
  • Review input Data Asset and summary of the Best Model
  • Explore Models that were trained (by algorithm names), with View Explanation for the best one, and Responsible AI Dashboard
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

CBD MFVI HCFD

Data Guardrails:
- Where they are located
- Three data guardrails auto-applied to classification models

A

Job Details > Data Guardrails tab. A training job has to complete first before you can view what guardrails were applied.

  • Class Balancing Detection - Imbalanced or underrepresented classes
  • Missing Feature Value Imputation - Provide values when missing (average, most common value, etc.)
  • High Cardinality Feature Detection - Reduce fields that appear to have high cardinality (nearly or always a random value)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Data Guardrails are applied when…

A

…Featurization is enabled for your experiment.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

P D A

Data Guardrails have three possible states

A
  • Passed: No problems, no action required
  • Done: Changes applied to your data, review changes made by AutoML
  • Alerted: An issue was detected and couldn’t be fixed. Review data to fix
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Where AutoML displays the Scaling and Normalization techniques applied during training and in what format

A

Models Tab > Algorithm Name column. If a technique is applied, it is listed in this format: <applied scaling and/or normalization techniques,...>, <algorithm name>

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

You can View Explanation for any trained model by selecting one of the trained models in the Overview tab and select the Explain Model subtab (T/F)

A

True. The explanation is an approximation of the model’s interprerability. This doesn’t go just for the Best Model/Top Pick. You can opt to see an Explanation and even Responsible AI for any Model per request.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly