1: Giving Computers the Ability to Learn From Data Flashcards
Three types of machine learning
Unsupervised, Supervised, Reinforcement Learning
What’s the main goal in supervised learning?
To learn a model from labeled training data that allows us to make predictions about unseen or future data.
What are the two main subcategories of supervised learning?
Classification - output is label and regression - output is continuous value
What is the goal of classification?
To predict the categorical class labels of new instances based on past observations. Those class labels are discrete, unordered values that be understood as the group memberships of the instances.
Describe regression analysis.
We are given a number of predictor (explanatory) variables and a continuous response variable (outcome), and we try to find a relationship between those variables that allows us to predict an outcome.
What’s the goal of reinforcement learning?
To develop a system (agent) that improves its performance based on interactions with the environment. The current state of the environment typically also includes a so-called reward signal (related to supervised learning). However, the feedback is not the correct ground truth label or value, but a measure of how well the action was measured by a reward function. Through the interaction, an agent can then use reinforcement learning to learn a series of actions that maximizes this reward via an exploratory trial-and-error approach or deliberative planning.
Describe reinforcement learning diagram:
Agent – state –> Environment – Action –> && – Reward –> Agent
What are two examples of unsupervised learning?
Clustering and Dimensionality Reduction for data compression.
Describe the four stages in a typical workflow diagram for using machine learning in predictive modeling
1) Preprocessing (Feature Extraction and Scaling, Feature Selection, Dimentionality Reduction, Sampling)
2) Learning (Model Selection, Cross-Validation, Performance Metrics, Hyperparameter Optimization)
3) Evaluation
4) Prediction