AI: Final Exam Flashcards
What are the 3 types of AI capabilities?
Learning, Perception & Cognition
What are the types of AI Learnings?
Supervised, Unsupervised & Reinforcement
What are the types AI Perception?
Vision, audio, speech and natural language
What are the types AI Cognition?
Regression, classification, recommendation, planning, optimization and pattern recognition.
AI into business
The push (tech to business) vs pull (business to tech)
Horizontal (similar across industries) vs vertical (unique to industry vertical)
What is Machine Learning?
the process of using mathematical models of data to help a computer learn without direct instruction.
Ill - posed problem because a variety of models can explain same data set
Overfitting vs Underfitting
Fundamental tension in machine learning due to optimization and generalization
optimization ( adjusting the model to best fit the training data)
Generalization (ensuring the model performs well on data it has never seem before)
Overfitting
algorithm has learned “too much” from the training data
Underfitting
algorithm has not sufficiently modeled relevant patters in the training data
Feature Leakage
features specified in the machine learning model leak information and allow system to “cheat”
How do you avoid future leakage?
Model should not have had access to any information about the test set, either directly or indirectly
What is the solution to feature leakage?
Split the data into 3 parts “training, validation and test sets”
What is another name for test set?
Holdout set. It should never be used to train the model
What is deep learning?
incremental, layer by layer approach in which complex representations are developed to map the input to output
How do we get an output from an artificial neuron?
2 steps:
1) calculate the weighted sum
2) applying the activation function
What are 3 commonly used activations functions in deep learning?
ReLU, Tanh, Sigmoid
When do we use ReLU?
ReLu is used for feedforward and convolution neuronal networks
When do we use Sigmoid or Tanh?
Used for Recurrent Neural Networks
What does a neural network use to update and optimize the weights connecting neurons across different layers?
Error Backprpgation
What is a key parameter in error back propagation?
Learning Rate