Fundamentals of Machine Learning II (Not for Certification) Flashcards
What is deep learning?
Deep learning is an advanced form of machine learning that uses artificial neural networks with multiple layers to model complex patterns in data, mimicking the way the human brain processes information.
What is an artificial neural network (ANN)?
An ANN is a computational model inspired by biological neural networks, composed of interconnected layers of nodes (neurons) that process input data through mathematical functions to produce an output.
Why is it called “deep” learning?
The term “deep” refers to the multiple layers of neurons in a deep neural network, creating a deeply nested function.
What types of problems can deep learning be used for?
Deep learning can be used for regression, classification, natural language processing, and computer vision.
What is a neuron in a neural network?
A neuron is a single computational unit in a neural network that applies a mathematical function to its inputs and passes the result to the next layer based on an activation function.
hat is the role of weights (w) in a neural network?
Weights (w) determine how much influence each input (x) has on the output. They are adjusted during training to reduce prediction errors.
What is an activation function?
An activation function determines whether the output of a neuron should be passed to the next layer. Examples include ReLU, sigmoid, and softmax.
What is a classification problem in deep learning?
A classification problem is where a model predicts the probability of an input belonging to a certain class, such as predicting penguin species based on features.
How does a neural network predict class probabilities?
The output layer produces a vector of probabilities for each class using functions like softmax. The class with the highest probability is selected as the prediction.
What is the loss function in deep learning?
A loss function measures the error between predicted values (ŷ) and true values (y). The goal is to minimize this loss during training.
What is backpropagation?
Backpropagation is the process of adjusting weights in a neural network by propagating the loss backward through the layers to reduce error.
What optimization technique is commonly used to adjust weights in deep learning?
Gradient descent is commonly used, adjusting weights up or down to minimize the loss function by finding the direction of maximum decrease.
How are training data processed in neural network training?
Training data are batched into matrices and processed using linear algebraic calculations, which is why GPUs are used for deep learning tasks.
What is an epoch in the context of neural network training?
An epoch refers to one complete pass through the entire training dataset during the learning process, with weights being adjusted after each pass.
What is the softmax function?
Softmax is a type of activation function used in the output layer of a neural network for classification tasks. It converts output scores into probabilities for each class.