SUL Topic 6 - Neural Network Flashcards
Neural Network
A computational model that mimics the structure and function of the human nervous system
Biological Neuron Components
Dendrites, cell body, and axons
Perceptron
Basic unit of an artificial neural network that takes multiple inputs and produces a single output
Weight
Value assigned to each input representing its importance in the neural network
Activation Function
Determines the output of a neural network node based on the weighted sum of inputs
Three main layers of a neural network
Input layer
hidden layers
output layer
Deep Learning
Term used when a neural network has multiple hidden layers
Threshold Function
Activation function that outputs 0 or 1 based on a threshold
Sigmoid Function
Activation function that outputs values between 0 and 1, useful for probability predictions
ReLU
Activation function that outputs the input if positive, otherwise 0
Forward Propagation
Process of feeding inputs through the network to generate an output
Back Propagation
Method to adjust weights by propagating errors backward from output to input layer
Gradient Descent
Optimization technique used to minimize the cost function in neural networks
Stochastic Gradient Descent
Updates weights using a single sample at a time, speeding up convergence for large datasets
Supervised Learning
Training with input-output pairs to minimize error between predicted and actual outputs
