Neural networks Flashcards
What is a neural network?
A set of neurons connected by directed weighted edges
What is a neuron?
A fundamental processing element
What is a dendrite?
A set of inputs
What is an axon
A single output
What is a synapse?
A set of weights
How does a neural network work?
If the sum of inputs >= threshold decided, then the neuron is fired
What does a positive weight mean in a neural network?
Encourages a network to fire
What does a negative weight mean in a neural network?
Prevents a neuron from firing
What is an epoch?
The entire training set fed into the neural network
What is the training value?
The value that we require the network to product
What is the learning rate?
How fast the network converges to an output by adjusting the scale to correct the weights
What happens if the learning rate is too high?
Not able to predict accurately and skips the optimal solution
What happens if the learning rate is too low?
Not able to predict accurately and the training time increases
What do we do when the epoch produces an error?
- Check the next inputs
- Calculate the error by doing training value - output
- If the error is not 0, then weight = weight + learningRateinputserror
What does it mean if a system is linearly separable?
The output data points can be separated using a linear boundary
