Week 8: Recap of Learning Flashcards
For our brain to produce ‘adaptive’ behaviour it must be capable
of learning!
Unsupervised learning
The network learns useful weights soley based on the statistics of input patterns
Example of unsupervised learning (3)
Classifying input patterns vis competitive learning (winner takes all)
BCM rule (unlearning below threshold)
Basic Hebbian learning rule
Supervised learning (2)
The network is given a desired output to compare its own output to
The difference instructs the change in synaptic weights
Examples of supervised learning
Perceptron (i.e., delta rule) , deep learning models,
Reinforcement learning
The network is given intermittent feedback in form of punishment and rewards and uses this as a guide to change weights.
Supervised learning rule and reinforcement learning rule can be
combined
What are the three learning rules? (3)
- Unsupervised learning
- Supervised learning
- Reinforcement learning
Example of supervised learning rule
Delta rule
There is no one correct learning rule to understand the brain as
depend on the brain area, the type of information that is learned, thestage of development of the organism etc.
As the brain develops, in part genetically hard-wired, different areas of the brain become plastic (some stay plastic, some are so only for a brief time window), and experiences (i.e., incoming neural patterns) are fed into different brain areas where plasticity acts
Different parts of the brain may implement different learning rules at different times.