The Importance of Motor Learning Flashcards
Mastery
Classical Conditioning
Reinforcement:
Punishment:
Positive Reinforcement –
Negative Reinforcement –
Positive Punishment –
Negative Punishment –
Classical Conditioning
* A learned (reinforced) reflex / response that is evoked by a stimulus
Reinforcement: increase behaviour
Punishment: decrease behaviour
Positive Reinforcement – Giving a treat for completing homework
Negative Reinforcement – Removing chores for good behavior
Positive Punishment – Adding extra laps for being late
Negative Punishment – Taking away phone privileges for missing curfew
The process of reinforcement learning
involves….
The process of reinforcement learning
involves learning to link reward with
specific actions (and their outcomes)
so they become repeated
what is the goal of reinforcement learning
Cumulative Reward
maximize reward and minimize loss
- Might be better to sacrifice immediate reward for long-term reward
- Chess
- Investments
training a computer to reach for a target
the actions were learned using reward – the action was repeated when it was associated with success (reaching the
target, walking).
Exploration:
Exploitation:
Exploration: The (trial and error) process of acquiring more information about the environment by searching possibilities
Searching (many) action possibilities to determine which actions tend to maximize reward.
Exploitation: capitalize on known information to maximize reward
Shift emphasis from exploring to exploiting to maximize reward
hit the target, if they miss?
what happens if the target shifts unknown the the subject
When the participant hits the target, the participant hears a pleasant tone.
When the participant misses the target, they do not receive any reward feedback
Absence of reward causes participants to shift their aimpoint to get reward
what is dopamine? where is it produced from?
dopamine input to where, and then what does the structure do
Dopamine is a neurotransmitter that is part of the brain’s intrinsic reward system. It is produced in the substantia
nigra.
Dopamine input to the striatum is critical for learning from reward
and strengthening the representation of specific actions
Learning Causes ‘Chunking’ of Individual Elements in a Motor Sequence
Practice can link sequential actions into a single movement pattern
Chunking: fusing a series of individual elements into a larger subunit of a movement sequence
Early in learning process, shifting gears requires several distinct movements.
With practice, independent actions are ‘chunked’ into a larger subunit of a movement sequence.
Eventually actions can be ‘chunked’ together into a single cohesive movement sequence where successive actions are ‘coarticulated’
Learning to produce motor sequences of finger movements
before training and after training
Forces measured at each finger
Subjects get faster with practice
Persistent learning effect (reduction in execution time at 1 mo. post learning)
With learning, subjects can produce sequences faster, with less errors (not
shown). Key presses become smoother and linked together
Co-Articulation
Adjacent movement elements influence each other
Co-articulation causes a blending of discrete movements within a
sequence and is associated with an
increase in the speed and smoothness
of movement sequences.
Individual movements between
targets 1-2, 2-3, 3-4, 4-1 are easy
to identify in hand speed profiles.
Individual movements between
targets 1-2, 2-3, 3-4, 4-1 less
obvious in hand speed profiles.
Despite performing 4 movements,
there are only 2 obvious peaks in
hand speed profiles.
Brain regions with increased activity in early stages of learning
Dorsolateral Prefrontal Cortex
Inferior Parietal Cortex
Rostral Premotor Areas
Cerebellum
Basal Ganglia
Dorsolateral Prefrontal Cortex
- working memory, attention, action selection
- conscious planning and processing of movements
- likely involved in initial stages of chunking motor sequences
Inferior Parietal Cortex
- processing visual and somatosensory information
Rostral Premotor Areas
- Involved in planning motor actions
- processing visual and somatosensory feedback
Cerebellum
- Involved in detecting and correcting errors
Basal Ganglia
- Involved in processing reward during action (implicit reward of doing sequence
correctly?)
Supplementary motor area
Dorsal premotor area
primary motor cortex
SMA = storage unit hold onto motor plans
DPA = processing visual and planing motor
M1 = produce motor actions
