Lecture 26 - Reward System Dysfunction Flashcards
Brain system
A collection of structures in the brain that work together to perform a common function
Examples: Visual system, auditory system, vestibular system, somatosensory system, motor system, reward system
Systems can work alone or in concert with other systems to bring about changes in behaviour – analysis of how this is achieved is called systems neuroscience
Brain network
Subtly different to a ‘network’ in that a network loosely refers to the structure of circuits that connect areas of neurons together
Two distinct types of brain system
systems with a specific function
systems with a generic function
Systems with a specific function
Processing visual information from the eye:
retina -> thalamus -> visual cortex -> cortex visual association areas
Generating fine movements of fingers:
motor association/planning areas in prefrontal and frontal cortex -> hand area in primary motor cortex
System with a generic function
• Systems that process information received from regions performing widely differing specific functions to perform a particular behaviourally important operation
Usually a global function that uses all the information from different regions
• [….] generic functions are required for most/all tasks: e.g. attention, perfecting skills, memories, reward processing [can’t easily answer ‘where’?]
How is the reward system and its network a generic processing system?
It is a generic system because it integrates information from manyareas serving different functions and SELECTS a behavioural response: e.g. stay or go?; repeat what you just did or don’t; or do something different.
Prefrontal cortex has an input pathway into the nucleus accumbens which from then goes to the ventral pallidum to the thalamus to the cortex but there are also other inputs into the nucleus accumbens that are a part of the lambic
Fear from the amygdala for example is all integrated with the motivation you have to do something to lead to an output
Caudate/putamen goes to the globus pallidus and the nucleus accumbens goes to the ventral pallidum (ventral system goes to the ventral pallidus)and from there to the thalamus and then back to the thalamus which also forms a loop which is more about associative learning rather than motivation/limbic functioning i.e. learning new skills and habits
The mesolimbic dopamine circuit
The mesolimbic dopamine circuit
- Inputs from hippocampus to integrate memory of ‘context’
- Inputs from amygdala to integrate memory of an emotional e.g. fearful situation
Mid brain to limbic system
Nigrostriatal dopamine circuit
The nigrostriatal dopamine circuit
- Reinforces sensory-motor associations
- Important in learning new skills
- Important in forming habits - also disordered in addiction
Substantia nigra to striatum (takes dopamine to the caudate/putamen)
E..g driving once you have practice lots the stimulus drives the movement rather than having to learn each step of how to respond
Much of the reward networks involves the
basal ganglia
Reward networks and basal ganglia - Dorsal circuit (sensorimotor)
1) Striatum (caudate,
putamen- sensorimotor),
2) Globus pallidus (sensorimotor),
3) Substantia nigra (sensorimotor dopamine - nigrostriatal),
4) (Subthalamic nucleus)
Reward networks and basal ganglia - Ventral circuit (limbic)
1) nucleus accumbens
(limbic)
2) Ventral pallidum (limbic)
3) Ventral Tegemental area (limbic dopamine - mesolimbic)
4) Subthalamic nucleus
How does the basal ganglia part of the reward system select between the options of what to do?
We have competing ‘motivations’ BUT only one set of muscles to respond with!
How might we ensure that the right behaviour is selected in a particular circumstance?
Basal ganglia tries to decide how the right behaviour is selected in a particular circumstance
The basal ganglia and selecting the most important thing
The basal ganglia - different parts select the most appropriate / most important movement, sensation, idea, plan, memory, emotion, in a given situation, based on experience
Has different loops
Basal ganglia and its loops
Motivation and emotion - Limbic loop where we want to think about motivation and emotion, whether it is appropriate to do this particular behaviour in a particular situation
Cognitive: ideas/memories/plans - this cognitive loop is really here to decide what the plan is to do in a specific example, when do you choose a particular strategy in a particular scenario
Sensorimotor stimuli/actions - Loop that involves the stimulus occurring and deciding what action to form in response to it
How do the Basal Ganglia help us learn from experience about what the best action is to do in particular circumstances?
Reinforcement learning –
learning the strategy to be taken in a given situation that maximises the chance of a successful outcome
-> strategy is stored for later selection
-> reinforcement makes that strategy more likely to be selected in a similar situation in future
-> It’s all about dopamine: positive reinforcement releases dopamine
A dopamine signal can be measured
in the striatum of the basal ganglia
Dopamine is released in response to rewarding stimuli such as ..
stimuli associated with food or liquid (pulse is relatively short, matter of seconds)
stimuli assoicated with sex (anything you know that leads to sex will become rewarding and lead to dopamine release in these areas)
Release of dopamine into the striatum _________ cortical activity (an ‘action’) can increase the strength of synapses from the cortex
AFTER
Release of dopamine into the striatum AFTER cortical activity (an ‘action’) can increase the strength of synapses from the cortex
Synaptic plasticity at
corticostriatal synapses
controls what is learnt for later selection
Input coming into the basal ganglia is like an action and then if something nice happens like a reward occurs and dopamine is bought into this area to strengthen the pathway that goes right the way round, what dopamine is doing is that it is working on the connections between the cortex and the striatum/basal ganglia and these synapses are called corticostriatal synapses
Can record from cells in the striatum, these are cells that are going to go from the striatum to the pallidum and these are called spiny projection neurons as they have lots of spines (lots of sites of connections to other neurons) and they project out, looking at the strength of the synapses from the cortex to this neuron and recording from there we can measure a baseline response after hitting it will a little pulse
The spiny projection neuron stimulates and pumped one dopamine on which has reinforced the circuit and caused long term potentiation
baseline synaptic response, when action is followed by dopamine this synapse with the baseline is strengthen, dopamine released in response to positively reqarding stimulus following a cortical ‘action’ leads to long term potentiation
Release of dopamine into the striatum AFTER cortical activity (an ‘action’) can increase the strength of synapses from the cortex - Principles of Positive Reinforcement
Addition of a pleasant stimulus to a behaviour equation
The dog sits FIRST - an ‘action’ that presents cortical activity to the striatum
The reward FOLLOWS the ‘action’ so the PRECEDING action is reinforced
What happens if you give the dog the reward first then try to teach him to sit?
How do we know that dopamine release is reinforcing?
Because animals will learn the action required to activate their own dopamine pathways: Intracranial self-stimulation (ICSS)
Do an experiment where we put a stimulating electrode in the brain of an animal to activate the dopamine circuit and when we do this we give them a lever that will turn on the stimulator and give them a reward and you see what happens, animals learn very quickly the action required to stimulate their dopamine pathway which is called intracranial self-stimulation
Stimulating electrode implanted in an area near dopamine neurons in a rat for example
Intracranial self-stimulation of the dopamine cells in the substantia nigra – directly activates the reward pathways so animals learn to ‘select’ the action of pressing the lever
Brain disorder examples that involve dysfunction of dopamine and the reward system and affect the basal ganglia’s ability to correctly select …
Motor (execution of movement) - Parkinson’s disease
Sensorimotor (stimulus-response) - Addiction (sensory problem e.g. seeing the needle produces response
Cognitive (planning actions) - Obsessive Compulsive Disorder
Limbic (emotion/memory) - Schizophrenia/Psychosis (abnormal associations that do not make sense to others in the world)
In Parkinson’s disease dopamine is lost in …
the basal ganglia
PD and radiolabbeled DOPA which is dopamine in the basal ganglia
The nigrastriatal degenerates much more than the mesolimbic and lose dopamine in the caudate/putamen
PET scans and give them flurodopa and radiolabel it so that it is like a precursor for dopamine so it will go in to the area that makes dopamine which is mostly the caudate/putamen
Patient - quite a reduction in the area compared to the controls, asymmetric which could indicate that someone is in quire an early stag, Fewer dopamine fibres to uptake the DOPA due to the neurodegeneration.
