Lecture 5 Flashcards
Causal Question’s explainations in the role of DA in reward:
- “liking”
- Learning
- “wanting”
Experimental approaches to determine what DA does in reward: what reward function is _______
- Necessary cause (lost)
- Sufficient cause (enhanced)
- coding of function (coded)
Answers of Causal DA Question (1/4)
- Activation sensorimotor hypothesis of effort, arousal and response vigor
Answers of Causal DA Question (2/4)
- Hedonia hypothesis of reward pleasure
Answers of Causal DA Question (3/4)
- Reward learning hypothesis of associative stamping-in, teaching signals and prediction errors
Answers of Causal DA Question (4/4)
- Incentive Salience hypothesis of reward “wanting”
(A: 1/4) Activation-sensorimotor hypothesis
DA mediates general functions of: action generation, effort, movement, general arousal/behavioural activation.
(A: 2/4) Hedonia hypothesis
DA in NAc is a “Pleasure neurotransmitter”: Mediates +ve reinforcing effects of reward stimuli. Supress DA~Anhedonia
DA and Hedonic Rxn’s in rats
DA reduction does NOT decrease “liking”
DA activation does not increase “liking”
5 different brain manipulations insufficiently enhancing hedonic impact of reward
- Hyper-DA mutation (KO mice)
- AMPH injected in NAc
- AMPH systemic administration
- Sensitization
- Electrical brain stim reward
DA and Hedonic Rxn’s in humans
DA does NOT mediate subjective ratings
DA does NOT mediate subjective ratings w/ two methods:
- Patients with Parkinsons show normal liking ratings
2. DDS patients have compulsive actions due to more L-Dopa administered.
Nonhedonic hypotheses of reward (two main)
- Reward learning
2. Incentive Salience
(A: 3/4) Reward Learning hypothesis
DA signal modulates synaptic plasticity in target neurons, psychologically suggesting DA acts to etch links (in neostriatum and NAc) b/w S-S and S-R events.
Reward-Learning (DA) Hypotheses (3 types)
all say DA mediates learning but in different ways
- DA signals stamp in S-R and S-S associations whenever reward follows
- DA activation causes new habit learning (ergo habit performance)
- DA mediate teaching signals via US prediction errors
Reward-Learning (DA) Hypothesis (1/3): Associative stamping in
DA acts as US reinforcement signal to learn associations about preceding reward stimuli. Based on Law of effect (thorndike)
Reward-Learning (DA) Hypothesis (1/3): Associative stamping in: Thorndike’s Law of effect (3 components)
- Context (S)
- Instrumental response (R)
- Response outcome (O)
Reward-Learning (DA) Hypothesis (1/3): Associative stamping in: Thorndike’s Law of effect (summary)
if R in presence of S followed by satisfying event~ S-R association strengthened
If R in presence of S followed by unsatisfying event~S-R association weakened.
Reinforcer (O) “stamps” S-R association
Reward-Learning (DA) Hypothesis (1/3): Associative stamping in: Supporting Evidence
- Extinction-mimicry
- DA modulating mechanisms of LTP and LTD
- DA manips right after learning trial alters consolidation.reconsol of memories
Reward-Learning (DA) Hypothesis (2/3): Habit Learning
DA causes new S-R habits to be learned &/or modulates strength of learned S-R habits
Reward-Learning (DA) Hypothesis (3/3): Prediction Error Learning Model(s)
suggest DA embodies specific parameters of learning equations by acting as a teaching signal.
- Rescorla-Wagner Model
- Temporal Difference Model
Reward-Learning (DA) Hypothesis (3/3): Prediction Error Learning Model (a) Rescorla-Wagner Model
suggests DA boosts might increase predictions of future reward (V) to a (CS). Increase in DA elevates prediction error (lambda-V) generated by hedonic impact of US (lambda) at moment of reinforcement, boosting amount of learning on the trial (deltaV).
Reward-Learning (DA) Hypothesis (3/3): Prediction Error Learning Model (b) Temporal Difference Model
time more explicit in expectations of reward as series of future events. V becomes more accurate thru learning about actual rewards via prediction errors that modulate synaptic weights in circuits involved in future predictions.
DA makes _____ contributions to both ____ & ____, but not directly causing _______
Indirectly, learning, learned performance, formation of new reward associations
