Lecture 10 Flashcards
Two key brain areas in operant conditioning are the dorsal striatum for (__ —> __) learning and the orbitotrontal cortex for (__ —> __) learning.
SD; R; R; O
Two key brain areas in operant conditioning are the ____ ____ for (SD —> R) learning and the ____ ____ for (R —> O) learning.
Dorsal striatum; orbitofrontal cortex
The ____ ____ is part of the basal ganglia, a group of interconnected subcortical structures important for ____ ____ and learning.
Dorsal striatum; motor control
The basal ganglia include the ____, ____, and the ____ ____ (external and internal segments)
Caudate; Putamen; Globus Pallidus
In primates, the ____ and ____ are distinct structures, while in rodents they are combined into one structure called the ____
Caudate; putamen; Striatum
Within the basal ganglia, the ____ pathway generally increases movement, while the ____ pathway generally decreases movement.
Direct; indirect
Which dopamine receptors are responsible for direct/indirect pathways?
D1 = direct pathway
D2 = indirect pathway
Dopamine neurons in the ____ ____ part compacta and ____ ____ ____ (VTA) project to the striatum and frontal cortex, heavily influencing operant behavior.
Substantia Nigra; ventral tegmental area
____ neurons in the Substantia Nigra par compacta and ventral tegmental area project to the ____ and ____ ____, heavily influencing operant behavior.
Dopamine; striatum; frontal cortex
the ____ ____ (brain structure) is especially critical for learning the association between a discriminative stimulus (SD) and a response (R)
Dorsal striatum
When the dorsal striatum is inactivated, animals have trouble learning new (SD —> R) links based on ____ or ____.
Reinforcement; punishment
The ____ ____ helps predict the specific outcomes of a response (R —> O)
Orbitofrontal cortex
Orbitofrontal cortex neurons can fire differently depending on whether a ____ or a ____ is expected.
Reinforcer; punisher
Competition between brain systems mediates different types of leaning and memory. For example, ____ is responsible for place navigation, while ____ is responsible for response navigation.
Hippocampus; Striatum
Competition between brain systems mediates different types of leaning and memory. For example, Hippocampus is responsible for ____ navigation, while striatum is responsible for ____ navigation.
Place; Response
In ____ navigation, rats learn the direction they need to go to get food, while in ____ navigation, rats learn to use environmental cues to direct the path.
Place; response
Initially, rats use a ____ strategy (in the first week), but after additional training they use a ____ strategy (~2 weeks) — it takes time (repetitions) to develop a habit
Place; response
In the first week, inactivating ____ ____ (Str) does not change the strategy mice use to navigate the maze. However, inactivating ____ (HPC) results in more rats using a ____ strategy, argues that it is needed for using ____ strategy.
Dorsal striatum; hippocampus; response; place
In the second week (after additional training), inactivating ____ doesn’t change the strategy mice use, but ____ inactivation blocks their use of ____ strategy and shifts them back to using ____ strategy.
Hippocampus; striatum; response; place
Predicting specific outcomes:
Single neuron recording in ____ ____ revealed that during the delay between response & outcome, neurons show specificity for whether they are expecting or reinforcing or punishing outcome.
Orbitofrontal cortex
When mice conditioned to expect sucrose after the Go response but received a quinine instead, how does it affect neuonal response in the orbitofrontal cortex?
There were increased neuronal responses in mice that expect sucrose but got quinine.
____ ____ is the immediate small reward or larger delayed reward — longer the delay, more likely to choose the immediate reward because it is not perceived to have more effects than the small one in the near future
Delay discounting
In self-control, ____ ____ lesions shift preference to ____ reward.
Orbitofrontal cortex; immediate
The ____ ____ ____ is a major source of ____ released in frontal cortex. While rats can be trained to press lever to stimulate the region and were found to continuously respond until they collapse, they do not appear to enjoy it. This demonstrates that the area may be more associated with ____, and that ____ is not equal to ____.
Ventral tegmental area; dopamine; arousal; wanting; liking
____ ____ is the subjective “goodness” of a reinforcer, or how much we “like” it, while the ___ ____ is how much we “want” a reinforcer and how hard we are willing to work to obtain it.
Hedonic value; motivational value
The ____ ____ ____ (VTA) releases dopamine in the frontal vortices, while the ____ ____ ____ ____ (SNC) releases dopamine in the striatum.
Ventral tegmental area; Substantia Nigra pars compacta
What does the incentive salience hypothesis of dopamine function say?
that one role of dopamine function in operant conditioning is to signal how much the animal “wants” a particular outcome
- How motivated the animal is to work for it, and the ability of an outcome to attract attention and motivate responding is reduced in dopamine-depleted animals
In a behavioral economics experiment, control rats will lever press for sugar pellets and only eat some of the freely available chow. What did the rats treated with dopamine antagonist do when comparing to them?
Rats given a dopamine antagonist will shift to eating the freely available rat chow and only lever press a little.If both are freely available they still prefer sugar pellets, meaning that “liking” hasn’t changed, but there was reduced motivation to lever press for sugar pellets.
Mice that are genetically engineered to be unable to produce ____ will not seek out food at all and generally starve to death. However, they still display ____ value, suggesting they still “like” it but lack the motivation to obtain it.
Dopamine; hedonic
____ ____ are naturally occurring neurotransmitter-like substances that bind to opiate receptors
Endogenous opioids
Signaling via opioid receptors ____ the perception of pain & produce feelings of euphoria. ____ ____ are released in response to ____ ____, such as food, water, and sex
Reduce; endogenous opioids; primary reinforcers
____ ____ (also known as ____) is involved in conscious awareness of bodily and emotional states, and may play a role in signaling the aversive value of stimuli.
Insular cortex; insula
Insular cortex (also known as insula) is involved in ____ ____ of bodily and emotional states, and may play a role in signaling the ____ value of stimuli.
Conscious awareness; aversive
____ ____ ____ plays a role in perception of physical pain, as well as in other negative emotional states (hunger, anger, disgust)
Dorsal posterior insula
Dorsal posterior insula plays a role in perception of physical ____, as well as in other ____ emotional states (hunger, anger, disgust)
Pain; negative
Insula is a structure underneath ____ lobe and ____ lobe.
Frontal; temporal
the ____ ____ ____ ___ (DACC) is a brain region that may play a role in the ____ value of pain — the degree to which pain can drive changes in behavior.
Dorsal anterior cingulate cortex; motivational
The ____ ____ ____ ____ (DACC) shows ____ activation when study participants unexpectedly receive a reduced reward
Dorsal anterior cingulate cortex; increased
