Chp 19 - GOOD Flashcards
instrumental learning/behaviour
how behaviour is modified by the outcome it produces, in response
what does hull refer to habit strength as
strength of association between a stimulus and a response, as number of reinforced pairings between a stimulus and response go up, habit strength associated with it also goes up
anatomy of dorsal lateral striatum
receives lots of sensory information representing world and receives information about limb and whole body movements.
has topographical organization (everything directed to specific spots)
Neurons in the dorsal lateral striatum display evoked responses to what and why is that important
sensory cues and motor responses, display sensory evoked responses when it the stimulus is linked with a conditioned movement
nice because it is set up for stimulus response association because it collects sensory and motor information at same time)
design and experiments of dorsal lateral striatum on radial maze
1 group with damaged dorsal lateral other group no damage. trained on 8 arm radial maze, each day 4 random arms would change that light up. very habit like, if rat goes into light up arm, would get reinforced
results = not impaired had high accuracy by the end, impaired group not so successful
skilled reaching design and results on dorsal lateral and dorsal medial striatum
start at back of rectangle box, go to other end and use paw to reach for food through small opening. used olfactory not sight
damage to lateral, medium, and control
design and results of operant chamber on dorsal lateral striatum
different ways to receive food/reinforcement
tone-lever-food or light-chain-food (stimulus response associations)
control had great acquisition, damage could not
possible problem/other possibility with operant chamber experiment and what was done to account for it (2)
believed dorsolateral striatum might simply cause motor problem and therefore cannot perform in experiment (couldn’t move and therefore received less reinforcement therefore couldn’t association as much)
- instead of pressing lots of times in order to receive reinforcement, just press once and receive
- the trial was only ended once the subject successfully completed and received the reinforcement equal amount of times
deficits still remained and performed worse! so not only motor problem causing differences. BAD RETENTION AND ACQUISITION
function of dorsolateral striatum
causes movements that lead to reinforcement of specific stimuli, is involved in accuracy and fine tuning improvement of motor responses. discriminate against motor habits and deals with associative conditioning specific to reinforced cues
dorsal medial striatum function
cognitive control of behavioural flexibility. interact with hippocampus and prefrontal cortex to influence voluntary behaviour
(behavioural flexibility, attentional processes, and goal directed behaviour)
one trial place learning experiment with damage to DMS and _____ and why
show increased path length, less successful
because has significant connectivity with prefrontal cortex which also is important in the function of behavioural flexibility
damage to prefrontal cortex also display less successful
what two structures make up the functional circuit for behavioural flexibility on a task mediated by the _____
medial prefrontal cortex and dorsal medial striatum
hippocampus
Thorndike’s law of effect
that outcomes produced as a result of a behaviour, either strengthen or weaken an existing stimulus-response connection
Tolman’s cognitive expectancy theory
instrumental behaviours are organized around goals and mediated by expectancies.
expectancy is a 3 term association stimulus-representation of a response- representation of an outcome of the response (believes there is an expectancy, that we store and detect information in our brain about the relationships of events)
Combining the theories of Thorndike and Tolman, what categories of instrumental behaviour were created? explain the difference between them (vs)
action (tolman) and habits (thorndike)
actions = purposeful, goal directed, rapid, sensitive to response outcomes, requires expectancies
habits = not goal directed or purposeful, insensitive to response outcomes
experiment to tell if instrumental behaviour is action or habit
reward devaluation strategy (changes the value of the outcome) and provides evidence it isn’t habit or would pick the same thing no matter what
triangle and cylinder (raisins under and grapes under)
another puzzle square and diamond (nuts and chocolate)
give monkey triangle and square but give lots of nuts before, there pick triangle because don’t want nuts again
instrumental behaviours are initially controlled by ____ system but then become ____ . what evidence to support this?
actions
habitats
reward devaluation works at the start when controlled by actions, but later not once they become habits, it has no effect.
both can work together at some points too well better learned but not exactly a habit yet
conceptual model for actions and habits
experience in represented in two levels of the brain. with limited training, action system occurs in level II. if reward then it occurs in level II and project back to level I to generate instrumental behaviour. if devalued/no reward, does not project into level II and level I response is not activated and no instrumental behaviour
with extended training, habits are formed, representations in level I are strong enough that do not need to project to level II.
what does the prelimbic prefrontal cortex do
critical for acquisitions of associations that support an action because when damaged before training, reward devaluation has no effect, making behaviour only a habit but if damaged after, devaluation has an effect and is not a place for STORING because after learning and damage prelimbic, reward devaluation still occurs
damage to dorsolateral striatum in actions and memories
after extensive training reward devaluation still has an effect meaning that the behaviours can never be formed into habits because of the damage to the dorsolateral striatum
effect of infralimibic medial prefrontal cortex on action and habits
damage prior to training means no habits forming
damaged after training, the rats still lose their habits and are still sensitive to reward devaluation
THEREFORE even with extensive training, infralimbic region comes to not allow habits from forming (need infralimbic for habits!)
contributions of prelimbic and infralimbic regions of prefrontal cortex to create instrumental behaviours
limited training is controlled by prelimbic which creates instrumental behavior (no habit)
extensive training = infralimbic suppresses action system from being involved and instrumental behaviour is instead produced by habit system
if no infralimbic system, then action system only controls because cannot be suppressed
