Brainscape's Knowledge GenomeTM

Browse over 1 million classes created by top students, professors, publishers, and experts.


See full index

Learning PSYC351 > Instrumental Conditioning: Motivational Mechanisms > Flashcards

Instrumental Conditioning: Motivational Mechanisms Flashcards

1
Q

motivational mechanisms: associative structure of instrumental conditioning perspective

A
  • relies on concept of associations in Pavlovian conditioning
  • molecular perspective: focuses on individual stimulus antecedents and outcome of responses related to these antecedents
  • examines instrumental learning in isolated behavioural preparations
  • allows framework of studying neural mechanisms of instant conditioning
  • associations can be proven, substantiated, in nervous system
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

motivational mechanisms: response allocation approach, Skinnerian tradition

A
  • broader context of organism’s activities
  • considered from molar perspective
  • “how are long term goals achieved amid all behavioural options”
  • main concerns
    1. how instrumental conditioning limits organism’s free flow of activities
    2. consequences of these limitations
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

response-allocation approach limitation example

A

when you have a summer class, your studying schedule imposes a contingency on what you normally do; limits freedom

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

associative structure of instrumental conditioning

A

response, reinforcer, context of stimuli
- instrumental response occurs inpresence of distinctive stimuli
- e.g. turning a key in the car ignition (response) startsthe car (reinforcer); sitting in driver’s seat with key in between your fingers (context)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

SR association and law of effect

A
  • involves establishment of SR association between R and S present when response is reinforced
  • does NOT involve learning about reinforcer OR response outcome (O) OR relation between and reinforcing RO outcome
  • role of reinforcer: strengthen SR association
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

SR association and law of effect: Thorndike’s belief

A
  • once established, SR association was solely responsible for insturmental B
  • thus, motivation = activation of SR association by exposure to S present when response was previously reinforced
  • characterizing habitual B leads to resurgence of interest in SR mechanisms
  • these theories fell into disfavor during the cognitive revolution
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

habits

A
  • 45% of human B
  • automatic Bs we do the same way each time
  • likely arise in pursuit of goals and particular contexts
  • once acquired, these occur without goals
  • reaction to stimulus context in which goal was attained previously
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

habits: compulsive behaviours

A
  • drug abuse, gambling, sexual B, eating
  • individuals feel driven to perform repeatedly
  • contextual cues trigger them
  • negative consequences are not relevant according to SR theory
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

expectancy of reward and SO associations

A
  • reward expectancy is considered as motivator of instrumental B
  • specification of instrumental response ensures participant will ALWAYS experience certain S in connection with making response
  • stimuli may invoke multiple senses + involve distinctive place, texture, smell, sight cues
  • reinforcement of instrumental response = pairing (S) with reinforcer (O)
  • pairings provide potential for
    1. classical conditioning
    2. establishment of association between S and O
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

expectancy of reward and SO associations: Pavlovian process and expectancy of reward from memory

A

…. specification of instrumental response ensures participant will ALWAYS experience certain S in connection with making response….
- activates memory of event
- allows individuals to predict event will occur
- expect something important will occur and expect reinforcer

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

2 process theory

A

Belief: why did instrumental response increase during conditioning
1. presence of S evokes instrumental conditioning
- through SR association (Thorndike)
2. instrumental response occurs in response to SO (expectation of reward)
- assumes two types of learning: classical and instrumental

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

2 process theory: process

A
  1. S is associated with 0 reinforcement through Pavlovian conditioning
  2. results in SO association, which activates emotional state
    - +/- based on appetitive or aversive reinforcer
  3. emotional state motivates instrumental B
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

2 process theory: transfer

A
  1. standard instrumental conditioning phase
    - lever press in reinforced with food
  2. standard Pavlovian conditioning phase
    - lever = removed from experimental chamber
    - tone CS is paired with food US
  3. critical transfer phase
    - lever again available, lever press is performed to secure reward
    - BUT Pavlovian CS = periodically
    - if Pavlovian SO response motivates instrumental B the rate of level pressing should increase when one CS is presented
    - AS PREDICTED… reward increases rate of responding because: likely positive emotion elicited by CS+ (food) summating with appetitive emotion involved in lever pressing for food
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

what determines transfer results in regard to 2 process theory?

A
  • expectancies for specific rewards, rather than general positive emotional states
  • the compatibility of Pavlovian CR and instrumental response
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

overt responses and classical conditioning

A
  • Pavlovian conditioning can elicit overt responses
  • sign tracking (tendency to interact with cue that predicts reward
    e.g. increased lever pressing during CS show that independently established SO association can facilitate instrumental responding reinforced by that O.
    because response levers = removed during Pavlovian phase, no SR association could have been learned during that phase
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

agonists vs antagonists

A

refer to page 12 of notebook, slides 13, 14, 15 of powerpoint

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

dopaminergic pathway

A
  • principally involved in reward (mesolimbic system)
  • formed by projections (axons) of midbrain dopamine neurons of VTA
  • when rewarding stimuli = experienced …
    1. dopaminergic mesolimbic system = activated
    2. causes release of DA to targeted nuclei (notably NAcc)
  • VTA neurons project to several limbic structures
    1. NAcc
    2. amygdala
    3. striatum
    4. PFC
    5. hippocampus
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

ventral striatum and reward

A

heterogenous mix of a few different brain structures
- NA + caudate + putamen + olfactory tubercle
- all structures (notably NA) play roles in decision making to respond to reward and motivation
ventral striatum + NA RECEIVE afferents from basolatera; amygdala, hippocampal formation, PFC; projects to lateral hypothalamus and ventral pallidum (VP)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

basal and lateral amygdala roles

A

convey info about stimuli that predicts occurence of reinforcers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

amygdala + ventral striatum connectivity

A
  • connectivity between amygdala + ventral striatum = important in translation of emotion and motivational effects of stimuli to behavioural output
  • glutamatergic inputs from amygdala to ventral striatum work together with ascending dopamine system
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

4 major dopaminergic pathways

A
  1. mesolimbic pathway
  2. mesocortical pathway
  3. nigrostriatal pathway
  4. tuberoinfundibular pathway
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

mesolimbic pathway

A
  • transmits dopamine from VTA to ventral striatum
  • reward-related cognition, aversion-related cognition
  • incentive salience: “wanting”
  • pleasure (“liking”) response from certain stimuli
    • reinforcement
  • associated disorders: ADHD, schizophrenia, addiction
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

mesocortical pathway

A
  • transmits DA from VTA to PFC
  • executive functions
  • associated disorders: ADHD, schizophrenia, addiction
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

nigrostriatal pathway

A
  • transmits dopaminergic neurons from zona compacta of substantia niagra to caudate nucleus and putamen
  • associated processes
    1. motor function
    2. reward-related cognition
    3. associative learning
  • associated disorders: addiction, chorea, Huntington’s, shizophrenia, ADHD, tourette’s, Parkinson’s
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

in schizophrenia, what are the pathways most notably involved and what are the effects of the presence of DA?

A

mesolimbic pathway (VTA to NAcc)
- surplus of DA
- results in positive symptoms
mesocortical pathway (VTA to PFC)
- not enough DA
- results in negative symptoms

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

pathways diagram

A

refer to notebook page 38 IMPORTANT

27
Q

reward: ventral striatopallidal system

A
  • mainly composed of NA and VP
  • system receives dense inputs from limbic structures (hippocampus, PFC, amygdala)
  • hypothesis: this system = critical interface between reward-processing and motor output
  • research suggests reward-related B depend on normal connectivity between NA + VP
28
Q

psychostimulants: cocaine

A
  • blocks DA reuptake in presynaptic neuron
  • opposite of amphetamines
29
Q

psychostimulants: amphetamines

A
  • cause DA release via DA transporter-mediated reverse transport
  • cause interference with dopamine reuptake
30
Q

psychostimulants: opioids

A
  • mu-receptor focused
  • mu-receptors mediate therapeutic + addictive activities of morphine
  • deficiency in mu-receptors abolishes analgeisc effect of morphine + physical dependence
31
Q

mu-receptor knockout mice

A
  • genetically altered; take out the mu-receptor genes
  • reward properties of opioids/non-opioids are abolished
  • opiates emulate endogenous endorphins that engage mu-opioid receptors
32
Q

psychostimulants: ACh

A
  • cholinergic neurons; release ACh
  • involve new memory formation in hippocampus
  • nicotine:
    1. binds to nicotinic receptors + enhances cholinergic neurotransmission
    2. enhances release of DA by acting on presynaptic cholinergic receptors
33
Q

psychostimulants: sedatives (alcohol, valium, benzos, etc)

A
  • anxiolytics bind to GABA receptors
  • benzos bind to GABA receptors makes it more efficient by increasing frequency with which the chloride channel opens when GABA binds to its own site
34
Q

selective influence of drugs

A
  • some drugs seem to selectively influence NA + striatum
  • neurons within NA allow for multiple synaptic contacts via spiny dendritic fields
  • get input from neurons releasing endogenous opioids that engage mu-receptor
  • VTA dopaminergic projections innervate spiny neurons
  • NA gets glutaminergic inputs from cortex
35
Q

striatum contains ___% of GABergic medium spiny projection neurons

A
  • 90-95%
  • these are major targets of cortical input and sole source of output
36
Q

selective influence of drugs: how it works

A
  1. dopaminergic mesolimbic projections from VTA to ventral striatum
  2. NA neurons send GABAergic inhibitory projections to VP
  3. DA neuron firing rates are maintained at steady level due to inhibitory signals from VP
37
Q

within NAcc

A

IMPORTANT
refer to page 39 in notebook

38
Q

drug abuse and DA

A
  • psychostimulants artificially drive DA activity
  • brain interprets increase in DA as a positive prediction error
  • reinforcers learning, linking sensory cues associated with drug administration with reward
  • sensory cues acquire motivational value that fuels drug craving
39
Q

liking vs wanting

A
  • DA is not required/sufficient to generate liking
  • it’s believed that DA activity is coupled to unconsciously wanting
  • wanting: related to underlying motivational value of reward (independent of whether consumption engenders pleasure)
  • cues paired with reward acquire incentive salience that drives wanting; transforms sensory signals of reward into desired goals
40
Q

RO + S(RO) relations

A
  • neither SR nor SO association involves direct link between R and reinforcer or O
  • e.g. if you ask someone why they brush their hair, they would reply that they expect combing their hair (R) improves their appearance (O)
  • RO associations do not exist in 2 process models
41
Q

evidence for RO associations

A
  • involves devaluation of the reinforcer after conditioning
  • if the instrumental response (R) occurs because of the R-O association
  • devaluation of reinforcer should reduce the rate of instrumental response
  • if reinforcer devaluation disrupts instrumental response behavior
  • memory of the outcome (O) was involved in motivating the instrumental behavior
42
Q

devaluation of reinforcer

A
  • makes the reinforcer less attractive
  • e.g., can make food less attractive by conditioning taste aversion
  • for behavior specific to the response whose reinforcer was devaluated
43
Q

Why can results NOT be explained by SO associations?

A

SO associations do not account for response specificity of the devaluation effects observed

44
Q

RO associations and drug addiction

A
  • RO associations are involved in instrumental drug-seeking behavior
  • however, addiction seems driven by S-R mechanisms
  • Both views are correct
  • RO mechanisms predominate in free operant situations
  • whereas SR mechanisms activated when drug taking is a response to drug-related cues
45
Q

hierarchical SO relationships

A

WHAT WE KNOW
1. organisms associate instrumental response with outcome
2. RO association cannot produce instrumental B alone
3. instrumental response activates expectancy of reinforcer; NOT sufficient to identify response cause
3-TERM CONTINGENCY
- S,R,O in instrumental conditioning = connected through conditional relation

46
Q

response allocation (important)

A
  • does not consider instrumental B in terms of reinforcement of a response in presence of particular stimuli
  • molar approach
  • focuses on how instrumental conditioning procedures put limitations on activities
  • causes redistribution of B among available response options
  • examines:
    1. how response distribution altered when an instrumental conditioning procedures is introduced
    2. what factors determine nature of response allocation
47
Q

antecedents of response allocation approach: consummatory-response theory

A
  • eating… drinking…
  • critical feature of reinforces
  • this theory moved search for reinforcers from special kinds of stimuli to special kinds of responses
  • theory assumed consummatory responses are fundamentally different from various instrumental responses
48
Q

antecedents of response allocation approach: premack/differential probability principle

A
  • disagrees with the consummatory-response theory
  • posits difference in likelihood of instrumental/reinforcer responses
  • eating reinforces bar pressing because eating is more likely than just bar pressing
  • encourages thinking about reinforcers as responses rather than stimuli
  • expands range of activities investigators use as reinforcers
49
Q

antecedents of response allocation approach: response deprivation hypothesis

A

restriction of reinforcer activity critical factor for instrumental reinforcement

50
Q

differentiation between premack and response allocation

A
  • response allocation does not focus on instrumental and reinforcer responses (like premack and response deprivation hypothesis)
  • response allocation considers broad range of activities that are always available to the individual
51
Q

response-allocation: unconstrained baseline

A
  • allocation of responses by an individual when there are no restrictions on behavioural options; presumably reflects their preferences
  • baseline is disrupted when a schedule is imposed
52
Q

response-allocation and the consequences unconstrained baseline

A
  1. individuals typically defend their response allocation against challenges to unrestricted baseline
  2. baseline is seldom reestablished after instrumental contingency
  3. given that instrumental contingency makes it impossible to return to unrestricted baseline; redistribution is matter of compromise
53
Q

minimum deviation model

A
  • response-reinforcer contingency causes organism to redistribute B between instrumental and contingent responses to decrease total deviation of 2 responses from bliss point
  • provides perspective as to how organisms settle for next best thing when schedule constrains unrestricted baseline
54
Q

explanantion of reinforcement effects

A

reinforcement effect: identified by increase in instrumental response
- to get more reinforcer, must perform more of instrumental contingency response

55
Q

how does our environment influence our behaviour in terms of choosing from alternatives

A
  • environment provide great range of options
  • instrumental contingencies occur in context of all responses and reinforcers available
  • behavioural context can significantly influence how an individual adjusts to a schedule constraint
56
Q

behavioural economics

A

similarities between economic restrictions in market place vs schedule constraints in instrumental conditioning
1. demand curve
- relation between price of commodity and how much of it is purchased
2. elasticity of demand
- degree to which price influences consumption
**refer to slide 54 - IMPORTANT

57
Q

behavioural economics:
- money = …..
- purchased commodity = ….
- price of reinforcer = …..

A

money = nb of responses
purchased commodity = reinforcer
price of reinforcer = nb of responses required to obtain the reinforcer

58
Q

determinants of elasticity of demand

A
  1. availability of substitutes
  2. price range
  3. income level
  4. link to complementary commodity
59
Q

determinants of elasticity of demand: availability of substitutes

A
  • most important factor
  • whether price increases (or not) causes increase/decreased in purchasing
  • the higher the nb of responses required to get the reinforcer, the less organisms will want to “pay the price”
60
Q

determinants of elasticity of demand: availability of substitutes and drug abuse parallel

A
  • get methadone by pressing response lever but within a progressively increasing FR schedule (cond. 1)
  • subjects can obtain hydromorphone at constant FR32 by pressing the 2nd lever (cond. 2)
  • if methadone is only reinforcer, increase in its price (lever pulls)
  • in decreased consumption only at its highest FR values
  • less methadone is consumed if hydromorphone is also available
  • responding for hydromorphone increases as price (nb of lever pulls) of methadone increases
61
Q

determinants of elasticity of demand: price range

A
  • price range of commodity impacts elasticity of demand (the degree to which price influences consumption)
62
Q

determinants of elasticity of demand: income level

A
  • higher the income relatively equates to less deterrence from higher price
  • the more responses/time organism has available, the less their B is influenced by increase in cost of reinforcer
  • e.g. being rich makes you care less about a speeding ticket
63
Q

determinants of elasticity of demand: link to complementary commodity

A
  • often individuals that smoke also drink
  • smoking increases likelihood of drinking and vice versa
  • therefore, sharp increase in alcohol$ should drive down drinking and smoking

Learning PSYC351 (9 decks)

Brainscape helps you reach your goals faster, through stronger study habits.
© 2024 Bold Learning Solutions. Terms and Conditions