Unit 4 Flashcards
What is the difference between Operant Conditioning and Pavlovian Conditioning?
OP: voluntary action, reward/punishment control Bx
PC: involuntary action, become learned reflexes
what is motivation?
the will to expend energy to achieve a goal
what are four things that motivate behavior?
-physiological responses
-emotional responses
-cognitive response
-involuntary responses (innate and learned)
what are two types of reflexive behavior, and what are two types of learned behavior?
reflexive: unconditional stimulus & response
learned: conditional stimulus & respone
why is US important?
biologically important due to survival value
what is the UR?
the automatic reflexive response to the US
what is the CS?
initially neutral but becomes a cue to the response
what is the CR?
learned response to the CS
what is the common process of Pavlovian Conditioning?
CS-US -> UR
–overtime–
CS only -> CR
what are conditioned emotional responses? (CERs)
learned response to a neutral stimulus presented just prior to a negative stimulus (electric shock)
-emotional component to URs
-CUES!
-motivates behavior (reinforcement)
what type of behavior occurs when CERs are present?
appetitive
-satisfying
what type of behavior occurs when CERs are absent?
aversive
-undesirable for survival, avoidance, fear
what is the US for drugs?
the drug interaction with nervous system (binding at receptors, inhibiting hormones)
what is the UR for drugs?
the drug effect (euphoria, drowsiness)
what is the CS for drugs?
cues for administration (bong, people, location)
what is the CR for drugs?
homogeneous / heterogenous response
-either the same as UR or different
what does naloxone do to withdrawal?
suppress the effects of opioids
-rapidly reverse opioid overdose
-opioid antagonist
pavlovian conditioning and naloxone
CS (cue (syringe)) - US (naloxone) -> UR (withdrawal)
CS (syringe) -> CR (withdrawal)
what is acquisition?
CS-US
-gradually strengthens CR (response to drug)
-relatively permanent
what is extinction?
CS - no US
-gradually weakens CR (drug response)
-cues no longer predict drug
what is spontaneous recovery?
reemergence of the extinguished response after a long period of time
what are three things that happens during spontaneous recovery?
disinhibition
renewal effect
reacquisition
what is disinhibition?
the CS (cue) is in a new context
-lack of restraint and wanting immediate gratitfication
what is renewal effect?
extinction in a different context than acquisition
-when returning to same context as acquisition it causes a relapse
what is reacquisition?
CR re-established in few trials back to same strength
-it takes fewer tries of the drug, to bring the tolerance back to where it was
what is a homogeneous response? (in relation to the CR)
the CR is the same as the UR (dog salvation)
what is a heterogeneous response? ( in relation to the CR)
the CR is different then the UR
-EX: Peppermint odor (CS) - Insulin (US) -> hypoglycemia (UR)
Peppermint odor alone (CS) -> hyperglycemia (CR)
what is associative drug tolerance?
an association between predrug cues and the systemic effect of the drug that leads to tolerance
-basically pavlovian conditioning leads to tolerance
-Shepard Siegal (1975)
-due to conditioned compensatory responses (CCR)
what are conditioned compensatory responses?
automatic learned response, even without the US present
-creates the opponent process theory
what is the opponent process theory in general (not relating to conditioning)?
two opposite processes working together
what is the physiological disturbance of the opponent process theory in general (not relating to conditioning)?
“A” process
-initial change away from baseline
what is the compensatory response of the opponent process theory in general (not relating to conditioning)?
“B” process
-trying to bring it back to baseline
-it can decrease below baseline in order to stabilize it
-unconditioned
how is the opponent process theory related to conditioning?
CS: environmental cues (injection, sound, location)
US: drug interacting with receptors
UR: “A process (drug effect, disturbance)
CCR: “B” process (withdrawal symptoms, becomes conditions and starts earlier & stronger overtime)
HETEROGENEOUS
CS (cue) - US (drug action) -> UR (A process)
————overtime with associative tolerance, the B process dominates the A process————-
CS (cue) -> CCR only (B process)
explain the rats with morphine experiment that lead to the mice “overdosing”
-rats were placed into a white box and given the drug until tolerance, then increased the dose (this decreases respiration)
-when placing the mice in a black box and gave the same dose, they died (B process increased respiration)
why did the mice die in the ‘overdosing’ experiment
-the CS was changed which didn’t create the same CR (“B” process)
-this lead to an overpower of the “A” process with nothing to balance it out -> DEATH
what is external inhibition?
disruption of associative tolerance
-no CCR
-EX: Opiate addict
Context: early morning in bathroom
Mom knocks on door -> O.D.
CS (bathroom cues) + extraneous stimulus (knocking on the door) -> no CR (craving)
what is conditioned place preference? (CPP)
the environmental cues associated with drug effects
what three things lead to a homogeneous CR?
placebo effect
sensitization
drug paraphamalia
what three things lead to a heterogeneous CR?
associative tolerance
opioid overdose
drug withdrawal
what is operant conditioning?
acquisition and maintenance of Bx’s through consequences and reward
what are the voluntary/compulsive bx of operant conditioning?
Antecedents (A): cues
Behavior (B): response
Consequences (C): outcome (deemed biologically important)
what is the official terminology of the voluntary/compulsive bx for operant conditioning?
S^D = A
R = B
S^R = C (reinforcer or punisher)
S^D - R -> S^R
what is reinforcement?
makes bx more likely
-contingency: b/w response and outcome (bx adds or subtracts something)
-two types: positive and negative
what is positive reinforcement?
adding a good stimulus
what is negative reinforcement?
takes away or prevents a bad stimulus
what is punishment?
makes behavior less likely
-two types: positive and negative
what is positive punishment?
adding a bad stimulus
what is negative punishment?
taking away a good stimulus
what are primary reinforcers?
unlearned natural responses based on what is biologically important
-appetitive (food, water) and aversive (pain, illness) responses
what are secondary reinforcers?
learned responses from pavlovian conditioning (cues)
-money, praise, drug paraphernalia
what is similar between operant conditioning and pavlovian conditioning?
acquisition, extinction, and spontaneous recovery (disinhibition, renewal effect, reacquisition)
which one (operant or pavlovian conditioning) creates a faster and stronger learning effect?
operant conditioning
-increase the magnitude of reinforcement
what are aversive aftereffects?
the effects that occur after the drug leaves the system
-hangover
explain alcohol and its positive & negative reinforcers, and its aversive aftereffects?
positive reinforcement: pleasant feeling
negative reinforcement: reduce stress, reduce withdrawal
aversive aftereffects: hangover
why do people drink if they keep getting a hangover (punishment)?
it is a delayed response
-creates less effective learning
-if it was an immediate punishment, people wouldn’t drink
how are drug addicts perceived?
weak, poor, minority
-INACCURATE (heroin vs runners high activate same receptors)
what is the difference between abuse and addiction?
abuse: no dependency, use beyond social norms
addiction: dependency, compulsive self-administration
what is the definition of addiction according to the DSM-5? (the distinct qualification to be labeled addicted)
its called substance-related and addictive disorders
-maladaptive use is greater than 1 year
-must be harm/impairment
-follows the specific diagnosis and criteria for each substance
what are the four symptoms of addiction?
-impaired control (compulsive)
-social impairment (hurting relationships)
-risky use (drunk driving)
-pharmacological dependence (tolerance, withdrawal)
what is classified as behavioral addiction according to the DSM-5?
gambling
what is the difference between dependence and addiction?
dependency: passive administration and no compulsive bx, used therapeutically
addiction: compulsive administration and bx (behavior)
what is another term that can be used instead of withdrawal?
abstinence syndrome
what are physiological effects of morphine addiction?
works at opioid receptors, decreases NT
what are physiological effects of cocaine addiction?
increases dopamine in nucleus accumbens, blocks DA reuptake
what are psychological effects of morphine?
-initially euphoria and positive reinforcement
-overtime becomes and escape to withdrawal and and negative reinforcement
what are psychological effects of cocaine?
euphoria and positive reinforcement
what three components are apart of reward? (positive reinforcement)
emotion/affect (pleasure)
motivation (wanting to engage in bx due to incentives)
learning/cognition (expectation of outcome)
all equally independent of each other
what is the incentive sensitization theory?
the increase of salience (importance) of drug to the body due to both positive and negative reinforcement
-emotional cues with drug cues (fav. bong)
-liking vs wanting
what is the difference between liking and wanting?
liking: emotional tie to the euphoria/high you get, achieve tolerance or no change
wanting: incentive and motivation to do drugs, leads to sensitization, increases effect overtime, continues to use regardless if it leads to pleasure, leads to addiction
what is craving?
WANT (not a like)
-due to motivation to experience euphoria and avoid withdrawal
-becomes a conditioned response and gets stronger with more use
-motivates drug-taking b/x that maintains addiction
-becomes involuntary
what are koob’s addiction cycle stages?
binge/intoxication
withdrawal/negative affect
preoccupation/anticipation
what occurs during the binge/intoxication stage?
-making associations and reinforcers that will increase bx
-positive reinforcement
what occurs during the withdrawal/negative affect stage?
-change in NS that leads to tolerance and withdrawal if you were to stop
-negative reinforcement
what occurs during the preoccupation/anticipation stage?
-a stage of abstinence but still having cue-induced cravings
-serves as a motivator to relapse
-stress can induce this
what are the three types of risks associated with addiction? (dependence liability)
learning
individual
environmental
what are learning risks?
-reinforcement (positive and negative)
-aversive aftereffects
-pavlovian and operant conditioning
-delay of reinforcement
what are individual risks?
-motivation (mood modification such as depressed or stressed)
-genetics (predisposition to become addicted)
what are environmental risks?
-availability of drug
-ease of administration (needles, tablet)
-cost (financial, legal, physical)
-acceptability by family, peers, society
which two drugs have the highest addiction risk?
alcohol and nicotine
who discovered the reward system?
Olds and Milner
-used electrical stimulation of the brain as positive reinforcement
what is the mesolimbic pathway?
Vental Tegmental Area (VTA) -> Medial Forebrain Bundle (MFB) -> Nucleus Accumben (NAcc)
what do dopamine (DA) agonists do?
-produce euphoria
-acts as a positive reinforcers to increase the Bx
what do DA antagonists do?
-blocks DA activity which stops the Bx by blocking the positive reinforcement
-also blocks responding for food
how do DA and heroin interact?
Heroin binds at opioid receptors in the VTA that releases DA in the NAcc
-makes it very easy to become addicted by increasing DA -> euphoria!
what does the NAcc do?
pleasure center of the brain that releases DA
-mediates reward
-site of action for positive reinforcement
what mechanisms are involved in positive reinforcement (reward)? (stage, Bx, liking or wanting)
-binge/intoxication stage
-seeking euphoria
-liking/wanting
what mechanisms are involved in negative reinforcement? (stage, Bx, liking or wanting)
-withdrawal/negative affect stage
-escape and avoid withdrawal
-wanting
what mechanisms are involved in drug craving? (stage, what its triggered by)
-preoccupation/anticipation stage
-triggered by association cues
what is the reward circuits?
-mesolimbic/mesocortical DA pathways
-VTA projecting to the NAcc, amygdala, prefrontal cortex, and the caudate putamen (striatum)
what is the anti-reward circuit?
-extended amygdala
-signal goes between central nucleus of the amygdala, shell of the NAcc, and the bed nucleus of the stria terminalis
where is DA in the reward circuits when psychostimulants are present?
NAcc
where is DA in the reward circuits when opioids are present?
VTA, NAcc, and amygdala
where is DA in the reward circuits when alcohol is present?
NAcc and VTA opioid neurons
where is DA in the reward circuits when nicotine & THC are present?
VTA, NAcc, and amygdala
what two drugs is DA being used as positive reinforcement not essential for?
alcohol and heroin
what do endogenous opioids and cannbinoids do to the DA-independent reward system?
-block DA
-DA antagonist
what are the two classes of negative reinforcement? what do they do?
escape: bx terminates bad state
avoidance: bx prevents bad state
which system (reward or anti-reward) produces withdrawal effects?
anti-reward system
how does the anti-reward system produce withdrawal effects?
activates NE, corticotropin-releasing factor (CRF), and dynorphin in the extended amygdala
-shifts the effects from being positive reinforcement to negative reinforcement
what happens at Koob’s within system of neuroadaptation?
-binge/intoxication stage: increase of DA in the NAcc
-withdrawal/negative affect stage
*increase of cAMP & CREB activity
*decrease of D2-R and DA activity in the VTA
what happens at Koob’s between system of neuroadaptation?
continuation of the withdrawal/negative affect stage:
*increase dynorphin (decreases DA) in NAcc
*decreases SA & withdrawal in the NAcc
*increases NE, CRF in extended amygdala
*increases anxiety & withdrawal in the extended amygdala
-preoccupation/ anticipation stage
