test (ch 3 & 4) Flashcards
learning
relatively permanent changes in environment behavior relations due to certain types of experience (environmental interactions)
two types of reflexes
inborn reflex – Unconditional reflexes
Learned reflexes – conditional reflexes
another name for respondent conditioning and/or classical conditioning
pavlovian conditioning
Pavlovian Conditioning procedure
US——-UR (unconditional reflex)
NS——-No UR (Neutral stimulus)
Training
NS—(pairing)—-US—-UR (conditioning)
Testing
CS———- CR (conditional reflex)
the pairing of NS with a well-established CS
Higher-Order
Explanation for classical condition
NS association to US
variables that affect pavlovian conditioning
methods of pairing the NS (CS) and US
CS-US contingency
CS-US (ISI) contiguity
stimulus features
prior experiences with CS and US
Number of CS-US Pairings
Intertrial Interval (ITI)
Other Variables
Variable (2) the Number of methods of Pairing the CS and US
four pairs:
trace conditioning
delayed conditioning
simultaneous conditioning
backward conditioning
CS presented before the US
trace conditioning
CS presented before and overlaps the US
delayed conditioning
CS and US are presented at the same time
simultaneous conditioning
US is presented before the CS
backward conditioning
when is US conditional (dependent) on a CS presentation
variable(2) CS-US Contingency
(CS-US Contingency) All Things Equal…
the greater the contingency, the stronger the conditioning
variable(3) CS-US (ISI) contiguity
interstimulus interval (ISI): time between CS presentation and US presentation
(CS-US Contiguity) All Things equal…
the shorter the ISI, the better conditioning
(CS-US Contiguity) All Things equal… (alternative)
the greater temporal contiguity the better/faster/greater conditioning
Exception to CS-US contiguity (ISI)
conditioned taste aversion
the CS consist of two or more stimuli
compound stimulus
two NS are presented without a US pairing, result no UR. The two NS are then paired with an US, result with a UR. The paired NS (CS) individual are then tested, but one CS becomes a CR and one fails to become a CR
overshadowing
overshadowing is dependent on…
species
CS intensity (magnitude)
US intensity (magnitude)
variable (4) Stimulus features
compound stimulus
overshadowing
variable (5) Prior Experience with CS and US
Latent Inhibition
blocking
sensory preconditioning
NS presented without US, followed by NS presented with US produces UR, but CR magnitude is less or failure of the CR to appear as a result of prior presentation of the CS in the absence of the US.
latent inhibition
latency is dependent on…
contingency
Failure of a NS to become a CS when it is part of a compound stimulus that includes an established CS.
blocking
how is blocking different from overshadowing
(blocking): 1 stimulus is already a CS, blocking a compounded NS with a US from being conditioned, vs. neither stimulus has been established as a prior CS, but one is becomes conditioned and the other is not (or is less so)
A procedure in which two neutral
stimuli are paired, after which one is repeatedly paired with
a US. If the other stimulus is then presented alone, it may
elicit a CR even though it was never paired with the US.
sensory preconditioning
variable (6) Number of CS-US Pairings
the number of CS US paring is a variable affecting pavlovian conditioning
the number of CS US pairing is____
a curvilinear relationship
Intertrial Interval (ITI)
the time period between two trials
(Intertrial Interval [ITI]) all things equal
the longer the ITI, the better conditioning
what depends on ITI
the length of ITI depends on relationships, species, intensity of the stimulus
Pavlovian (classical) extinction
procedure (or operation)
present CS alone without US.
Pavlovian extinction process (or result)
the CS is less likely to elicit the CR
deterioration in performance following a period with-out practice
forgetting
after a period of time passes with no training after a CS is established and extinguished, the CS will once again elicit the CR
spontaneous recovery
theories of classical conditioning
stimulus substitution theory
preparatory response theory
compensatory response theory
rescorla-wagner model
other theories
(Pavlov) stimulus substitution theory
the CS substitutes for the US because the UR and the CR are the same
the ways the CR is not identical to the UR
CR to the UR is:
weaker
less reliable
longer latency
& there are qualitative differences
the CR is somtimes opposite to the the UR
How is CR is sometimes opposite of the UR
Tone paired with a shock, prepares the heart by decreasing heart rate in preparation for the shock, the opposite to the expected heart rate increase to due to Pavlovian conditioning
reduced sensitivity to pain to morphine, but increased sensitivity to pain with a CS paired with morphine.
the CR prepares the organism for the US
Preparatory response theory
variation of the preparatory response theory that proposes that the CR prepares the organism for the US by compensating for its effects.
compensatory response theory
a_______explanation is the one that makes the fewest assumptions
parsimonious (the law of parsimony)
all behavior is caused
behavior is lawful and orderly
determinism
any energy change that affects sensory receptors, and behaviors
stimulus
all stimuli that affect behavior at any given moment
environment
deal with physical phenomena and understand how things in the physical world operate
natural science approach
is an explanation in which the evidence for the explanation is the same as the behavior to be explained
circular explanation
small, random, (in)heritable differences among individuals that rtesult in different chances of reproduction
natural selection
the first person to study human emotions systematically
John Watson
use of Pavlovian conditioning to reverse unwanted effects
counterconditioning
A form of counterconditioning in which a patient imagines progressively anxiety evoking scenes while relaxed
Systematic desensitization
person is gradually exposed to the fear-evoking stimulus while feeling relaxed
Exposure therapy
A form of exposure therapy that relies on technology that creates simulated scenes that arouse anxiety.
Virtual reality exposure therapy
perverse or unnatural ways someone receives sexual pleasure
Paraphilias
a CS that elicits inappropriate sexual arousal is followed by a noxious US.
Aversion therapy
An aversion to foods with a particular flavor acquired through Pavlovian conditioning
Conditioned taste aversion (aka conditioned food avoidance)
A taste (NS) is paired with a US (e.g., poison) that makes the organism sick such that the taste becomes a CS for sickness (CR)
Taste-aversion experiments
(1) the CS and US occur together (are paired) only once; (2) the interval between the CS and US (the ISI) is much longer
Two important ways taste aversion differs from typical Pavlovian conditioning procedure
After a period of repeated drug use, more of the drug is required to produce a high, or, the same amount of drug produces less of an effect
Tolerance
the opposite of the main drug effect
withdrawal
drugs that produce physical dependence
opiates
alcohol
nicotine
caffeine
barbiturates
benzodiazepines
sleeping medication
drug users respond in anticipation of drugs….
preparatory response
the response of withdrawal symptoms is a…
compensatory response
Drug Dependence (Siegel 2005)
US————–>UR
Drugs. comp. Rest
NS————->NO UR
drug cues
CS————–>CCR
drug cues Conditional CR
together, the exteroceptive drug cues, and interoceptive cues can be defined as….
the situation specificity of tolerance and withdrawal
self-administration cues elicit conditional compensatory responses (preparatory responses)
interoceptive drug cues
treatments designed to extinguish the association between pre-drug cues and systemic effects of the drug
cue-exposure therapy
treatment protocol should be more effective if it incorporates extinction of ______ cues and _____ cues as well as ____
drug-onset
self-administration
exteroceptive
the CR____ prepared the user for the the ____ (Drug)
conditional compensatory response (CCR)
Unconditional Stimulus (US)
Behavior is a function of its consequences
Law of Effect
Any procedure or experience in which a behavior becomes stronger or weaker (e.g., more or less likely to occur), depending on its consequences
Operant conditioning (learning
- a behavior must have a consequence
- the behavior must increase in strength
- the increase in Strength must be the result of the consequence
three characteristics to qualify as reinforcement
three characteristics to qualify as reinforcement
- a behavior must have a consequence
- the behavior must increase in strength
- the increase in Strength must be the result of the consequence
the consequence is added (or presented)
Positive reinforcement
the consequence is subtracted (or withdrawn or removed)
Negative reinforcement (aka escape and avoidance learning)
A term used to refer to the strength of a reinforced behavior.
Behavioral momentum
reinforcers not dependent on learning experiences
Unconditioned (primary) reinforcement
reinforcers dependent on learning experiences
Conditioned (secondary) reinforcement
Reinforcers that have been paired with many different kinds of reinforcers.
Generalized conditioned reinforcement
events that follow spontaneously from a behavior
Natural reinforcers
events that are provided by someone for the purpose of modifying behavior.
Contrived reinforcers
reinforcing events are the automatic consequence of an action (see natural reinforcers)
Automatic reinforcement
the degree of correlation between a behavior and its consequence
Contingency
the gap in time between a behavior and its reinforcing consequence
Temporal contiguity
anything that changes the effectiveness of a con- sequence
Motivating operations –
The reward center of the brain, in particular, an area in the septal region running from the middle of the brain to the frontal cortex where dopamine is the most important neurotransmitter
Reward pathway/dopamine
three major theories of positive reinforcement
hull drive reduction theory
Premack’s relative value theory
Response deprivation theory
hull drive reduction theory
Premack’s relative value theory
Response deprivation theory
three major theories of positive reinforcement
Hull’s drive reduction theory
attributes a reinforcer’s effectiveness to the reduction of a drive.
attributes a reinforcer’s effectiveness to the reduction of a drive.
Hull’s drive reduction theory
considers reinforcers to be behaviors rather than stimuli and that attributes a reinforcer’s effectiveness to its probability relative to other behaviors.
Premack’s relative value theory
High-probability behavior reinforces low-probability behavior.
Premack principle
