Learning, CBT, Memory Flashcards
List the 3 major factors that contribute to the effectiveness of classical conditioning.
(Classical conditioning)
- Temporal relationship between the CS and US
- Number of conditioning trials
- Pre-exposure to the CS or US
List the types of temporal relationships in classical conditioning
(Classical conditioning)
- Delay conditioning
- Trace conditioning
- Simultaneous conditioning
- Backward conditioning
Delay conditioning
Classical conditioning
Presenting the CS so it precedes and overlaps (.5s) presentation of US
*most effecient, will establish a strong response
Trace conditioning
classical conditioning
Presenting and terminating the CS prior to presenting the US
Produces a weaker CR than delayed conditioning
Simultanous conditioning
Classical conditioning
Presenting and withdrawing the CS and US simultaneously together
Produces a weaker CR than both delayed and trace conditioning
Backward conditioning
Classical conditioning
Presenting the US prior to the CS
Does not usually produce a CR; essentially ineffective
Number of conditioning trials
Classical conditioning
the greater the number of conditioning trials, the stronger and more persistent the CR will be
Regardless of the number of trials, the CR is usually weaker in magnitude and intensity than the UR
Pre-exposure to CS or US
Classical conditioning
repeated exposure to the US or intended CS before the CS and US are paired slows down the acquisition of the CR
psychic excretion
classical conditioning
AKA conditioned reflex; result of mental activity
classical conditioning
explains how certain stimuli automatically elicit a particular response
Pavlov’s signature experiment of classical conditioning
classical conditioning
Pairing a US (meat powder) with a CS (tone) to elicit a CR (salivation)
unconditioned stimulus (US)
Classical conditioning
stimulus that naturally elicits a certain physiological response
(e.g., meat powder)
unconditioned response (UR)
classical conditioning
physiological response that is naturally elicited by the presentation of an unconditioned stimulus
(e.g., salivation)
conditioned stimulus (CS)
Classical conditioning
aka neutral stimulus
stimulus that is paired with a US to elicit that same physiological response
(e.g., tone)
conditioned response (CR)
classical conditioning
physiological response that is conditioned (trained) to occur after being presented with the pairing of a CS and US
(e.g., salivation)
classical extinction
classical conditioning
gradual disappearance of CR due to repeated presentation of the CS alone
(e.g., no more salivation when the tone is presented by itself)
spontaneous recovery
Classical conditioning
suppression of the CR vs. being eliminated entirely by extinction trials
-learning is never fully lost, but inhibited
2 important characteristics of classical conditioning:
classical conditioning
- Following extinction, fewer trials are needed to re-establish the CS-CR relationship than were needed to establish it initially
- CR rarely extinguishes all at once (i.e., spontaneous recovery)
stimulus generalization
classical conditioning
when the individual produces a CR to not only the CS but to stimuli that are similar to the CS
(e.g., salivating to both a 500 Hz tone (CS) and to 400 Hz and 600 Hz tones)
may not be confined to a single sense modality (e.g., picture of bell or spoken word “bell”)
stimulus discrimination
classical conditioning
OPPOSITE of stimulus generalization
ability to discriminate between the CS and similar stimuli AND only respond with a CR to the CS
established through discrimination training
discrimination training
classical conditioning
process to extinguish stimulus generalization through selective reinforcement and extinction
(e. g., to eliminate stimulus generalization to a dog conditioned to salivate (CS) at 500 Hz tone (CS)
- - the 500 Hz tone must be consistently followed by presentation of meat powder
- - the 400 Hz and 600 Hz tones must be presented repeatedly without meat powder
experimental neurosis
classical conditioning
variety of uncharacteristic behaviors (e.g., restlessness, agitation, unprovoked aggressiveness) exhibited by very difficult discriminations
-may result from conflict between cortical excitation and inhibition
higher order conditioning
classical conditioning
-AKA second order conditioning
when a 2nd NS is repeatedly paired with a previously CS, the 2nd NS eventually produces a CR
(e. g., dogs who learned to salivate to a tone were exposed to conditioning where a flashing light was repeatedly present right before the tone
- – tone = US when paired with light
- – after several trials, light alone (CS) elicits salivation (CR)
blocking
classical conditioning
occurs after an association is made between the CS (tone) and US (meat powder)
presence of CS (tone) BLOCKS the association between a 2nd NS (electric shock) and US (meat powder) when the CS (tone) and 2nd NS (shock) are presented together PRIOR to the US (meat powder)
(e. g., tone (CS) paired with electric shock (2nd NS)
- - tone alone (CS) will produce a fear reaction (CR)
blocking
classical conditioning
occurs after an association is made between the CS (tone) and US (meat powder)
presence of CS (tone) BLOCKS the association between a 2nd NS (electric shock) and US (meat powder) when the CS (tone) and 2nd NS (shock) are presented together PRIOR to the US (meat powder)
(e. g., tone (CS) paired with electric shock (2nd NS)
- - tone alone (CS) will produce a fear reaction (CR)
blocking
classical conditioning
occurs after an association is made between the CS (tone) and US (meat powder)
presence of CS BLOCKS the association between a 2nd NS and US when the CS and 2nd NS are presented together PRIOR to the US
- occurs because the CS (tone) already predicts the occurrence of the 2nd NS (shock), so the new stimuli (light) is only providing redundant information
(e. g., tone (CS) paired with electric shock (2nd NS) –> produces a fear reaction (CR)
- - tone alone (CS) will produce a fear reaction (CR)
- -then tone (CS) presented with light (3rd NS) prior to shock (2nd NS)
- -flashing light (3rd NS) alone will NOT produce a fear response (CR)
overshadowing
classical conditioning
2 neutral stimuli (vs. a CS with a new NS) are repeated together prior to presentation of a US
the 2 stimuli together produce a CR, but when the 2 are presented separately, only 1 of them produces a CR
1 stimuli is more salient to the subject
(e. g., tone with a flashing light are paired together and then is followed by a shock, which produces a paired fear reaction
- -the tone and light are presented separately, ONLY 1 of those will elicit the fear reaction)
Two primary researchers of classical conditioning
Ivan Pavlov
John B. Watson
John B. Watson
Classical conditioning
“father of American behaviorism”
believes that you need to study observable, measurable behaviors
used classical conditioning to establish a phobia in 11-month old Little Albert
Little Albert experiment
classical conditioning
unexpected loud noise (US) naturally elicited startle response (UR)
exposed Little Albert to conditioning of white rat (CS) prior to the noise
after 1 week, rat alone (CS) elicited a startle response (CR)
experiment of stimulus generalization— fear of all furry white objects
What do interventions based on counterconditioning seek to do?
(classical conditioning)
eliminate a maladaptive behavior by pairing a stimulus (CS) associated with that behavior with a stimulus (US) that naturally elicits an incompatible behavior
Reciprocal inhibition
Classical conditioning
- Intervention based on counterconditioning by Wolpe, 1958
- can be used to weaken and eliminate anxiety reactions
- **if the response is antagonistic to anxiety it can be made to occur in the presence of anxiety-evoking stimuli so that it is accompanied by a complete or partial suppression of anxiety responses
- the bond between these stimuli and anxiety response will be weakened
e. g., relaxation, assertiveness, sexual arousal
- the bond between these stimuli and anxiety response will be weakened
What are two of the interventions based on counterconditioning?
(classical conditioning)
- systematic desensitization
2. Behavior sex therapy
What is systematic desensitization and list the 4 stages?
classical conditioning
- an application of reciprocal inhibition for eliminating anxiety responses
1. Relaxation training
2. Construction of anxiety hierarchy
3. Desensitization in imagination
4. in-vivo desensitization
Relaxation training
classical conditioning
therapist teaches client to use a technique that produces a state of relaxation
e.g., PMR, guided imagery
Construction of anxiety hierarchy
classical conditioning
client and therapist construct and anxiety hierarchy which consists of events related to target behaviors and are derived on the basis of anxiety that they provoke
-use Subjective Units of Distress Scale (SUDS) to rate from 0 (no anxiety) to 100 (severe anxiety)
Desensitization in Imagination
classical conditioning
pair relaxation with items in the anxiety hierarchy beginning with the least anxiety-provoking item
- therapist then instructs patient to relax using a technique learned in Stage 1
- once patient is relaxed, therapist instructs him/her to imagine appropriate anxiety hierarchy item
- client signals therapist whenever he/she feels anxious, and therapist helps client re-establish a state of relaxation using a relaxation technique
- when client is able to imagine an item without experiencing anxiety, the next item in the hierarchy is presented
- this process is repeated until the client can imagine the most anxiety-causing item without experiencing anxiety
In Vivo Desensitization
classical conditioning
after the client is desensitized to 75-85% of items in the anxiety hierarchy, then he/she begins to confront anxiety arousing situations in vivo, if feasible to do so
**highly structured, facing “real life” only situations that correspond to hierarchy items that have been successfully desensitized in imagination
Evaluation of systematic desensitization
classical conditioning
- use a dismantling strategy– identify mechanisms responsible for the benefits of systematic desensitization
- compare the effects of various components of a treatment by administering different components to different groups of participants
- RESULTS: training in an incompatible response and gradual exposure to anxiety-evoking events are not essential components of systematic desensitization and that extinction or repeated exposure to CS without US – the primary factor responsible for its effects
Behavior Sex Therapy
classical conditioning
- counter-conditioning treatment used to help with sex d/o related performance anxiety
- pairing situations that evoke performance anxiety with pleasurable physical sensations and relaxation
- *partners are told to refrain from genital sex and given a series of homework assignments that involve taking turns and giving and receiving pleasure through touch
- initial HW: non-genital touching
- then increase to more intimate encounters that eventually include non-demand genital touching
- EVALUATION: most effective for treatment of premature ejaculation and vaginismus
Name two interventions based on aversive conditioning
classical conditioning
- In vivo aversion (over sensitization)
2. Covert sensitization
Describe interventions based on aversive conditioning
-maladaptive behavior or stimulus associated with it (CS) is paired with a stimulus (US) that naturally evokes pain or other unpleasant response
In vivo aversion therapy
classical conditioning
- most effective for SUD, paraphilias, SIB
- target bx is paired with an aversive stimulus (e.g., electric shock, noxious odor, emetic- nausea inducing drug)
- e.g., eliminate a sexual fetish by pairing the fetish object (CS) with an electric shock (US) so that eventually the fetish object is avoided because it produces an unpleasant sensation (CR) vs. sexual arousal
Evaluation (effectiveness) of in vivo aversive therapy
classical conditioning
moderately effective initially for some patients and problems (eg., tobacco cessation) but has a HIGH relapse rate
- *most successful when aversive stimulus or its consequences are similar to target bx
- e.g., nausea inducing drugs are more effective for alcoholism than an electric shock
- *more effective when supplemented with “booster sessions” or with other treatments
e. g., paraphilia: combo aversion with orgasmic reconditioning, relapse prevention
Covert sensitization
classical conditioning
imagines engaging in maladaptive behavior and then imagines (vs. confronts) the aversive stimulus
- e.g., TC- imaging smoking and becoming nauseated by it, throwing up on floor, etc.
- accompanied by a “relief scene” where something pleasant happens
e. g., nonsmoking is accompanied by pleasant sensations
Describe the theory most related to classical extinction interventions
(classical conditioning)
Mowrer’s 2 Factor Theory
- says that development of a phobic response is the result of both classical and operant conditioning
- a person develops an anxiety reaction to a neutral stimulus (CS) when it is paired with a stimulus (US) that naturally elicits anxiety or other aversive responses (classical conditioning)
- the person then avoids the CS because doing so enables him/her to avoid anxiety (negative reinforcement)
- repeatedly exposing the client to the CS without the US while inhibiting his/her usual avoidance response in order to extinguish the client’s CR
Name the three types of classical extinction therapies
classical conditioning
- in vivo exposure with response prevention
- implosive therapy
- eye movement desensitization and reprocessing (EMDR)
in vivo exposure with response prevention
classical conditioning
- client is exposed in “real life” to anxiety- arousing stimuli for a prolonged period of time and is prohibited from making his/her usual avoidance or other anxiety reducing response
e. g., OCD– exposing client to obsessional cues while prohibiting the client from engaging in usual rituals - one technique is called FLOODING
flooding
classical conditioning
type of in vivo exposure with response prevention intervention
- exposure to MOST anxiety or fear-arousing stimuli for a prolonged period of time
- while graduated exposure (graded) begins with exposure to situations that produced minimal anxiety and then gradually progresses to those that are more anxiety provoking
- helpful for decreasing fear and avoidance that may be caused by initial exposure to high-anxiety arousing situations
evaluation (effectiveness) of in vivo exposure
classical conditioning
- exposure to distressing stimulus and response prevention are both essential components of treatment
- prolonged continuous (massed) exposure to anxiety-arousing stimulus is usually more effective than several brief exposures
- high anxiety provocation during exposure may not be necessary for success
- e.g., simultaneous use of a tranquilizer (to decrease anxiety) may enhance the effectiveness of the exposure)
- self-directed exposure can be as effective as therapist-directed
- group exposure can be as effective and individual treatment
- partner-assisted exposure is effective for agoraphobia
introceptive exposure
classical conditioning
type of in vivo exposure with response prevention
- effective for decreasing panic attacks associated with panic disorder and other anxiety disorders
- involves use of strategies designed to evoke the feared bodily cues associated with fear and anxiety reactions (e.g., spinning in a chair, breathing into a paper bag, cardiac exercise)
Implosive therapy
classical conditioning
based on the assumption that certain events (conditioned stimuli) are consistently avoided to reduce anxiety and that prolonged exposure to those events without US will produce extinction of anxiety response
- conducted in imagination
- involves presenting feared stimulus vividly so as to arouse high levels of anxiety
- Stampfl (1966)- believed avoidance behaviors are learned during childhood and represent conflicts related to sexual or aggressive impulses
Eye Movement Desensitization and Reprocessing (EMDR)
classical conditioning
initially developed as a PTSD tx, also used for panic attacks, phobias, depression, SUD
- assumption: exposure to a trauma can block neurophysiological adaptive information-processing mechanisms
- combines rapid lateral EMs with exposure and other techniques from CBT, psychodynamic
- **controversy on whether the benefits actually depend on EMs
Operant conditioning
identifies the factors responsible for acquisition and maintenance of complex voluntary behaviors
Who are the to primary theorists associated with operant conditioning?
Edward Thorndike
B.F. Skinner
Describe Edward Thorndike’s theory of operant conditioning
-stated that learning is due to connectionism (relationship between responses and stimuli as a result of instrumental [trial and error learning])
study of learning in lower animals reveals important information about human learning
Describe the animal experiment associated with Thorndike.
operant conditioning
“puzzle boxes”- placing a hungry cat in one of these and requiring them to make a certain response (e.g., pull a string loop) in order to escape the box and obtain food
- during the early trials, cats engage in numerous unproductive activities before making a response that permits escape
- and the number of trials increases, the cat makes the correct response sooner and sooner
law of effect
operant conditioning
with Thorndike’s theory
- a. any response followed by a “satisfying state of affairs” is likely to be repeated
b. any response that produces an “annoying state of affairs” is less likely to recur - **Thorndike later eliminated part b because he found that consequences tended to have little effect
Describe B.F. Skinner’s theory of operant conditioning
added to Pavlov’s model that classical conditioning is effective for explaining acquisition of respondent behaviors automatically elicited by certain stimuli
-BUT ADDED that the most complex behaviors are voluntarily emitted or not emitted as result of way they “operate” in environments
-coined the concepts of reinforcement and punishment
List the primary concepts that are component’s of Skinner’s theory of operant conditioning (there are 9)
- Reinforcement and punishment
- Operant extinction and behavior contrast
- Primary and secondary reinforcers
- Schedules of reinforcement
- Matching Law
- Superstitious behavior
- Stimulus control
- Stimulus and response generalization
- Escape and avoidance conditioning
reinforcement and punishment
operant conditioning, Skinner
the environment provides positive and negative CONSEQUENCES that cause people to display or withhold behavivors that preceded them
reinforcement- increase the behavior
punishment- to decrease or eliminate the behavior
positive and negative
operant conditioning, Skinner
positive = application of stimulus negative = withholding or removing a stimulus
positive reinforcement
operant conditioning, Skinner
performance of a behavior that increases the results of application of a stimulus (reinforcer) following a behavior
- associated with REWARD
e. g., Thorndike’s puzzle boxes– pulling on the string was increased over time because it lead to the reward of food
negative reinforcement
operant conditioning, Skinner
performance of a behavior is increased as a result of removing or withdrawing a stimulus (reinforcer) following a behavior
- associated with RELIEF
e. g., pulling a lever to STOP (relieve) an electric shock– lever pressing increases because it is being negatively reinforced)
positive punishment
operant conditioning, Skinner
application of a stimulus following a response, which then later decreases that response
- associated with PAIN
- e.g., slapping a dog with a rolled up newspaper after he chews your favorite shoe in order to stop the chewing behavior
negative punishment
operant conditioning, Skinner
removal or termination of a stimulus following the behavior in order to reduce the behavior
- associated with LOSS
- e.g., taking away a child’s allowance when she acts aggressively toward her younger sibling to decrease the aggression
Describe Skinner’s famous experimental paradigms for operant conditioning
“operant chamber” aka “Skinner box”
examining behaviors of pigeons or rats — either bar pressing or key pecking
trying to measure operant strength
operant strength
operant conditioning, Skinner
a. determines the rate of responding during acquisition trials
b. total number of responses made during extinction trials (period without reinforcement)
operant extinction
operant conditioning, Skinner
reinforcement is consistently withheld from a previously reinforced behavior to decrease or eliminate that behavior
- withdrawal of a reinforcer does not usually cause an immediate cessation of the response
- the response gradually disappears after an initial phase in which responding is more variable and forceful
e. g., if a rat has been reinforced for bar-pressing, a sudden withdrawal of reinforcement will initially cause the rat to bar-press more than usual before bar pressing begins to decline
- the response gradually disappears after an initial phase in which responding is more variable and forceful
extinction burst
operant conditioning, Skinner
aka response burst
- temporary increase in responding during extinction trials
- behavioral contrast can occur as a result of it
behavioral contrast
operant conditioning, Skinner
- occurs when the subject is reinforced for 2 different behaviors and reinforcement for 1 behavior is withdrawn in order to extinguish it, and other behavior is likely to increase
e. g., rat is reinforced for pressing a round button and square button. Then reinforcement for round button is stopped. The round button pressing decreases and the square button pressing will increase
primary reinforcer
operant conditioning, Skinner
aka UNCONDITIONED reinforcer
- inherently desirable and DON’T depend on experience to acquire the reinforcing value
e. g., food, water
secondary reinforcers
operant conditioning, Skinner
aka CONDITIONED reinforcers
- acquire value only through repeated association with primary reinforcers
e. g., tokens, applause, gold stars
generalized secondary reinforcer
operant conditioning, Skinner
occurs when a secondary reinforcer is paired with several different primary reinforcers
e.g., money— can be exchanged for a variety of primary reinforcers
Name the two categories of schedules of reinforcement
operant conditioning, Skinner
continuous schedule
intermittent (partial) schedule
continuous schedule
operant conditioning, Skinner
when reinforcement is presented after each response
-rate of acquisition of behavior is fastest
intermittent (partial) reinforcement schedule
operant conditioning, Skinner
once an operant condition has been acquired, the best way to maintain a behavior is to switch it to 1 of these 4 types
Name the four types of intermittent (partial) reinforcement schedules
(operant conditioning, Skinner)
- Fixed interval (FI)
- Variable interval (VI)
- Fixed ratio (FR)
- Variable ratio (VR)
Describe a fixed interval (FI) reinforcement schedule
operant conditioning, Skinner
reinforcement is delivered after a fixed period of time regardless of number of responses made
e. g., rat of FI-30 receives reinforcement every 30s whether it makes 1 or 50 responses during the 30s period
- tends to produce LOW rates of responding because the number of responses is unrelated to the delivery of the reinforcement
- typically STOP responding after a reinforcer is delivered and then begin responding again toward the end of the reinforcement interval, which produces a “scallop” in cumulative recording of number of responses made
- in the work setting, FI tends to produce MINIMAL levels of work
Describe a variable interval (VI) schedule of reinforcement
operant conditioning, Skinner
interval time between delivery of reinforcer varies in an unpredictable manner from interval to interval
- under VI-30 schedule, rat might be reinforced at 15, 40, 30, 20, or 45 s AS LONG AS they press the level ONCE during each of the intervals
- produces a steady but relatively LOW rate of responses
- schedule used when a specific number of “pop” quizzes will be given during a semester, but exact amount of time in between the quizzes varies
Describe a fixed ratio (FR) reinforcement schedule
operant conditioning, Skinner
reinforcer is delivered each time the subject makes a specific number of responses
e.g., pigeon on F-6 is reinforced with a food pellet every 6th peck
-there is an EXPLICIT relationship between the reinforcer and the response and therefore it produces a relatively HIGH, STEADY, rate of responding with a brief pause following delivery of the reinforcer
piecework- workers receive payment following completion of a specific number of units
Describe a variable ratio (VR) reinforcement schedule
operant conditioning, Skinner
reinforcers after a variable number of responses
e. g., VR-20 schedule, the average number of responses receiving reinforcement will be about 20 but the exact number varies from reinforcer to reinforcer (might be every 20, 15, 25 responses)
- unpredictable relationship between reinforcer and response leads to an INCREASE in rates of responding and responses that are MOST RESISTANT to extinction
e. g., gamblers playing the slot machines
matching law (definition and experimental example)
operant conditioning, Skinner
-predicts the correspondence between responding to 2+ alternatives and frequency of reinforcement for responding
concurrent schedules of reinforcement used, which provides 2 or more simultaneous and independent schedules of reinforcement, each for a different response
e.g., rat in a cage with 2 levers– lever 1 delivers reinforcement on a VI-30s schedule and level 2 delivers reinforcement on a VI-60s schedule
***rat will match the relative frequency of lever presses to relative frequency of reinforcement obtained with each lever; so the rat will press VI-30s 2x as often as the VI- 60s
superstitious behavior
operant conditioning, Skinner
accidental, noncontingent reinforcement can lead to this
display variety of odd, ritualistic-like behaviors (head bobbing, turning counter-clockwise) right before reinforcement occurs
e.g., if you reinforce pigeons with food every 15s regardless of what they are doing, they may engage in this behavior
stimulus control
operant conditioning, Skinner
aka stimulus discrimination
- occurrence of behavior is affected by the presence of discriminative- stimuli (positive or negative discriminative stimulus)
- whether or not a response is reinforced may be signaled by cues in the environment
- example of two factor learning: performance of the behavior is due to operant conditioning because the organism performs the behavior because it is being reinforced to do so
- e.g., explains why a baby whines in the presence of their father (positive discriminative stimulus, ) who reinforces this behavior by picking the kid up but not the mother (negative discriminative stimulus, stimulus delta)
Describe Skinner experiment for stimulus control
operant conditioning
Pigeon might be reinforced for pecking a key when a GREEN light is on but NOT when a RED light is on
-result: pigeon will only peck the key in the presence of the GREEN light
- GREEN light = positive discriminative stimulus (S^D)
- RED light = negative discriminative stimulus (S-)