Ch 5.1-5.2 Flashcards
nonassociative learning
occurs when organism is repeatedly exposed to 1 type of stimulus
does not contain any reinforcement or punishment
2 types of nonass learning
habituation
sensitization
habit
action that is performed repeatedly until it becomes auto
habituation
we still have the same stimulus, but with every progressive episode of the stimulus , the response decreases
decrease in response to stimulus after repeated presentations
dishabituation
occurs when previously habituated stimulus is removed
person is no longer accustomed to the stimulus
if stimulus is presented again, the person will react to it as if it was a new stimulus
recovered or restored behavioral response where reaction towards known stimulus is enhanced
sensitization
opposite of habituation
response increases with every episode of the stimulus
increase in responsiveness due to either a repeated application or a particularly aversive or noxious stimulus
produces a more exaggerated response
sensitization vs habituation
sensitization is usually temporary , may not result in any type of long term behavior change
habituation form of learning that does not require concious learning or motivation
desensitization
stimulus that previously evoked an exaggerated response ( sth that we were sensitized to) no longer evokes an exaggerated response
diminished emotional responsiveness to negative or positive stimulus after repeated exposure to it
desensitization or sensitization
vs habituation or dishabituation
desens: change in physiological response
( sensory receptors start or stop responding )
dishab: change in cognitive response ( brain does on does not realize something is there
desens vs habituation
desensitivation downreg or decreased response in receptors , causes less sensation
habituation mental process that you no longer conciously notice the stimulus, your ears still pick it up but your brain ignores it after a while
associative learning
process of learning in which one event, object or action is directly connected with another
2 categories of associative learning
classical conditioning
operant conditioning
classical conditioning definition
aka respondent condtioning
process in which 2 stimuli are paired in such a way that the response to one of the stimuli changes
refers to the learning process which results from the pairing of a biologically potent stimulus with a neutral stimulus
ex of classical conditioning
pavlovs dogs
Pavlov trained his dogs to salivate at the sound of the ringing bell
natural behavior of dogs
dogs naturally salivate at the sight and smell of food, it is a biological response which prepares dogs for food consumption
stimulus ( food) naturally produces this response ( salivating) dogs do not intrinsically react to the sound of a bell in any particular way
Pavlovès experiment
paired the sound of the bell ( auditory stimulus) with the presentation of food to the dogs and after a while, the dogs began to salivate to the sound of the bell even in the absence of food
process of pairing the two initially unrelated stimuli changes the dogs response to the sound of the bell over time and they become conditioned to salivate when they hear it. dog effectively learned that the sound of the bell was meant to announce food
neutral stimulus
stimulus that initially does not elicit any intrinsic response
stimulus which does not elicit any response on its own
neutral stimulus for Pavlov
sound of the bell prior to the experiment
unconditioned stimlus ( US)
is stimulus which initiated unconditioned response ( UR)
unconditioned refers to the fact that no learning took place to connect the stimulus to the response
US for Pavlov
presentation of food is US and UR is the salivation
conditioned stimulus
CS
originally neutral stimulus ( bell) that is paired with unconditioned stimulus ( food) until it can produce a conditioned response ( salivation) without the unconditioned stimulus ( food)
the neutral stimulus once it gains the ability to elicit a conditioned response
conditioned response
CR
learned response to the conditioned stimulus
same as unconditioned response, but now occurs without the unconditioned stimulus
CR for doggs
salivating at the sound of the bell is the conditioned response
Three stages of conditioning
1 before
2 during
3 after
before conditioning
unconditioned stimulus produces unconditioned response
neutral stim produces no unconditioned response
before for pavlov
food produces salivation
bell produces no salivation
during conditioning
neutral stimulus is associated with the unconditioned stimulus to form the conditioned stimulus
during stage the UCS must be associated with the neutral stimulus on a number of occasions or trials in order for learning to take place
after conditioning
conditioned stimulus creates a conditioned response
processes by which classically conditioned responses are developed and maintained
acquisition extinction spontaneous recovery generalization discrimination
acquistion and dog ex
process of learning the conditioned response
time during the experiment when the bell and food are always paired
stimulus
anything that stimulates your senses
anything you can hear, see, smell touch
unconditioned
innate process
anything that you can do naturally
conditioning
learning
extinction
occurs when conditioned and unconditioned stimuli are no longer paired so the conditioned response eventually stops occuring
when CS is presented continuously without the UCS
extinction ex with pavlovs dogs
after the dogs have been conditioned to salivate at the sound of the bell, if the sound is presented to the dogs over and over without being paired with food, then after some period of time, the dogs will eventually stop salivating at the sound of the bell
spontanous recovery
when extinct conditioned response occurs again when the conditioned stimulus is presented after some time
does not last very long
spont ex with pav dogs
if the behavior of salivating to the sound of the bell becomes extinct in a dog, and it is then presented to the dog again after some amount of lapsed time and the dog salivates, the conditioned response was spontaneously recovered
generalization
process by which stiuli other than the original conditioned stimulus elicit the conditioned response
tendency for a stimulus, similar to the conditioned stimulus, to elicit a response similar to the conditional response
more similar the stimulus is to the CS, the stronger the CR will be
generalization ex with pav dogs
if dogs salivate to the sound of a chime or a doorbell, even though those were not the same sounds as the conditioned stimulus, the behavior has been generalized
discrimination
opp of generalization
occurs when the conditioned stimulus is differentiated from other stimuli
the conditioned response only occurs for conditioned stimuli
when animal knows to make a response to some stimuli but not all stimuli
discrimination ex with pav dogs
if the dogs do not salivate at the sound of a buzzer or a horn, they have differentiated those stimuli from the sound of a bell
adaptive value to generalization
allows us to make appropriate responses to similar stimuli
adaptive value of disc
it is important to respond differently to similar stimuli
would not want to respond to all loud sounds in the same way
concept of extinction therapy
used by therapists to treat phobias
if you are afraid of heights
expose you to different heights and eventually, the stimulus of heights will not elicit the same response of fear
taste aversion
caused by nausea and or vomiting
powerful long lasting association
development of taste aversion
org eats a specific food and becomes ill a few hours later will generally develop a strong aversion to that food
most org develop an aversion to smell or taste, but possible to develop aversion to the sight of the food
function of taste averson
prevent org.m from consuming sth that might be toxic or poisonous in the future
response happens to be one that does not need a long acquisition phase ( typically acquired after one exposure) and has a very long extinction phase or never extinguishes
operant conditioning
uses reinforcement ( pleasureable consequences) and punishment ( unpleasant consequences) to mold behavior
classical and operant similarity
timing is everything
classical: important for NS to be paired with UCS for them to occur together or very close together in time in order for the neutral stimulus to become coonditioned
operant: imp for reinforcement or punishment to occur around the same time as the behavior in order for the learning to occur
BF Skinner
conducted research in operant conditioning
worked with animals and designed an operant conditioning chamber ( later called Skinner box) that he used to shape animal behavior in series of experiments
Skinner experiments reward
one series of experiments, hungry rat would be placed inside SKinner box that contained a lever
food pellet will drop into the box if the rat pressed the lever
often first time the rat pressed the lever was by mistake, but after discovering that food would appear in response, the rat would continue to do so until satiated
Skinner exp punishment
in another series of exp, Skinner box is wired to give a painful electirc shock until a lever was pushed
rat would run around trying to avoid the shock at first, until accidentally hitting the lever and causing the shock to stop
in repeated trials, rat would quickly push the lever to end the painful shock
Reinforcement
anything that will increase the likelihood that a preceding behavior will be repeated
behavior is supported by reinforcement
2 main types of reinforcement
positive
negative
positive reinforcement
some sort of desirable stimulus that occurs immediately following a behavior
pos reinforcement rat case
food pellet is pos rein for the hungry rat because it causes the rat to repeat the desired behavior ( push the lever)
neg rein
some sort of undesirable stimulus that is removed immediately following a behavior
neg rein rat case
electric shock is neg rein for rat because causes the rat to repeat the desired behavior ( push the lever) to remove the undesirable stimulus ( painful shock)
reinforcer
anything that increases a desired behavior
+ and - increase desired behavior but process by which they do so is diff
+ rein and stimulus
rein by adding a + stim (desirable)
- rein and stim
rein by removing a - stim ( undesirable)
+ rein and - rein
+ adds
- subtracts
amygdala
imp in - conditioning
hippocampus
imp in + conditioning
key distinction for reinforcement
primary
secondary reinforcers
primary rein
unconditioned
somehow innately satisfying or desirable
rein that we do not need to learn to see as reinforcers because they are integral to our survival
biological
ex of prim rein
food + because it is required for survival
avoiding pain and danger - renforcer b/c necessary for same reason
2nd rein
conditioned
learned to be rein
neutral stimuli that are paired with prim rein to make them conditioned
only has reinforcing qualities when linked to the prim rein
ex of 2nd rein
if every time child reads a book, she recieves a stamp, after collecting ten stamps, she can exchange these for a small pizza
pizza, being food, is the primary reinforcer and the stamps are secondary reinforcer
child learns to find stamps desirable because they help her get something she wants- pizza
pairing of 2nd rein
if after collecting 10 stamps, instead of recieving a pizza, the child recieves a coupon that is good for one small pizza, in this case, both stamps and coupon are 2nd rein
almost any stim can be a 2nd rein, must be paired with prim rein in order to produce learned behavior
operant conditioning relies on
reinforcement schedule
types of reinforcement schedule
continuous or intermittent
continuous schedule
every occurrence of behavior is reinforced
intermittent schedule
occurrences r sometimes reinforced and sometimes not
cont rein results
rapid behavior acquisition or rapid learning
also results in rapid extinction when rein ceases
inter rein results
slow acquisition or behavior , greater persis or resistance to extinction of behavior over time
maintaining behaviors: schedules
initially condition a behavior using cont rein scheudle and maintain that behavior using inter rein
ex of main behavior
dog can be trained to sit in response to hand motion in cont rein where a treat is given every time the dog sits, once dog has suff.ly mastered this behavior , u can switch to an intermittent rein schedule, where dog receives a treat only occasionally when it sits in response to hand motion
four types of inter schedules
fixed ratio
variable ratio
fixed interval
variable interval
fixed ratio schedule
provides rein after set number of instances of the behavior
fixed ratio rat ex
rat recieves food pellet every 10 times it pushes the lever after it has been conditioned , rat will demonstrate a high rate of response ( will push lever rapidly, many times to get food)
variable rate sched
provides the rein after an unpredictable number of occurrences
variable rate gamb ex
rein may be unpredictable but behavior is repeated with hope of a rein
fixed and variable rate
both produce high response rates
chances that behavior will produce the desired outcome ( treat or a jackpot or some other rein) increases with the number responses ( times behavior is performed )
fixed interval schedule
provides rein after set period of time that is constant
behavior will increase as rein interval comes to an end
fixed int employee ex
employee reinforced by attention from boss, employee mght work hard all time , thinking boss will walk by at any second and see the hard work and provide + rein ( attention) once employee learns boss only walks at the top of the hour every hour, employee may be ineffective worker thruout the day, but more effective as the top of the hour approaches
variable interval schedule
rein after inconsistent amount of time
schedule produces slow steady behavior response rate, because amount of time it will take to get rein is unknown
var int boss ex
the boss walks by at unpredictable times each day, employee does not know when they will recieve atttention ( rein) , thus employee will work in a steady efficient manner thruout the day, but not very quickly
employee knows it doesn’t matter how quickly he works at any given time, because pot rein is tied to an unpredictable time schedule
cont deff
rein given after each every single response
cont response rate
slow
cont extinction rate
fast
cont notable behavior patterns
best way to teach new behavior but has fastest rate of extinction
fixed ratio deff
rein given after set number of responses
fixed ratio response rate
fast
fixed ratio extinction rate
medium
fixed ratio notable behavior patterns
post rein pause may be an analogue to procrastination
fixed interval deff
rein given after set amount of time
fixed interval response rate
medium
fixed interval extinction rate
medium
fixed interval notable behavior patterns
long pause in responding following rein, followd by accelerating rate
variable ratio deff
rein given after variable number of responses
variable ratio response rate
fast
variable ratio extinction rate
slow
variable ratio notable behavior patterns
slowest rate of extinction
behavior persists longer despite lack of reinforcer
variable interval deff
rein given after variable amount of time
variable interval response rate
fast
variable interval extinction rate
slow
variable interval notable behavior patterns
tends to produce a low to moderate steady rate of responding
shaping desired behavior
parents shape behavior by reinforcing the smaller intermediate behaviors necessary to acheive the final desired behavior
shaping desired behavior learning to walk
parents will reinforce child trying to pull themselves up, so she will try again
once she mastered pulling herself up and standing while holding something , they will reinforce child’s attempts to stand while not holding anything and so on until the child is able to walk on her own
punishment vs reinforcement
rein increases behavior
pun decreases behavior
punishment
process by which a behavior is followed by a consequence that decreases the likelihood the behavior will be repeated
positive punishment
application or pairing of an undesirable stimulus with the behavior
ex of positive punishment
if a cadet speaks out of turn at military boot camp, drill sargeant makes them do 20 pushups
- punishment
involves the removal of desirable stimulus after the behavior has occured
ex of - punishment
if child breaks a window while throwing baseball in house, they lose TV privilleges
+ vs - punishment
+ punish: adds
- punish: subtracts
when shaping behaviors
rein and punishment used in conjunction, it is uncommon for punish to have as much of a lasting effect as rein
removal of punish
no longer effective
punishment instructs
what not to do
reinforcement instructs
what to do
better alternative to encourage behavior change and learning
operant conditioning processes
acquisition extinction spontaneous recovery generalization discrimination
two types of aversive control
escape
avoidance
escape
individual learns how to get away from an aversive stimulus by engaging in a particular behavior
helps reinforce the behavior so they will be willing to engage in it again
perform a behavior to terminate an ongoing , unpleasant, aversive stimulus
escape ex child temper
if a child does not want to eat her vegetables , aversive stimulus, so she throws a temper tantrum
if parents respond by not making the child eat the vegetables, the child will learn by behaving in that specific way, she can escape that particular aversive stimulus
shaping
succesively reinforcement behaviors which lead up to the target behavior
aversive control
term used to describe situations in which a behavior is motivated by the threat of sth unpleasant
avoidance learning
occurs when a person performs behavior to ensure an aversive stimulus is not presented
ex of avoidance learning child
child notices Mom cooking vegetables for dinner and fakes an illness so mom will send him to bed with ginger ale and crackers
diff between avoidance and escape learning
some sort of signal is given before the aversive stimulus is presented
behaviorism explanation of psychological phenomena
all phenomena are explained by describing observable antecedents of behaviors and its consequences