Lecture 9 Flashcards
____ ____ is the process whereby organisms learn to make or to refrain from making certain ____ in order to ovtain or avoid certain outcomes
Operant conditioning
Who is Edward Throndike?
A psychologist who, at the end of the 19th century, first tried to systematically explore how animals learn new behaviors with his puzzle boxes
Operant conditioning:
In the presence of a particular stimulus, called the ____ ____ (____), a particular ____ (____) may lead to a particular ____ (____)
discriminative stimulus (SD), response (R), outcome (O)
Operant conditioning can be formulated as a three-part association: ____ ____ (____) -> ____ (____) –> ____ (____)
Discriminative stimulus (SD), Response (R), Outcome (O)
What are the SD, R, and O in the case of a puzzle box?
SD = the box
R = sequence of movements that open the door
O = escaping from the box
Fill in the blanks using SD, R and O (some may be used more than once)
The association between ____ and ____ is strengthened when ____ is followed by a desirable ____
SD; R; R; Outcome
____-____ ____ is an operant conditioning paradigm in which the experimenter defines the beginning and end points of each trial
Discrete-trials paradigm
____-____ ____ is an operant conditioning paradigm in which the animal can operate the apparatus as it chooses in order to obtain reinforcement (or avoid punishment)
Free-operant paradigm
B.F.Skinner devised a cage in order to utilize ____-____ ____, which typically consist of one or more ____, food port, one or more ____, and can be further equipped with metal grid floor to give a ____ and ____ speaker.
free-operant paradigm; levers; lights; shock; audio
What are the SD, R, and O in the case of a Skinner chamber?
SD = the chamber
R = pressing the lever
O = receiving food
What is the dependent variable in the case of a Skinner chamber?
number of lever presses (as a rate of responses or cumulative responses)
____ ____ help the learner identify (or “discriminate”) the conditions in which a response will be followed by a particular outcome
Discriminative stimuli
In operant conditioning, ____ is defined not by a particular ____ of motor actions but rather by the ____ it produces
response; pattern; outcome
____ is an operant conditioning technique in which successive approximations to the desired response are reinforced
(criteria for response becomes increasingly specific as trials go on)
Shaping
____ is an operant conditioning technique in which organisms are graually trained to execute complicated sequences of discrete responses
Chaining
____ is an outcome of behavior that leads to the increased likelihood of that behavior in the future
Reinforcer
____ is an outcome of behavior that leads to the decreased likelihood of that behavior in the future
Punisher
____ is the process of providing outcomes (____) that lead to increased probability of a behavior
Reinforcement; reinforcers
____ is the process of providing outcomes (____) that lead to decreased probability of a behavior
Punishment; punishers
____ ____ are rewards that directly affect the organism’s physical well-being, including food, water, sleep, comfortable temperatues, and sex
primary reinforcers
Calrk Hull’s ____ ____ ____ proposed that all learning reflects the innate, biological need to obtain ____ ____
drive reduction theory; primary reinforcers
The ____ ____ ____ is when a normally acceptable reinforcer evokes less responding if a preferred reinforcer is expected
negative contrast effect
（aka我本可以忍受黑暗，如果我不曾见过太阳）
(ex. if primed with sweetened water, less sucking plain water will be observed in later trials)
____ ____ are reinforcers that initially has no biological value but that has been paired with a primary reinforcer. By virture of being paired with a primary reinforcer, these become reinforcers themselves, which the organism will work to obtain
Secondary reinforcers
(the conditioned stimulus)
(like in dogs: clicker = food)
(like in humans: status = health/wealth/sex)
Just as organisms will work to obtain ____, they will also work to avoid ____. However, both Throndike and Skinner conclude that ____ is not nearly as effective as ____ at controlling behavior
reinforcers; punishers; punishers; reinforcers
There are several factors that determines how effective the punishment will be: ____ leads to more ____ behavior, ____ ____ for punishment can encourage cheating, concurrent ____ can undermine it, and initial intensity matters
punishment; variable; Discriminative stimuli; reinforcement
Differential reinforcement of alternative behaviors (BRA)
Instead of delivering punishment each time an unwanted behavior is exhibited, reward preferred alternative behaviors
(ex. children with autism/developmental disorders show persistent habits of self-injurious behaivor, and rather than punishing the child for unwanted behavior, they are rewarded everytime they do a desired behavior)
Normally, ____ outcomes produce the fastest learning. But if there is a long ____ between the response and outcome, it is more likely that other behaviors have taken place during the interval, and those behaviors might thus be ____ with the outcome.
immediate; delay; associated
Rats trained to lever-press with food reinforcement learned more quickly when there is ____ delay and ____-second delay, but learned slowly with a ____-second delay
no; 4; 10
____ ____ is when the response causes a desirable element to be “added” to the environment, which causes the response to be more frequent
positive reinforcement
____ ____ is when the response causes an undesirable element to be “added” to the environment, which causes the response to be less frequent
Positive punishment
____ ____ is when the response causes an undesirable element to be “subtracted” from the environment, making the response to be more frequent
negative reinforcement
____ ____ is when the response causes a desirable element to be “subtracted” from the environment, making the response to be less frequent
negative punishment
____ ____ is the rules determining how and when outcomes are delivered in an experiment
Reinforcement schedules
____ reinforcement schedule follows every instance of the response by the reinforcer, whereas ____ reinforcement schedule follow only some instances of the response by the reinforcer
Continuous; partial
____-____ (FR) schedule requires a specific number of ____ must occur before a ____ is delivered
Fixed-ratio; responses; reinforcer
What does Fixed-ratio 5 (FR5) mean?
Reinforcement arrives after every fifth response
____-____ (FI) schedule requires the first ____ is made after a fixed amount of ____ to be reinforced
Fixed-interval; response; time
What does Fixed Interval 1-min (FI1) mean?
Reinforcement follows the first response made after a 1-minute interval since the last reinforcement
____-____ (VR) schedule requires that a specific number of ____, on average, must occur before a ____ is delivered
Variable-ratio; response; reinforcer
What does Variable Ratio 5 (VR5) mean?
On average, every fifth response is reinforced
(doesn’t have to be exactly 5)
____-____(VI) schedule requires the first ____ on average after a variable amount of ____ to be reinforced
Variable-interval; response; time
What does variable interval 1-min (VI1) mean?
Reinforcement follows the first response made after a 1 minute interval, on average, since the last reinforcement
____-____ 5 schedule shows the fastest increse in number of responses, and the number of responses of____-____ 5 schedule is flatter and plateaus in between
Variable-ratio; fixed-ratio
____-____ 10 sec schedules have a similar slope with ____-____ 10 sec schedules, except that ____-____ schedule shows continuous increase in cumulative response, whereas in ____-____ schedule the cumulative response increases at the interval and slows down in between
variable-interval; fixed-interval; variable-interval; fixed-interval
Use abbreviated form
____ and ____ schedules tend to produce higher rates of responding than ____ and ____ schedules.
VR; VI; FR; FI
____ ____ schdules is one that the organism can choose between several possible responses, each leading to a different outcome. This schedule is used to study ____ behavior
concurrent reinforcement; choice
(like 剧情向游戏)
In choice behavior/concurrent reinforcement schedules, an organism’s response patterns will closely mimic the relative rates of reinforcement for each possible response. This phenomenon is called…
Matching law of choice behavior
____ ____ is the study of how organisms allcate their time and resources among possible options
Behavioral economics
____ ____ is the particular allocation of resources that provices maximal subjective value to an individual
Bliss point
____ ____ is the progressive reduction of the subjective value of a reward the longer it is delayed.
ex. It is easy to convince a student to put off fun in order to study if the exam is tomottow, but harder if the exam is not for 5 weeks since the event is in further future
Delay discounting
There are two levers to choose from: one that delivers a small immediate reward, and one that delivers a larger reward after some delay.
How would a rat behave in either short delay and long delay situations?
Short delay (0-5sec): rats would choose the larger reward on nearly 100% of choice trials
Longer delay (20-30sec): Increasingly less likely to wait, opting more often for the smaller, immediate reward
Skinner advocated an extreme form of behaviorism called ____ ____, in which he asserted hat consciousness and free will are illusions, and argued that humans, like all other animals, function by blindly producing learned responses to environmental stimuli.
Radical behaviorism
