Exam 3 Flashcards
Edward Lee Thorndike
- American
- interested in animal intelligence at end of 19th century
- studied animal intelligence by studying animal learning
the statement that that behavior is a function of its consequences. So called b/c the strength of a behavior depends on its past effects on the environment
Law of Effect
What does this demonstrate: a chick in a maze goes down a wrong alley (this is followed by continued hunger). If the chick goes down the right alley, it finds food.
Law of Effect
Who was the first person to show that behavior is systematically strengthened or weakened by its consequences?
Thorndike
According to Thorndike’s Law of Effect, the strength of a behavior depends on its __________.
consequences
experiences whereby behavior is strengthened or weakened by its consequences
operant learning
Who was nicknamed the Darwin of Behavior Science?
B.F. Skinner
an increase in the strength of behavior due to its consequence
reinforcement
3 characteristics to qualify as reinforcement:
- a behavior must have a consequence
- the behavior must increase in strength (occur more often)
- the increase in strength must be a result of the consequence
a reinforcement procedure in which a behavior is followed by the presentation of, or an increase in the intensity of, a stimulus
positive reinforcement (sometimes called reward training)
any stimulus that, when presented following a behavior, increases or maintains the strength of that behavior
positive reinforcer
a behavior is strengthened by the removal of, or a decrease in the intensity of, a stimulus
negative reinforcement (sometimes called escape-avoidance learning)
any stimulus, that, when removed following a behavior, increases or maintains the strength of that behavior
negative reinforcer
Reinforcement _________ behavior
increases
Positive=stimulus is _______
presented
Negative=stimulus is _______
removed
an operant training procedure in which performance of a behavior defines the end of the trial
discrete trial procedure
Thorndike used ___________ to study operant learning
discrete trial procedure
an operant training procedure in which a behavior may be repeated any number of times
free operant procedure
Skinner used _____________ to study operant learning
free operant procedure
Pavlovian conditioning is sometimes called _______ learning
S-S
Operant learning is sometimes called _______ learning
S-R-S
the essential elements of all operant learning, often represented by the letter ABC, for antecedent, behavior, and consequences
three-term contingency
Pavlovian usually includes _____ behavior, while operant usually contains _________ behavior
involuntary; voluntary
Overmier & Seligman study
Strapped dog into harness and presented a tone followed by a shock. When they put the dog in a box divided by a barrier and delivered the shock, the dog made no effort to escape. They called this learned helplessness
any reinforcer that is not dependent on another reinforcer for its reinforcing properties
primary reinforcer
a reduction in the effectiveness of a reinforcer due to exposure to or consumption of the reinforcer
satiation
any reinforcer that has acquired its reinforcing properties through its association with other reinforcers (dependent of their association with other reinforcers)
secondary reinforcers
any secondary reinforcer that has been paired with several different reinforcers
generalized reinforcer
events that have been arranged by someone usually for the purpose of modifying behavior
contrived reinforcers
events that follow automatically or naturally from the behavior
natural reinforcers
when a behavior is decreased bc you got something “bad”
positive punishment
when a behavior is decreased because something good was taken away
negative punishment
behavior increases because you got something good
positive reinforcement
behavior increases because you got rid of something bad
negative reinforcement
a series of related behaviors, the last of which produces reinforcement
behavior chain
in operant training, the procedure of establishing a behavior chain
chaining
the procedure of identifying the component elements of a behavior chain
task analysis
the trainer begins by reinforcing performance of the first link in the chain
forward chaining
a chaining procedure in which training begins with the last link in the chain and adds preceding links in reverse order
backward chaining