Exam 2 Flashcards
Thorndike’s law of effect
Responses in a situation followed by satisfaction will become stronger, while responses followed by discomfort will become weaker
Contrast effects
Ways to test doubts about Thorndike’s law of effect
Negative: switch from large to small reinforcement
Positive: switch from small to large reinforcement
Skinner box (operant chamber)
A small apparatus with a way for subject to make responses and for experimenter to deliver reinforcement. Usually, rats pressing levers or pigeons pecking keys
Shaping
This strategy involves gradually altering a behavior, rewarding (reinforcing) closer and closer approximations of the desired behavior.
Chaining
This behavior techniques involves breaking a task down into smaller components. The simplest or first task in the process is taught first. Once that task has been learned, the next task can be taught. Construct a sequence of behaviors this way
Extinction
Weakening of a conditioned response over time in absence of unconditioned stimulus
Spontaneous recovery
the reappearance of the conditioned response after a rest period or period of lessened response
Not the only way for extinguished responses to return
Resurgence
The recovery of an extinguished response after extinction of a competing behavior
Eg: stop giving food for one stimulus and give it for another, then stop giving it for second stimulus. In end, rat will return to original stimulus, even though it wasn’t getting food
Partial reinforcement extinction effect
This slows down the acquisition of a response, but increases resistance to extinction
3 hypotheses: discrimination, frustration, and sequential
Divided into different interval ratios - reinforcement can be given over time
Discrimination hypothesis
partial reinforcement extinction effect makes it more difficult to distinguish between acquisition phase and extinction phase
Fixed-interval schedule
reinforcement happens after a set amount of time, such as when an attorney at a law firm gets a bonus once a year
Pauses after reinforcement
Variable-interval schedule
o Reinforcement is given for the first response that occurs after a changing period of time
o Does not pause after reinforcement
Fixed-ratio schedule
reinforcement happens after a set number of responses, such as when a car salesman earns a bonus after every three cars he sells.
Pause after reinforcement
Variable-ratio schedule
Reinforcement is given for a changing number of responses
Does not pause after reinforcement
Greatest total number of responses
Ratio vs. interval schedule
Greater responding in ratio schedules
Frustration hypothesis
During partial reinforcement, responding while frustrated becomes associated with reinforcement
Sequential hypothesis
During partial reinforcement, memory of sequence of non-rewarded trials becomes associated with reinforcement
Matching Law
there is a correlation between behavior and the environment
Responses are distributed to reflect the distribution of reinforcements
Typically studied by placing subjects in two operant experiments simultaneously (variable-interval)
Self-control
Requiring a choice between immediate small reward and larger delayed reward
Future rewards aren’t valued as highly as immediate rewards, and future punishments aren’t feared as much as immediate punishments
Probability matching
The probability of choosing an option tends to match the probability of that option succeeding, which does not maximize success
eg: 80% chance of something happening, people will pick it 80% of time instead of 100% of time
Reward
A positive reinforcement: response or behavior is strengthened by addition of something
Punishment
the presentation of an adverse event or outcome that causes a decrease in the behavior it follows
Omission training
the procedure of removing positive reinforcement/reward upon the occurrence of unwanted behavior
Avoidance
escape learning, a behavior terminates an aversive stimulus
precedes and prevents aversive stimulus
Two-process account of avoidance learning
Classical conditioning of fear to warning signal and reduction of fear as reinforcement
Sidman avoidance procedure
Provides evidence against two-process theory
No warning signal given, and there was still no sign of fear after extended training
Cognitive accounts of avoidance
Avoidance develops an expectation
Learned helplessness
Learning that there is a lack of contingency between responses and aversive outcome
This has served as model for human depression before
Biofeedback
The only exception to instrumental conditioning being a control of a voluntary action
Instrumentally controlling an autonomic response
You can teach subject to control autonomic response
Drive-reduction theory
Positive reinforcers reduce drivers, and negative reinforcers increase drives
drive is a state of arousal or tension created by biological or physical needs (creates an unpleasant state)
incentive motivation
reinforcers are incentives that elicit responding
Premack principle
A higher probability activity will reinforce a lower-probability one
Response-deprivation theory
Reinforcer is an opportunity to move closer to bliss point
Bliss point
ideal distribution of time and effort across all activities
Secondary reinforcement
neutral stimuli paire with reinforcers get ability to reinforce on their own
Social reinforcement
attention ad physical contact are reinforcements
Goal gradient hypothesis
effect of reward weaker the further behavior is away from reward
