Exam 2

Question 1

Thorndike’s law of effect

Answer 1

Responses in a situation followed by satisfaction will become stronger, while responses followed by discomfort will become weaker

Question 2

Contrast effects

Answer 2

Ways to test doubts about Thorndike’s law of effect
Negative: switch from large to small reinforcement
Positive: switch from small to large reinforcement

Question 3

Skinner box (operant chamber)

Answer 3

A small apparatus with a way for subject to make responses and for experimenter to deliver reinforcement. Usually, rats pressing levers or pigeons pecking keys

Question 4

Shaping

Answer 4

This strategy involves gradually altering a behavior, rewarding (reinforcing) closer and closer approximations of the desired behavior.

Question 5

Chaining

Answer 5

This behavior techniques involves breaking a task down into smaller components. The simplest or first task in the process is taught first. Once that task has been learned, the next task can be taught. Construct a sequence of behaviors this way

Question 6

Extinction

Answer 6

Weakening of a conditioned response over time in absence of unconditioned stimulus

Question 7

Spontaneous recovery

Answer 7

the reappearance of the conditioned response after a rest period or period of lessened response
Not the only way for extinguished responses to return

Question 8

Resurgence

Answer 8

The recovery of an extinguished response after extinction of a competing behavior
Eg: stop giving food for one stimulus and give it for another, then stop giving it for second stimulus. In end, rat will return to original stimulus, even though it wasn’t getting food

Question 9

Partial reinforcement extinction effect

Answer 9

This slows down the acquisition of a response, but increases resistance to extinction
3 hypotheses: discrimination, frustration, and sequential
Divided into different interval ratios - reinforcement can be given over time

Question 10

Discrimination hypothesis

Answer 10

partial reinforcement extinction effect makes it more difficult to distinguish between acquisition phase and extinction phase

Question 11

Fixed-interval schedule

Answer 11

reinforcement happens after a set amount of time, such as when an attorney at a law firm gets a bonus once a year
Pauses after reinforcement

Question 12

Variable-interval schedule

Answer 12

o Reinforcement is given for the first response that occurs after a changing period of time
o Does not pause after reinforcement

Question 13

Fixed-ratio schedule

Answer 13

reinforcement happens after a set number of responses, such as when a car salesman earns a bonus after every three cars he sells.
Pause after reinforcement

Question 14

Variable-ratio schedule

Answer 14

Reinforcement is given for a changing number of responses
Does not pause after reinforcement
Greatest total number of responses

Question 15

Ratio vs. interval schedule

Answer 15

Greater responding in ratio schedules

Question 16

Frustration hypothesis

Answer 16

During partial reinforcement, responding while frustrated becomes associated with reinforcement

Question 17

Sequential hypothesis

Answer 17

During partial reinforcement, memory of sequence of non-rewarded trials becomes associated with reinforcement

Question 18

Matching Law

Answer 18

there is a correlation between behavior and the environment
Responses are distributed to reflect the distribution of reinforcements
Typically studied by placing subjects in two operant experiments simultaneously (variable-interval)

Question 19

Self-control

Answer 19

Requiring a choice between immediate small reward and larger delayed reward
Future rewards aren’t valued as highly as immediate rewards, and future punishments aren’t feared as much as immediate punishments

Question 20

Probability matching

Answer 20

The probability of choosing an option tends to match the probability of that option succeeding, which does not maximize success
eg: 80% chance of something happening, people will pick it 80% of time instead of 100% of time

Question 21

Reward

Answer 21

A positive reinforcement: response or behavior is strengthened by addition of something

Question 22

Punishment

Answer 22

the presentation of an adverse event or outcome that causes a decrease in the behavior it follows

Question 23

Omission training

Answer 23

the procedure of removing positive reinforcement/reward upon the occurrence of unwanted behavior

Question 24

Avoidance

Answer 24

escape learning, a behavior terminates an aversive stimulus

precedes and prevents aversive stimulus

Question 25

Two-process account of avoidance learning

Answer 25

Classical conditioning of fear to warning signal and reduction of fear as reinforcement

Question 26

Sidman avoidance procedure

Answer 26

Provides evidence against two-process theory

No warning signal given, and there was still no sign of fear after extended training

Question 27

Cognitive accounts of avoidance

Answer 27

Avoidance develops an expectation

Question 28

Learned helplessness

Answer 28

Learning that there is a lack of contingency between responses and aversive outcome
This has served as model for human depression before

Question 29

Biofeedback

Answer 29

The only exception to instrumental conditioning being a control of a voluntary action
Instrumentally controlling an autonomic response
You can teach subject to control autonomic response

Question 30

Drive-reduction theory

Answer 30

Positive reinforcers reduce drivers, and negative reinforcers increase drives
drive is a state of arousal or tension created by biological or physical needs (creates an unpleasant state)

Question 31

incentive motivation

Answer 31

reinforcers are incentives that elicit responding

Question 32

Premack principle

Answer 32

A higher probability activity will reinforce a lower-probability one

Question 33

Response-deprivation theory

Answer 33

Reinforcer is an opportunity to move closer to bliss point

Question 34

Bliss point

Answer 34

ideal distribution of time and effort across all activities

Question 35

Secondary reinforcement

Answer 35

neutral stimuli paire with reinforcers get ability to reinforce on their own

Question 36

Social reinforcement

Answer 36

attention ad physical contact are reinforcements

Question 37

Goal gradient hypothesis

Answer 37

effect of reward weaker the further behavior is away from reward