Chapter 6 - Operant Conditioning

Question 1

operant behavior

Answer 1

A class of emitted responses that result in certain consequences; these consequences, in turn, affect the future probability or strength of those responses.

Question 2

avoidance behavior

Answer 2

Behavior that occurs before the aversive stimulus is presented and thereby prevents its delivery.

Question 3

three-term contingency

Answer 3

The relationship between a discriminative stimulus, an operant behavior, and a reinforcer or punisher.

Question 4

shaping

Answer 4

The gradual creation of new operant behavior through reinforcement of successive approximations to that behavior.

Question 5

secondary reinforcer (or conditioned reinforcer)

Answer 5

An event that is reinforcing because it has been associated with some other reinforcer.

Question 6

reinforcer

Answer 6

An event that: (1) follows a behavior and (2) increases the future probability of that behavior.

Question 7

punisher

Answer 7

An event that: (1) follows a behavior and (2) decreases the future probability of that behavior.

Question 8

primary reinforcer (or unconditioned reinforcer)

Answer 8

An event that is innately reinforcing.

Question 9

positive reinforcement

Answer 9

The presentation of a stimulus (one that is usually considered pleasant or rewarding) following a response, which then leads to an increase in the future strength of that response.

Question 10

positive punishment

Answer 10

The presentation of a stimulus (one that is usually considered unpleasant or aversive) following a response, which then leads to a decrease in the future strength of that response.

Question 11

contrived reinforcers

Answer 11

Reinforcers that have been deliberately arranged to modify a behavior; they are not a typical consequence of the behavior in that setting. Also called artificial reinforcers.

Question 12

generalized (or generalized secondary) reinforcer

Answer 12

A type of secondary reinforcer that has been associated with several other reinforcers.

Question 13

intrinsic reinforcement

Answer 13

Reinforcement provided by the mere act of performing the behavior; the performance of the behavior is inherently reinforcing.

Question 14

discriminative stimulus (SD)

Answer 14

A stimulus in the presence of which responses are reinforced and in the absence of which they are not reinforced; that is, a stimulus that signals the availability of reinforcement.

Question 15

discriminative stimulus for extinction (SΔ)

Answer 15

A stimulus that signals the absence of reinforcement.

Question 16

discriminative stimulus for punishment (SDp)

Answer 16

A stimulus that signals that a response will be punished.

Question 17

extrinsic reinforcement

Answer 17

The reinforcement provided by a consequence that is external to the behavior, that is, an extrinsic reinforcer.

Question 18

operant conditioning

Answer 18

A type of learning in which the future probability of a behavior is affected by its consequences.

Question 19

natural reinforcers

Answer 19

Reinforcers that are naturally provided for a certain behavior; that is, they are a typical consequence of the behavior within that setting.

Question 20

law of effect

Answer 20

As stated by Thorndike, the proposition that behaviors that lead to a satisfying state of affairs are strengthened or “stamped in,” while behaviors that lead to an unsatisfying or annoying state of affairs are weakened or “stamped out.”

Question 21

negative punishment

Answer 21

The removal of a stimulus (one that is usually considered pleasant or rewarding) following a response, which then leads to a decrease in the future strength of that response.

Question 22

negative reinforcement

Answer 22

The removal of a stimulus (one that is usually considered unpleasant or aversive) following a response, which then leads to an increase in the future strength of that response.

Question 23

escape behavior

Answer 23

A behavior that results in the termination of an aversive stimulus.