Chapter 6

Question 1

The law of effect

Answer 1

As stated by Thorndike, the proposition that behaviors that lead to a satisfying state of affairs are strengthened or “stamped in”, while behaviors that lead to an unsatisfying or annoying state of affairs are weakened or “stamped out”.

Question 2

Operant conditioning

Answer 2

A type of learning in which the future probability (strength) of a behavior is affected by its consequences. (Skinneer)

Question 3

Discriminative stimulus

Answer 3

a stimulus in the presence of which responses are reinforced and in the absence of which they are not reinforced, that is, a stimulus that signals the availability of reinforcement.

Question 4

Three-term contingency

Answer 4

the relationship between a discriminative stimulus, an operant behavior, and a consequence (reinforcer or punisher).

Question 5

Negative reinforcement

Answer 5

the removal of a stimulus (one that is usually considered unpleasant or aversive) following a response, which then leads to an increase in the future strength of that response.

Question 6

Positive punishment

Answer 6

the presentation of a stimulus (one that is usually considered unpleasant or aversive) following a response, which then leads to a decrease in the future strength of that response

Question 7

Positive reinforcement

Answer 7

the presentation of a stimulus (one that is usually considered pleasant or rewarding) following a response, which then leads to an increase in the future strength of that response

Question 8

Negative punishment

Answer 8

the removal of a stimulus (one that is usually considered pleasant or rewarding) following a response, which then leads to a decrease in the future strength of that response.

Question 9

Extrinsic reinforcement

Answer 9

the reinforcement provided by a consequence that is external to the behavior, that is, an extrinsic reinforcer.

Question 10

Intrinsic reinforcement

Answer 10

reinforcement provided by the mere act of performing the behavior; the behavior itself is the reinforcer.

Question 11

avoidance behavior

Answer 11

behavior that occurs before the aversive stimulus is presented and thereby prevents its deliver

Question 12

contrived reinforcers

Answer 12

reinforcers that have been deliberately arranged to modify a behavior; they are not a typical consequence of the behavior in that setting, also called artificial reinforcers

Question 13

Discriminative stimulus for extinction (S triangle)

Answer 13

a stimulus that signals the absence of reinforcement

Question 14

discriminative stimulus for punishment (SDP)

Answer 14

a stimulus that signals that a response will be punished

Question 15

escape behavior

Answer 15

a behavior that results in the termination of an aversive stimulus

Question 16

extinction

Answer 16

the weakening of a behavior thought the nonreinforcement of a previously reinforced behavior

Question 17

generalized reinforcer

Answer 17

a type of secondary reinforcer that has been associated with several other reinforcers. also called a generalized secondary reinforcer

Question 18

natural reinforcers

Answer 18

reinforcers that are naturally provided for a certain behavior; they are a typical consequence of the behavior within that steering

Question 19

operant behavior

Answer 19

a class of emitted responses that result in certain consequences; these consequences, in turn, affect the future probability (strength) of those responses

Question 20

primary reinforcer

Answer 20

an event that is innately reinforcing, also called an unconditioned reinforcer

Question 21

punisher

Answer 21

an event that (1) follows a behavior (2) decreases the future probability of that behavior

Question 22

reinforcer

Answer 22

an event that (1) follows a behavior (2) increases the future probability of that behavior

Question 23

secondary reinforcer

Answer 23

an event that is reinforcing because it has been associated with some other reinforcer also called; conditioned reinforcer

Question 24

shaping

Answer 24

the gradual creation of new behavior through reinforcement of successive approximations to that behavior