Chapter 6

Question 1

concurrent-chain schedule of reinforcement

Answer 1

A complex reinforcement procedure in which the participant is permitted to choose during the first link which of several simple reinforcement schedules will be in effect in the second link. Once a choice has been made, the rejected alternatives become unavailable until the start of the next trial. Concurrent-chain schedules allow for the study of choice with commitment.

Question 2

concurrent schedule

Answer 2

A complex reinforcement procedure in which the participant can choose any one of two or more simple reinforcement schedules that are available simultaneously. Concurrent schedules allow for the measurement of direct choice between simple schedule alternatives.

Question 3

continuous reinforcement (CRF)

Answer 3

A schedule of reinforcement in which every occurrence of the instrumental response produces the reinforcer.

Question 4

cumulative record

Answer 4

A graphical representation of how a response is repeated over time, with the passage of time represented by the horizontal distance (or x axis), and the total or cumulative number of responses that have occurred up to a particular point in time represented by the vertical distance (or y axis).

Question 5

delay discounting

Answer 5

Decrease in the value of a reinforcer as a function of how long one has to wait to obtain it.

Question 6

fixed-interval scallop

Answer 6

The gradually increasing rate of responding that occurs between successive reinforcements on a fixed-interval schedule.

Question 7

fixed-interval schedule (FI)

Answer 7

A reinforcement schedule in which the reinforcer is delivered for the first response that occurs after a fixed amount of time following the last reinforcer or the beginning of the trial.

Question 8

fixed ratio schedule (FR)

Answer 8

reinforcement schedule in which a fixed number of responses must occur in order for the next response to be reinforced

Question 9

intermittent reinforcement

Answer 9

A schedule of reinforcement in which only some of the occurrences of the instrumental response are reinforced. The instrumental response is reinforced occasionally, or intermittently. Also called partial reinforcement.

Question 10

inter-response time (IRT)

Answer 10

The interval between one response and the next. IRTs can be differentially reinforced in the same fashion as other aspects of behavior, such as response force or response variability.

Question 11

interval schedule

Answer 11

A reinforcement schedule in which a certain amount of time is required to set up the reinforcer. A response is reinforced only if it occurs after the reinforcer has been set up.

Question 12

limited hold

Answer 12

A restriction on how long a reinforcer remains available. In order for a response to be reinforced, it must occur before the end of the limited-hold period.

Question 13

matching law

Answer 13

A rule for instrumental behavior, proposed by R. J. Herrnstein, which states that the relative rate of responding on a particular response alternative
equals the relative rate of reinforcement for that
response alternative.

Question 14

melioration

Answer 14

A mechanism for achieving matching by responding so as to improve the local rates of reinforcement for response alternatives.

Question 15

partial reinforcement

Answer 15

same as intermittent reinforcement

Question 16

post-reinforcement pause

Answer 16

pause in responding that typically occurs after the delivery of the reinforcer on FR and FI schedules of reinforcement

Question 17

ratio run

Answer 17

The high and invariant rate of responding observed after the post-reinforcement pause on FR schedules. The ratio run ends when the ratio requirement has been completed and the participant is reinforced.

Question 18

ratio schedule

Answer 18

A schedule in which reinforcement depends only on the number of responses the participant performs, irrespective of when those responses occur.

Question 19

ratio strain

Answer 19

Disruption of responding that occurs on ratio schedules when the response requirement is increased too rapidly.

Question 20

schedule of reinforcement

Answer 20

A program, or rule, that determines how and when the occurrence of a response will be followed by the delivery of the reinforcer.

Question 21

undermatching

Answer 21

Less sensitivity to the relative rate of reinforcement than predicted by the matching law.

Question 22

variable-interval schedule (VI)

Answer 22

A reinforcement schedule in which reinforcement is provided for the first response that occurs after a variable amount of time from the last reinforcer or the start of the
trial.

Question 23

variable-ratio schedule (VR)

Answer 23

A reinforcement schedule in which reinforcement is provided for the first response that occurs after a variable amount of time from the last reinforcer or the start of the
trial.