Exam 4 Definitions

Question 1

Concurrent-chain schedule of reinforcement

Answer 1

A complex reinforcement procedure in which the participant is permitted to choose during the first link which of several simple reinforcement schedules will be in effect in the second link. Once a choice has been made, the rejected alternatives become unavailable until the start of the next trial. Concurrent-chain schedules allow for the study of choice with commitment.

Question 2

Concurrent schedule

Answer 2

A complex reinforcement procedure in which the participant can choose any one of two or more simple reinforcement schedules that are available simultaneously. Schedules allow for the measurement of choice between simple schedule alternatives.

Question 3

Continuous reinforcement (CRF)

Answer 3

A schedule of reinforcement in which every occurrence of the instrumental response produces the reinforcer

Question 4

Cumulative record

Answer 4

A graphical representation of how a response is repeated overtime, with the passage of time represented by the horizontal distance (or X axis) , and the total or cumulative number of responses that have occurred up to a particular point in time represented by the vertical distance (or Y axis)

Question 5

Delay discounting

Answer 5

Decrease in the value of a reinforcer as a function of how long one has to wait to obtain it

Question 6

Fixed interval scallop

Answer 6

The gradually increasing rate of responding that occurs between successive reinforcements on a fixed interval schedule

Question 7

Fixed interval schedule (FI)

Answer 7

I reinforcement schedule in which the reinforcer is delivered for the first response that occurs after a fixed amount of time following the last reinforcer or the beginning of a trial

Question 8

Fixed Ratio schedule (FR)

Answer 8

Are reinforcement schedule in which fixed number of responses must occur in order for the next response to be reinforced

Question 9

Intermittent reinforcement

Answer 9

A schedule of reinforcement in which only some of the occurrences of the instrumental response are reinforced. The instrumental response is reinforced occasionally, or intermittently. Also called partial reinforcement.

Question 10

Inter- response time (IRT)

Answer 10

The interval between one response and the next. IRTs can be differentially reinforced in the same fashion as other aspects of behavior, such as response, force, or response variability.

Question 11

Interval schedule

Answer 11

A reinforcement schedule in which a certain amount of time is required to set up the reinforcer. A response is reinforced only if it occurs after the reinforcer has been set up.

Question 12

Limited hold

Answer 12

A restriction on how long are reinforce remains available. In order for a response to be reinforced, it must occur before the end of the limited hold period

Question 13

Matching law

Answer 13

A rule for instrumental behavior, proposed by R. J. Herrnstein, which states that the relative rate of responding on a particular response alternative equals the relative rate of reinforcement for that response alternative

Question 14

Melioration

Answer 14

A mechanism for achieving matching by responding so as to improve the local rates of reinforcement for response alternatives

Question 15

Partial reinforcement

Answer 15

Same as intermittent reinforcement

Question 16

Post reinforcement pause

Answer 16

A pause and responding that typically occurs after the delivery of the reinforcer on FR and FI schedules of reinforcement

Question 17

Ratio run

Answer 17

The high end and variant rate of responding observed after the post reinforcement on the FR schedules. The ratio runs when the ratio requirement has been completed, and the participant is reinforced.

Question 18

Ratio schedule

Answer 18

A schedule in which reinforcement depends only on the number of responses the participant performs, irrespective of when those responses occur

Question 19

Ratio strain

Answer 19

Disruption of responding that occurs on ratio schedules when the response requirement is increased to rapidly

Question 20

Schedule of reinforcement

Answer 20

A program, or rule, that determines how, and when the occurrence of a response will be followed by the delivery of the reinforcer

Question 21

Unmatching

Answer 21

Less sensitivity to the relative rate of reinforcement than predicted by the matching law

Question 22

Variable interval schedule (VI)

Answer 22

A reinforcement schedule in which reinforcement is provided for the first response that occurs after a variable amount of time from the last reinforcer or the start of the trial

Question 23

Variable ratio schedule (VR)

Answer 23

Are reinforcement schedule in which the number of responses necessary to produce reinforcement varies from trial to trial. The value of the schedule refers to the average number of responses required for reinforcement.

Question 24

Behavioral bliss point

Answer 24

The preferred distribution of an organisms activities before an instrumental conditioning procedure is introduced that sets constraints and limitations on response allocation

Question 25

Consummatory-response theory

Answer 25

A series that assumes that species, typical consummatory responses (eating, drinking, and the like) are critical features of reinforcers

Question 26

Demand curve

Answer 26

The relation between how much of a commodity is purchased in the price of the commodity

Question 27

Differential probability principle

Answer 27

A principle that assumes that reinforcement depends on how much more likely the organism is to perform the reinforcer spots then the original response before an instrumental conditioning procedure is introduced. The greater the differential probability of the reinforcer and instrumental responses during baseline conditions, the greater is the reinforcement effect of providing opportunity to engage in reinforcer response after performance of the instrumental response. Also known as the Premack principal.

Question 28

Elasticity of demand

Answer 28

So agreed to which price influences the consumption or purchase of a commodity. If price has a large effect on consumption, elasticity of demand is high. If price has a small effect on consumption, elasticity of demand is low.

Question 29

Minimum deviation model

Answer 29

A model of instrumental behavior, according to which participants respond to a response-reinforcer contingency in a manner that gets them as close as possible to their behavioral bliss point

Question 30

Premack principal

Answer 30

The same as differential probability principle

Question 31

Response-deprivation hypothesis

Answer 31

An explanation of reinforcement according to which restricting access to a response below its baseline rate of occurrence (response deprivation) is sufficient to make the opportunity to perform that response an effective positive reinforcer

Question 32

Avoidance

Answer 32

An instrumental conditioning procedure in which the participants behavior prevents the delivery of an adversive stimulus

Question 33

Avoidance trial

Answer 33

A trial in a discriminated avoidance procedure in which an avoidance response is made and prevents the delivery of the aversive stimulus

Question 34

Discriminated avoidance

Answer 34

An avoidance conditioning procedure in which occurrences of the adversive stimulus are signal by a CS. Responding during the CS terminates the CS and prevents the delivery of the aversive US. Also called signaled avoidance.

Question 35

Discriminative punishment

Answer 35

A procedure in which responding is punished in the presence of a particular stimulus and not punished in the absence of that stimulus

Question 36

Escape trial

Answer 36

A trial during discriminated avoidance training, and which the required avoidance response is not made, and the aversive US is presented. Performance of the instrumental response during the aversive stimulus results in termination of the aversive stimulus. Thus, the organism is able to escape from the aversive stimulus

Question 37

Escape from fear (EEF) procedure

Answer 37

Situation in which subjects learn an instrumental response to escape from or terminates a conditioned stimulus that elicits fear. Escape from fear is predicted by the two process theory of avoidance and provides a coping mechanism for individuals suffering from excessive fear.

Question 38

Flooding

Answer 38

A procedure for extinguishing avoidance behavior in which the CS is presented while the participant is prevented from making the avoidance response

Question 39

Free operant avoidance

Answer 39

Same as non-discriminated avoidance

Question 40

Non-discriminated avoidance

Answer 40

And avoidance conditioning procedure in which occurrences of the aversive stimulus are not signal by external stimulus. The aversive stimulus is presented periodically, as said by the SS interval. Each occurrence of the avoidance response creates (or resets) a period of safety, determined by the SR interval during which the aversive stimulus is not presented. Also called free operant avoidance; originally called Sidman avoidance.

Question 41

Overcorrection

Answer 41

A procedure for discouraging behavior in which the participant is not only required to correct or rectify a mistake but it’s also required to go beyond that, for example, extensively practicing the correct response alternative

Question 42

Predatory imminence

Answer 42

The perceived likelihood of being attacked by a predator. Different species typical defense responses occur within different degrees of predatory imminence

Question 43

Punishment

Answer 43

An instrumental conditioning procedure in which there is a positive contingency between the instrumental response and an aversivestimulus. If the participant performs the instrumental response, it receives the aversive stimulus; if the participant does not perform the instrumental response, it does not receive the aversive stimulus. Punishment typically suppresses instrumental behavior

Question 44

R-S interval

Answer 44

The interval between the occurrence of an avoidance response and the next scheduled presentation of the aversive stimulus and a non-discriminated avoidance procedure. Thus, the R– S interval sets the duration of safety created by each avoidance response in a non-discriminated avoidance procedure.

Question 45

Response blocking

Answer 45

Blocking the opportunity to make the avoidance response so that the subject is exposed to a fear stimulus without being able to escape from it. Usually used in connection with flooding.

Question 46

Safety signal

Answer 46

A stimulus that signals the absence of an aversive event

Question 47

Shock frequency reduction

Answer 47

A hypothesis according to which reduction in the frequency of shock serves to reinforce avoidance behavior

Question 48

Shuttle avoidance

Answer 48

A type of avoidance conditioning procedure in which required instrumental response consist of going back-and-forth (shuttling) between two sides of an experimental apparatus on successive trials

Question 49

Signaled avoidance

Answer 49

Same as discriminated avoidance

Question 50

Species specific defense reactions (SSDRs)

Answer 50

Species typical responses animals perform in an aversive situation. The responses may involve freezing, fleeing, or fighting.

Question 51

S – S interval

Answer 51

The interval between successive presentations of the aversive stimulus in a non-discriminated avoidance procedure when the avoidance response is not performed

Question 52

Time out

Answer 52

A period during which the opportunity to obtain positive positive reinforcement is removed. This may involve removal of the participant from the situation where reinforcers are available.

Question 53

Two process theory of avoidance

Answer 53

A theory originally develops to explain discriminated avoidance learning that presumes the operation of two mechanisms: classical conditioning of fear to the warning, signal or CS and instrumental reinforcement of the avoidance response through termination of the warning, signal and consequence fear reduction