Chapter 5 Instrumental Conditioning Foundations

Question 0

What was thorndikes experiment

Answer 0

Put animals like cats and rats into puzzle boxes to find their intelligence
Although over trials took less time didn’t believe showed larger intelligence R-S association instead

Question 1

Instrumental Behavior

Answer 1

Behavior that occurs because it was previously instrumental in producing certain consequences
Also called goal directed behavior

Question 2

Why was thorndikes puzzle experiment more like S-R association then intelligence

Answer 2

Animals showed many responses because trapped and one caused a CR response of the door opening so the animals learned to associate that action with door opening
Quickened response came from a stronger association of the two

Question 3

Law of Effect

Answer 3

If a response in the presence of a stimuli is followed by a satisfying event, the association between the stimulus and the response is strengthened. If the response is followed by an annoying event the S-R association is weakened

There is a learned association between the response and the stimuli present at the time

Question 4

Discrete Trial Procedures

Answer 4

Similar to thorndikes method
Each training trial ends with removal of the animal from the apparatus and the instrumental response is preformed only once during the trial
Usually in a maze

Question 5

Running speed

Answer 5

A measure of maze behavior
How fast the animal gets from start to goal
Usually increases with repeated trials

Question 6

Latency

Answer 6

Another measure of maze behavior
The time it takes the animal to leave the start box and begin moving down the alley
Usually become shorter with trials

Question 7

Free operant procedures

Answer 7

Allows the animal to repeat the instrumental response w/I constraint
Invented by skinner

Question 8

Operant Response

Answer 8

The effect a response has in terms of the environment
Activities that have the same environmental effect are considered to be instances of the same operant response
Doesn’t matter how as long as has the same result
Ex press lever

Question 9

Magazine Training

Answer 9

The first phase of many conditionings
A delivery service of food called the food magazine bring food and is paired with a sound
Sign tracking started by pair

Question 10

Shaping

Answer 10

Sequence of training steps to get a specific response
Involved 3 components
1) clearly define the final response you want
2) clearly assess the starting level of performance
3) divide the progression from start to finish
Ex rat fed for going on back paws
Then fed when done near lever
Then only when on lever

Question 11

Appetitive Stimulus

Answer 11

A pleasant outcome/ stimulus in instrumental conditioning situations
Could be turned on or off
Ex getting paid

Question 12

Aversive stimulus

Answer 12

Unpleasant outcome in instrumental conditioning

Could be turned on or off

Question 13

Positive reinforcement

Answer 13

The instrumental response produces an appetitive stimulus
If the response occurs an appetitive stimulus presented
If he response doesn’t occur the stimulus not presented
Produces an increase in the rate of responding
Ex give girl cookie for cleaning

Question 14

Punishment

Answer 14

The instrumental response produces an unpleasant aversive stimulus
Contains positive contingency between instrumental response and stimulus outcome
Effective punishment produces a decline in the instrumental response

Question 15

Negative reinforcement

Answer 15

Instrumental response turns off aversive stimulus
Has a negative contingency between instrumental response and aversive stimuli
Increase instrumental response
Ex open umbrella to stop rain

Question 16

Omission training

Answer 16

Withdrawing source of positive reinforcement
Negative contingency between instrumental response and appetitive stimulus
Also called differential reinforcement of other behavior (DRO)
Ex. Suspending drivers license

Question 17

Belongingness

Answer 17

Certain responses naturally belong with reinforcers because of animal evolutionary history
Ex) pulling a lever to release from condiment is natural but scratching do not help animals escape and don’t belong with a puzzle box

Question 18

Instinctive Drift

Answer 18

The extra responses that develop in these food reinforced situations were activities the animals instinctively preform when obtaining food

Question 19

Positive Contrast

Answer 19

Elevated responding for a favorable reward resulting from prior experience with a less attractive outcome

Question 20

Negative Contrast

Answer 20

Depressed responding for a small reward because of prior experience with a better outcome

Question 21

Temporal Relation

Answer 21

One of two responses and a reinforcer

The time between the response and the reinforcer

Question 22

Temporal contiguity

Answer 22

A special case of the temporal relation

The delivery of the reinforcer immediately after the response

Question 23

Response reinforcer contingency

Answer 23

Also called casual relation
The second type of relation between a response and the reinforcer
Refers to the extent to which the instrumental response is needed and sufficient for the occurrence of the reinforcer

Question 24

Secondary or conditioned reinforcer

Answer 24

A conditioned stimulus that was previously associated with the reinforcer
Ex. Verbal promos such as good job

Question 25

Marking procedure

Answer 25

Introducing a brief light or noise after the target response or by picking up the subject and moving it to a holding box

Question 26

Superstitious Behavior

Answer 26

Responding as if their behavior was controlled by devilry of the reinforcer when I’m fact the food was provided independently if behavior

Question 27

Accidental or adventurous reinforcement

Answer 27

The accidental pairing of a response with delivery of the reinforcer

Question 28

Terminal Responses

Answer 28

Response that occur predominantly toward the end of the interval between successive reinforcers

Question 29

Learned helplessness effect

Answer 29

Exposure to uncontrollable shock disrupted subsequent learning
Ex shocked dogs that had no control

Question 30

Triadic design

Answer 30

How learned helplessness experiments conducted

Two phases: exposure phase and conditioning phase

Question 31

Learned helplessness hypothesis

Answer 31

Based on the conclusion that animals can perceive the contingency between their behavior and the delivery of a reinforcer
During the shock animals learn that the shocks are independent of their behavior and there is nothing they can do to control it and expect it to be independent in the future

Question 32

Escape behavior

Answer 32

The instrumental response results in the termination of an aversive stimulus
Ex you can feel you are raising your hand even if you can’t see it