Reading Notes 5 Flashcards
What two operations best characterized Thorndike’s experiments with cats?
- Establishing operations
- Consequential
What did Thorndike call his experiments with his cats? Why?
Trial and error learning
- It took the cats several attempts, with several errors, before they performed consistently and quickly
Fill in the blank: Thorndike’s Law of Effect suggested that responses could be made ___________ probable by some consequences and __________ probable by others.
More
Less
What do we call events that make a response more probable?
Reinforcers
What do we call events that make responses less probable?
Punishers
Maze started as very complicated constructions. They became increasingly simpler and then, were __________ as an apparatus for the study of nonhuman animal behavior
Dropped
Experimental analysis of behavior (EAB) typically involves rats and ________ as subjects of study.
Pigeons
EAB also involves research with humans. But with humans, the apparatus is different. How is the apparatus different with humans?
Rats- press levers
Humans- press buttons, or keys on a keyboard
Operant behavior is:
1) EMITTED (not elicited)
- Term used to describe behavior that “operates” on the environment
2) SELECTED by its consequences
- Recall Thorndike’s Law o/ Effect
3) MODIFIABLE by its consequences
- We change our behavior, based on consequences
Operant
A response that produces a change in the environment and increases in frequency due to that change
T/F: No two responses are exactly alike
True
The ___________ of the response is less important than its function
Topography
What are the different types of operant behavior?
1) Free operant
2) Restricted operant
What is a free operant?
An org. may repeatedly engage in the response over an extended period o/ time
- Key: The response can be made w/o any interference from the experimenter
Give examples of free operants.
a. Talking to yourself (e.g. thinking)
b. Rat pressing a lever
What is a restricted operant?
Rate o/ responding is determined by opportunities to emit the response
Give examples of restricted operants.
a. Thorndike’s puzzle box
b. Responding to flashcards
A high response rate results in what kind of slope?
Steep slope
A medium response rate results in what kind of slope?
Medium slope
A low response rate results in what kind of slope?
Small slope
How do you talk about behavior change?
1) One cannot reinforce a person
2) One cannot deliver reinforcement
3) By definition, a reinforcer results in an increase in the future likelihood o/ a response
“One cannot reinforce a person.” What does this mean?
- Increasing the future p o/ that person
- Instead, we say that we reinforce BEHAVIOR
“One cannot deliver reinforcement.” What does that mean?
- We only deliver REINFORCERS
- Reinforcement happens as a result o/ delivering reinforcing
- Delivering reinforcers = operation (IV, what we did/the cause)
- Reinforcement or the increase in behavior = the process (DV, what happened/the effect)
“By definition, a reinforcer results in an increase in the future likelihood o/ a response.” What does this mean?
- One can’t say that reinforcement didn’t work, bc he didn’t do his laundry
- Why?- A reinforcer must increase a behavior. If it doesn’t increase behavior, it is NOT a reinforcer
T/F: When a response is reinforced, it increases in frequency.
True
T/F: When a response is no longer reinforced, it decreases in frequency.
True
What is the difference between extinction and process?
Extinction as operation (IV, what we do)- discontinuing reinforcer presentation
Process (DV, what happens)- when responding decreases to pre-reinforcement conditions, or is eliminated
What are the side effects of extinction?
1) Extinction burst- relative increase in the rate o/ behavior
- Think o/ putting money in vending machine but nothing comes out
2) Greater variability in responding
- e.g. pushing other buttons
3) Increase in the force o/ the response
- e.g. push buttons harder
4) Emotional responses
- eg. extinction-induced aggression
What does EXT mean?
Withholding reinforcers for previously reinforced responses
- Behavior should stop occurring
What happens during scenario 1 (CRF)
CRF = Continuous
- Deliver 1 food pellet for every lever press for 60 days
- Implement EXT
What happens during scenario 2 (INT)?
INT = Intermittent
- Deliver 1 food pellet for every 10 or so responses, for 60 days
- Implement EXT
T/F: Behavior under a CRF schedule is easier to extinguish when compared to intermittent schedules. Explain.
True
Explanation- If every R is reinforced (CRF) it’s easier to tell when reinforcers stop being delivered
What is discrimination learning?
Process o/ being able to tell the diff. between situation
What is spontaneous recovery?
An increase in the rate o/ responding (above operant levels) after and during exposure to EXT
What is the main difference between spontaneous recovery and resurgence?
Resurgence involves 1+ behavior
Name two examples of the recovery of extinguished behavior.
- Spontaneous recovery
- Resurgence
Explain what occurs during EXT, when exposed to the next session, and at the end.
During EXT- responding decreases across the session (over time)
- You respond less at the end than at the beginning
Exposed to the next session- you don’t respond as low as you did at the end o/ the period EXT session
At the end- you respond at slightly higher levels
- Behavior decreases during the course o/ the session
What is a good way to think of your behavior? Explain the analogy.
Power outage
a. You pick up the phone to call a friend, but your behavior is met w/ EXT- phone is dead
b. Instead, you decide to read your textbook by a candle
c. The power is still off, hours later. You get hungry and decide to order a pizza and pick up the phone
d. You realize the power’s out
What is resurgence?
Return o/ previously established behavior during EXT o/ more recently reinforced behavior
Give an example of resurgence. Explain.
A rat can: (a) emit a lever (b) pull a chain
1. When we reinforce lever presses, the response increases in frequency
- Chain pulls are reinforced, so now that response occurs frequently
- Lever presses aren’t reinforced so that response doesn’t occur - In the last phase o/ the experiment, we extinguish BOTH responses (resurgence condition)
- We expect to see the lever press (it worked first)
Lever press and chain pulls —> aggression reinforced by parent attention and appropriate requests for attention
What is the Premack Principle?
States that a higher frequency (probability) response will reinforce a lower frequency (probability) response
Name a few examples of how the Premack Principle is applied in real life.
- High probability response = watching your favorite show
- Low probability response = studying - Applying the principle —> Memorize 5 definitions THEN you can watch one episode o/ your favorite show
- High probability response = eating gummy bears
- Low probability response = reading a chapter - Applying the principle —> Read one paragraph THEN you can have a gummy bear
What are conditioned reformers? Give examples.
Becomes effective as a reinforcer through its relation to some other reinforcer
- e.g. High five, good grades, bell in operant behavior
What is a generalized conditioned reinforcer? Give examples.
Becomes effective as a reinforcer through its relation to many other reinforcers
e.g. Money, gift cards
What is an unconditioned response? Give examples.
Does not depend on a relation to other to other reinforcers
e.g. Food, water, sleep
What is an automatic reinforcer? Give examples?
One that has a natural relation to the response that produces it (aka, intrinsic reinforcer)
e.g. Thumb sucking, hair twirling, & nail-biting
What is a contrived reinforcer? Give examples
One that has an arbitrary relation to the responses (aka, extrinsic reinforcer)
e.g. Paycheck, chocolate
What is a conditioned reinforcer?
Becomes effective as a reinforcer through its RELATION to some other reinforcer
Give examples of conditioned reinforcers.
High fives, good grades, bell in operant behavior
What is a generalized conditioned reinforcer?
Becomes effective as a reinforcer through its relation to MANY other reinforcers
Give examples of generalized conditioned reinforcers.
Money, gift cards
What is an unconditioned reinforcer?
Doesn’t depend on a relation to other reinforcers
Give examples of unconditioned reinforcers
Food, water, & sleep
What is an automatic reinforcer?
One that has a natural relation to the response that produces it (aka, intrinsic reinforcer)
Give examples of automatic reinforcers
Thumb sucking, hair twirling, & nail biting
What are contrived reinforcers?
One that has an arbitrary relation to the responses (aka, extrinsic reinforcer)
Give examples of contrived reinforcers.
Paycheck, chocolate
