Exam 2 Flashcards
Direct effect of schedule
The contingency which the schedule specifies. E.g., one lever press to get food. X behavior must occur for a reinforcer to be produced
Side effect of schedule
A characteristic of behavior that is not necessary for the reinforcer to be produced.
Response based schedule
Only x responses are required for reinforcement (fixed/variable ratio schedule).
Higher ‘n’ in FR leads to..
Higher response rate (?) and longer pause (break and run pattern).
VR 30
A variable ratio schedule with mean of n of 30
Direct and side effects of VR
Direct: mean number of responses must occur. Side: constant, high rate of responding.
Fixed interval
Once a certain time has passed, the first response that occurs is reinforced.
FI 3’
Fixed interval that starts reinforcing after three minutes.
Directed and side effects of FI
Direct - obvious. Side effect: Peak based pattern -
- Little responding at beginning of interval
- Los of responding at end of interval
Example: checking watch while waiting for a bus
Side effect of a FI
Scallop
What happens with larger VR rates?
The response increases (?)
Variable Interval
Direct effect: the first response after a varied amount of time is reinforced.
Side effect: low, constant response rate.
Example: pop quizzes
Order of steepest schedules
Most to least:
- VR
- FR
- FI
- VI
What does a longer VI do?
Lowers the response rate
Fixed time
Not to be confused with FI. But FT is time based only - it does not depend on a response.
Direct effect - nothing
Side effect - adjunct behavior and a decrease in behavior that was previously reinforced.
Non contingent reinforcement
NCR - same as fixed time
Differential reinforcement of high rate (DRH)
X responses must occur within time t. Used to increase behavior and make it more rapid. Examples: encourage kid eating quicker. Or need to talk quickly to get your thought across.
Differential reinforcement of low rates (DRL)
IRT > some time t. Respond before a certain time and it resets. Used to decrease behaviors but completely eliminate (e.g., rapid eating).
Inter-response time (IRT)
Time between responses
Differential reinforcement of other behavior (DRO)
Behavior incompatible (lifting weights instead of hitting but not something that can be done simultaneously) with x must occur for reinforcer to be delivered. Used to completely decrease behavior (aggression).
Multiple vs concurrent vs conjoint schedules
Multiple - There is a series of schedules (in series rather than in parallel).
Concurrent - there are schedules that happen in parallel and we can choose between being reinforced by many different schedules. I.e., schedules compete with each other.
Conjoint - a overall schedule that is composed of other schedules.
Extinction burst
The burst that happens after the reinforcement stops
Extinction effect
- Extinction burst
- Variability in behavior and topography (qualitative features such as pounding vs touching lightly) increases
- Force of operant previously reinforced increases
Seems like all instances of aggression but actually each is a separate aspect of behavior.
- Behavior under extinction eventually decreases
Is it true that the more consistently you reinforce behavior, the stronger it becomes?
No, varied creates behavior that is harder to make extinct.
Partial reinforcement effect
Inconsistently reinforced behavior is harder to make extinct.
Aversive
Subjective: uncomfortable, painful. Determined by self-report.
Objective: something that is avoided (behaviorally determined).
Natural aversive
The first time you come into contact with it, you have an aversive response. E.g., touching a hot stove. (A good litmus test is would a baby respond to it.)
- Harmful
- “Annoying”
- Thresholds are individuals
Not:
- Spiders
- Learned aversives
What do thresholds of aversives depend on?
- The individual
* Experience (prenatal, e.g.)
Habituation
Decrease response due to repetition
Sensitization
Increase response due to repetition
What can change responses to aversives?
Habituation, sensitization, reinforced self-reports (parents giving child attention when they fall)
Learned aversives
Neutral stimulus is paired with naturally aversive stimulus (conditioned aversive stimulus).
- Sight of an annoying neighbor
- Little kids at the movie (just the sight)
Punishment
Decreases behavior
Requirements for punishment
A response has to occur (there must be earlier reinforcement). Therefore, all punishment schedules are competing against reinforcement schedules.
When is a punisher most effective
- Immediate - delayed punishers are less effective
- Intense - if introduced gradually in intensity, behavior becomes “tolerant”; punishment is more effective at full intensity.
- Continuous schedule of punishment is more effective than intermittent schedule
- Reducing effect of competing reinforcer
- Verbally specified (for humans)
- An appropriate way to obtain the reinforcer that is maintaining behavior
When is punishment less effective
- When there are competing reinforcing contingencies
Two types of negative reinforcement
- Escape
S-: behavior results in removal of aversive (e.g., hitting snooze, taking pain-relieving meds, feeding whining dog, stopping the complaining when roommate does dishes) - Avoidance : behavior prevents aversive stimulus from occurring (no occasioning stimulus and no removal of that stimulus). The response postpones an aversive experience.
* Examples:- Taking a daily preventative medication right before the dose wears off
- Brushing teeth to avoid getting cavities
Sidman avoidance
Dog can avoid every shock even with no CS
What does a short time between response and shock cause (short response shock interval)
Higher rate of jumping
One-factor theory
Behavior is operant. The one factor is simply the reduction of aversive events. Time is the “stimulus” that occasions an avoidance response.
Two-factor theory
Operant and classical. 1. Fear is classically conditioned to the passage of time and 2. the organism behaves to escape fear/anxiety/discomfort (escape).
Avoiding the shot is part of it but it isn’t sufficient.
Immediate effects of punishment
- Punisher is reinforced
- Punisher becomes an aversive
- Generalization to other physically similar stimuli
- Aggression (displaced aggression, counter-control)
- Withdrawl
- Suicide (extreme withdrawl)
Displaced aggression
When one has no control over the aversive, they might channel aggression towards another object or organism. Examples:
- Bad grade leads to yelling at roommate
- Verbal abuse because of low SES
Counter-control
When there is no control over aversive, aggression can occur to stop the source of the punishing consequences. Examples:
- Rebellion against controlling parents
- Fighting back against bully
Non-standard aversives
Inequality (unequal outcomes for equal effort). Leads to less productivity, more violence, more risk of depression, anxiety, suicide.
