4-Reinforcement arrangements in applied to settings ll: detriments of reinforcer efficacy Flashcards
Zhou, Iwata,
• examined Stability of preferences over TIME in 22 adults with IDD.
• Conducted PS preference assessments at point
1.
• repeated the PS preference assessments for leisure items at intervals ranging between 12 and 20 months apart
• examined Rank Order correlations between the first and second assessments.
Mean rank-order correlation = 0.11 across participants
***GREATER STABILITY for most participants when only the top 5 stimuli are considered
• Suggests highest preferences may be more STABLE
• Corresponds with informants ability to offer
accurate opinions about reinforcers
Stability of preferences
Diagnosis: Do individuals with ASD display more stable preferences than individuals without similar diagnoses?
Stimulus type: Are food preferences more or less stable than non-food preferences?
Ciccone,: Examined rank-order correlation Coefficients for food only
Zhou: Leisure items only
Castillo,
Proportion and mean correlation for 1st vs. 2nd greater for edibles for all analyses
Findings: some validity that food preferences are more stable than non-food preferences
However, number of differences between the two studies: differing preference assessment, N, and interval between assessments
What shall we make of these
differences?
Why might food preferences be more
stable?
• Local and temporally extended satiation effects
for leisure items?
Potentially, categories showing greater
stability may require less frequent assessment?
• However, there are dangers inherent in
adopting this stance…
Shifts in Preference and Stimulus Value
• Local and temporally extended satiation effects for leisure items?
Potentially, categories showing greater stability may require less frequent assessment?
• However, there are dangers inherent in adopting this stance…
DeLeon
changes in preference associated with corresponding changes in the UTILITY of reinforcers?
Analysis
Conducted one lengthy Paired stimulus preference assessment before the study
Conducted brief MSWO PA before daily training sessions
•Utility of Frequent Assessment in Acquisition
-Sometimes helps; sometimes does not. Determining factor:
•Variable preferences!
Why might food preferences be more stable?
Zhou, Iwata, Goff, & Shore (2001):
Examined stability of preferences over time
22 adults with IDD
Conducted PS preference assessments at point 1
Repeated the PS preference assessments for leisure items at intervals ranging between 12 and 20 months apart
Examined rank-order correlations between the
first and second assessments
**Greater stability for most participants when only the top 5 stimuli are considered:
• Suggests highest preferences may be more stable
• Corresponds with informants ability to offer accurate opinions about reinforcers
Shifts in Preference and Stimulus
Value
Castillo, DeLeon, & Frank-Crawford (in preparation)
3 preference assessments, 12 items
Edible (N = 31) or nonedible (N = 38)
Does stability at 1st vs. 2nd predict 2nd vs. 3rd
Analyses:
• 3 out of 4: Did at least 3 of the top 4 remain
among the top 4?
• Top-ranked: Did stimulus ranked #1 stay #1?
• Correlation: Was the correlation of all ranked
0.7?
***Proportion and mean correlation for 1st vs. 2nd greater for edibles for all analyses
Shifts in Preference and Stimulus
Value
What shall we make of these differences?
Why might food preferences be more stable?
• Local and temporally extended satiation effects
for leisure items?
Potentially, categories showing greater stability may require less frequent assessment?
• However, there are dangers inherent in
adopting this stance…
Shifts in Preference and Stimulus
Value
DeLeon et al. (2001): Are changes in preference associated with corresponding changes in the utility of reinforcers? Analysis Conducted one lengthy PS PA before the study Conducted brief MSWO PA before daily training sessions
Shifts in Preference and Stimulus
Value
How STABLE are preferences and reinforcer efficacy over time?
Are changes in preference associated with corresponding changes in the utility of reinforcers?
Shifts in Preference and Stimulus Value
Zhou et al. (2001):
Mean rank-order correlation = 0.11 across participants
However, greater stability for most participants when only the top 5 stimuli are considered:
• Suggests highest preferences may be more stable
• Corresponds with informants ability to offer accurate opinions about reinforcers
Xxxxxxx in Preference and Stimulus
Value
Does stability differ according to:
Diagnosis (ASD vs. non-ASD)?
Stimulus type (food vs. non-food)?
XxxxxxShifts in Preference and Stimulus
Value
Zhou, Iwata:
STABILITY of preferences over time
•22 adults with IDD
•Conducted PS preference assessments at point 1
- Repeated the PS preference assessments for leisure items at intervals ranging between 12 and 20 months apart
- Examined RANK-order correlations between the first and second assessments
CONCLUSIONS:
- Greater STABILITY for most participants when only the top 5 stimuli are considered:
- Suggests highest preferences may be more stable
•Corresponds with informants ability to offer accurate opinions about reinforcers
Stability:
Shifts in Preference and Stimulus
Value
- MOMENTARY Capacity to support responses that produce it
2. UTILITY in producing LONG- term Behavior change
Effectiveness of a Reinforcer
- Pairing less preferred activity with established reinforcers through contingent delivery
- Pairing less preferred activity with established reinforcers through non contingent delivery
Hanley, Iwata: Examined choices between activities in a CONCURRENT Chain.
•First link determined subsequent activity and then differing arrangement/schedules in the subsequent activity.
•They measured a proportion of selections as a function of reinforcement delivered for engagement – not choosing – in the less preferred activity. Does this impact choices?’s
Edible reinforcement and NCR music while doing dishes
Can we make something preferred when it was not already By
Hanley: Shifting activity preferences
Hanley, Iwata :
• Selected one high preferred and one low preferred activity, measured relative Response Allocation.
In conditioning procedure, established reinforcers were delivered on FT schedules during access to low preferred.
No reinforcement during access to high preferred.
Each arranged for three, five minute sessions, followed by tests Sessions (no consequence for either activity)
CONCLUSIONS:
- Enhancing an activity with SUPPLEMENTAL CONTINGENT reinforcement can SHIFT choices towards that activity
- Non-contingent PAIRING of an activity with ESTABLISHED preferred stimuli can SHIFT choices toward that ACTIVITY
Effects seem to be TRANSIENT (do not persist after discontinuation of the Pairing procedures)
Determinants of Stimulus Value
Continuing research- Hanley
Examined affects of SATIATION and CONDITIONING on Preference RANKS.
Conducted INITIAL preference assessment then a SATIATION condition for HIGH preference stimulus
Free access for 2 to 3 hours per day, and conditioning for a low preference stimuli, pairing the stimulus with continuous attention and continue with availability I prefer edibles, five, one minute trials per day. Exposure for the control stimuli was 51 minute child per day.
Hanley Iwata Roscoe
DELAY to reinforcement: widely studied in context of
- treating problem behavior
- Research on Temporal discounting
- Self control.
Are conditioned reinforcers less susceptible to adverse affects of delay?
Determinants of Stimulus Value:
Delay
Leon Examined the effects of Delayed reinforcement with primary and conditioned reinforcer.
Three Conditions:
1. Baseline – no Reinforcement
2. FR 1 no delay (responses produced a reinforcer immediately)
3. FR1 increasing delay
(responses produced a reinforcer following 1 of 5 delays)
Assessed delayed of food, delayed tokens, and immediate tokens with a delayed exchange
CONCLUSIONS:
• delayed FOOD produced the greatest Persistence
• Delayed TOKENS produced most RAPID decreases in responding,
- Token delivery with a delayed EXCHANGE opportunity equaled or exceeded Effects of delayed food.
Conditioned reinforcers less susceptible to adverse affects of delay.. depends on when they are OWNED and EXCHANGED
Determinants of Stimulus Value:
Delay
Effects relative response allocation
Matching law (ML): Organisms will distribute behavior among concurrently available
alternatives in same proportion that reinforcers
distributed among those alternatives
In humans, the ML obtains for
Problem behavior
Academic responding
Communicative behavior
Leon, Deleon: Rate of reinforcement:
Determinants of Stimulus Value
higher preference = better ______
Studies have compared responding for
reinforcers of varying preference
•However, as noted earlier, HP and LP stimuli sometimes support SIMILAR RATES of responding
Research on amount of work completed for stimuli of varying preference assessed via Progressive Ratio schedules
Higher preference, better quality reinforcers:
- More Potent reinforcers
Quality of reinforcement
Determinants of Stimulus Value:
Leon, Deleon
Can vary according to:
Quantity
Intensity
Duration
Mixed results examining effects of ____
Some suggest a positive relation between magnitude and responding
Other suggest no relation
Function of schedule of reinforcement?
Magnitude of reinforcement
Trosclair
Preference assessment: Concurrent operant arrangement used to assess the participants’ preferences for two different reinforcer magnitudes (i.e., small vs. large or medium vs. large) and no reinforcement
Progressive Ratio analysis conducted to assess reinforcer EFFICACY
may play an important role when THINNING schedules of reinforcement
Magnitude
effects of different reinforcer magnitudes on preference and reinforcer efficacy
An environmental event, operation, or
stimulus condition that serves the following 2 functions
- Reinforcer establishing function:
Momentary alters the reinforcing effectiveness of other events - Evocative function: Momentarily alters the frequency of occurrence of the type of behaviors that produces those other events as a consequence
Motivating Operation (EO):
Determinants of Stimulus Value:
Motivating Operations
Momentarily increases the reinforcing
effectiveness of that stimulus.
Momentarily increases the frequency of behavior that produce the stimulus as a consequence
Stimulus deprivation
Determinants of Stimulus Value:
Motivating Operations
Momentarily decreases the reinforcing
effectiveness of the stimulus
Momentarily decreases the frequency of behaviors that have produced the stimulus as a consequence
Stimulus satiation
Gottschalk):
Deprivation and satiation effects with food on preference assessment OUTCOMES:
• Control: Regulated (premeasured) access for
24 hr before assessment
- Deprivation: 48 hour deprivation for one stimulus at a time; regulated access for others
- Satiation: 10 min free access before assessment; regulated access for other
Paired-stimulus preference assessment
following manipulations
***SATIATION can influence preference RANK
Determinants of Stimulus Value:
Motivating Operations
Can influence preference RANK
CAN similarly influence PERFORMANCE
-Depends upon the specific OPERATION and the person
Satiation
Determinants of Stimulus Value:
Motivating Operations
Zhou, Iwata):
Deprivation and satiation for food reinforcers under less contrived arrangements
Deprivation: 30-min before lunch
Satiation: 30-min after lunch
No additional exposure, unlike Vollmer &
Iwata (1992)
Determinants of Stimulus Value:
Motivating Operations
Conclusions on motivating operations:
Zao, Vollmer
• Can influence preference assessment results
•May influence reinforcer VALUE but not
necessarily under NATURALISTIC conditions
• More interesting examples may not involve deprivation or satiation, but CONDITIONED establishing operations
-Transitive CEO manipulated to enhance motivation for mands in response chains
Are there different “kinds” of satiation?
Are the sorts of changes in deprivation/satiation correlated with normal life enough to shift response
patterns?
Vollmer Examined rates of SIMPLE responses under conditions of deprivation satiation
Deprivation/Satiation
Determinants of Stimulus Value:
Motivating Operations
Can the effectiveness of a reinforcer be
influenced by the nature of other, qualitatively different reinforcers in the environment?
Behavioral economics:
-Imports principles of microeconomics to the
study of OPERANT behavior
Determinants of stimulus value: behavioral economics
Investigation of choice under conditions
of asymmetrical reinforcers
Investigation of consumption under various conditions of constraint
Once the parallels are drawn and validated, opens the door to relations heretofore only considered by
economists
Why behavioral economics in IDD?
Commodities:
Econ: Goods and services
B. Econ: Reinforcers
Unit Price:
Econ: $ paid per unit of commodity
B. Econ: Number of responses “paid” per
unit of reinforcer
Consumption:
Econ: Total quantity of a commodity
consumed, typically at the population level
B. Econ: Total amount of a reinforcer
obtained per unit time, typically at the
individual level
Behavioral Economics – Some
Terms
Population Demand Curve
See Co instructor material
Individual Demand Curve
Co instructions