Unit 2 Lecture Flashcards
Focus of Behavior Analysis
- Primary focus of Bx-analytic assessment: Identify prob with bx (excesses & skill deficits)
- Also need to measure & assess: Effects of bx analyst’s involvement in treatment
- Social Validity
- Risk
- Treatment integrity
Review: Behavioral Assessment
*Systematic gathering of info to make data-based decisions regarding behavior & the environment
Behavior - Analytic Assessment
- Purpose is to Gain specific info about individual performance within a specific env
- Not diagnostic
- Does not necessarily result in a global score or grade level equivalent
Different Approaches: Results of Assessments
- Behavioral:
- Leads to specific targets
- Educational/ psychological:
- Leads to Broad “Level” or global score
Different Approaches:
Combined or Separated Operants
- Behavioral:
- Separates out each operant
- Educational/Psychological:
- Often combines operants
Different Approaches Freq of Assessments
- Behavioral:
- Ongoing
- Educational/ Psychological:
- Snapshot
Different Approaches:
Types of Data Used
- Behavioral:
- Requires direct (objective) observation of bx
- Educational/ psychological:
- (Subjective) self-report maybe only measure
Which if the following are features of a behavioral assessment?
a. Ongoing
b. Combines operants
c. Provides a global score
d. Separates by operant
e. Requires observation
f. Self-report can be sufficient
a. Ongoing
d. Separates by operant
e. Requires observation
Objective Measures
- Measures that are impartial & independently verifiable
- e.g: The coffee is 160 F
Subjective Measures
- Measures that are influenced by personal opinions & can only be reported by the individual
- E.g: The coffee is too cold
Preference For Objective Measures in Bx-Analytic Assessment
- Problems with subjective measure:
- Can change over time (not reliable)
- Not casual
- Counter to the natural science approach
- Behavior-Analytic assessments will always include objective measures
- May also supplement with subjective
Which type of measures are independently verifiable?
A. Objective
B. Subjective
A. Objective measures are independently verifiable while subjective measures are influenced by personal opinions and are susceptible to biases.
Rating a product as 4 out of 5 stars would be considered what type of measure?
A. Objective
B. Subjective
B. Subjective
Whether a product is rated as 4/5 stars is based on a person’s opinion of that product. It is not clear what criterion the person might use to rate the product that way. Therefore, this would be a subjective measure.
Write an example of an objective measure:
-“Completed work in 3 hours.” Or “Asked for help 4 times.”
An objective measure can be independently verified. Any precise measure based on direct observation would be a good example of an objective measure.
Wolf (1978) on Social Validity
“Social Validity” :The Case for Subjective Measurement or How Applied Bx Analysis if Finding Its Heart”
Social Validity
*The degree to which the consumer finds our involvement acceptable from beginning to end
Importance of Social Validity
- Consumer is more likely to stick with the treatment
- Better outcomes
- Encourage others to seek treatment/ help
Poor Social Validity
- AKA social invalidity
- Actions the consumer takes when our involvement is not acceptable
- Unsatisfied consumers may:
- Not implement parts of program
- Withdraw
- Share disapproval with others
Case for Subjective Measures
*JABA’s Purpose: “Publication of applications of the analysis of bx to problems of social importance”
Laboratory and Applied Settings
- In Lab Settings:
- Select species based on genetics
- Can control individual history
- In applied settings:
- Cannot control for species
- Not using novel bx
Subjectivity in Social Validity
- Cannot rely on subjective measures alone
- Not sufficient, but necessary
- Standard practice
Which is the best description of social validity?
a. How certain we are that the procedures caused the change
b. The extent to which consumers find service acceptable
c. The extent to which a procedure affects society at large
b. The extent to which consumers find service acceptable
When assessing social validity, the use of subjective measures may be appropriate.
a. True
b. False
a. True
Social Validity Assessment
- Examination of the acceptability, Viability & Appropriateness of a client goal, programmed intervention, and/or outcome
- Are the changes in bx of clinical or applied importance?
Areas to Measure Social Validity
- Goal
- Procedures
- Results
Social Validity Goals
- Are the specific behavioral Goals really what society want?”
- The consumer
- The important people in the consumer’s life
- The society
Uses Social Validity
- Assess throughout treatment
- Remember:
- Measures must be high in each area
- Measures maybe Subjective
- Be responsive to the results of assessment
In which areas do we assess social validity?
a. Goal
b. Rapport
c. Attire
d. Procedures
e. Results
f. Demeanor
a. Goal
d. Procedures
e. Results
Are the specific behavioral ________ really what society wants?
-Goals
We assess social validity at all stages of the provision of behavior-analytic services: Before treatment (goals), during treatment (procedures), and after treatment (results).
Do consumers consider the treatment _______ acceptable?
-Procedures
We assess social validity at all stages of the provision of bx-analytic services: Before treatment (goals), during treatment (procedures), and after treatment (results).
Are consumers satisfied with the ________?
-Results
We assess social validity at all stages of the provision of bx-analytic services: Before treatment (goals), during treatment (procedures), and after treatment (results).
Prevalence of Social Validity Measures in Research
- Review of journals reporting social validity in studies:
- Carr et al (1999)
Prevalence: Take-Home Point
- Research ques often focus on some other primary phenomenon
- Prevalence in practice is still an empirical ques
Importance of Social Validity Measures in Applied Practice
*“Efficacy without adequate social acceptability is a recipe for marginalization
Why is conducting social validity assessments increasingly important in clinical practice?
a. Clinical treatment does not require IRB approval
b. Treatment often only applies one procedure at a time
c. Results of treatment typically are sufficient to satisfy consumers
a. Clinical treatment does not require IRB approval
What could result from carrying out interventions that are not socially valid?
a. Clients do not make progress
b. Caregivers may discontinue services
c. Other people who could benefit might not seek help
d. All of these
d. All of these
Early Decisions in Service Delivery
- Selecting goals & target
- Social Validity
- Treatment needs
- Intensity of services
- Involvement from others
Determining Social Validity of Goals
*Are the specific behavioral goals really what society wants?”
Applied Dimension of ABA
“In behavioral application, the bx, stimuli and/ or organism under study are chosen because of their importance to man & society”
Social Validity & the Applied Dimension E.g. 1
- E.g: Addressing feeding with a child with an extremely limited diet
- Non-e.g: Teaching a child a type when they cannot read
E.g. of Socially Valid Goals
- Live in my own apartment
- Graduate high school
- Work in a restaurant
- Communicate in a way to express needs
Non-examples of Socially Valid Goals
-Strict compliance to authority
May result in less autonomy
-Toddler never whines
Unreasonable expectation
The applied dimension of ABA tells us that goals:
a. Should be large enough to make a difference
b. Should demonstrate experimental control
c. Are chosen for their social importance
d. Generalize across contexts
c. Are chosen for their social importance
Which of the following are the most likely to be socially valid goals?
(check all that apply)
a. Asks for help when needed
b. Can identify font types by sight
c. Completes morning hygiene routine independently
d. Can arrange names of former vice president of the U.S. by year
a. Asks for help when needed
c. Completes morning hygiene routine independently
3 Levels of Goals
Assess social validity at these levels:
- Broad social goals
- Behavioral categories
- Discrete responses
Broad Social Goals
- Ultimate outcomes
- Long-term goals
- E.g: Live independently
- Non-e.g.
- Self-actualize
- Not Valid = Maintain a healthy lifestyle as defined by recent fad
- Valid: Maintain a healthy lifestyle
Behavioral Categories
- Intermediate outcomes
- e.g:
- Hygiene
- Time management
- Meal preparation
- Not valid: Consume ONLY “healthy” food
- Valid = Eat a balanced, healthy diet
Discrete Responses
- Specific target bx
- E.g:
- Showering
- Setting alarm clock
- Bringing lunch to work
- Not Valid: Consumes foods that are not in agreement with religious beliefs
- Valid - Eat 7 servings of fruits & veg per day
Selecting Goals With the Client
- Child at library, common play area
- Language delays
- Prob bx when other children approach/ touch associated items
Selecting Goals With the Client
- Child @ library, common play area
- Language delays
- Prob bx when other children approach or touch associated items
- Do we teach:
- Ask to play alone?
- Tolerate presence of peers?
What are the three levels that are associated with social validity of goals?
a. Behavioral categories
b. Components of treatment prog
c. Discrete responses
d. Broad social goals
e. Proximal results
a. Behavioral categories
c. Discrete responses
d. Broad social goals
When assessing the social validity of goals:
a. Focus on ensuring validity at the discrete-responses level above all else
b. Favorable results in 2 to 3 areas is sufficient
c. Ensure validity at all levels
c. Ensure validity at all levels
What was the problem with the social skills training program in the story that Jose told?
a. The procedures used were not bx-analytic
b. The procedure used was not effective
c. The goals selected let to unintended results
c. The goals selected let to unintended results
What would have been a more socially valid behavior for the behavior analyst to target with the boy?
Walk away, report to a teacher, or teach conversational skills about topics of common interest
Jose provided some examples of alternative behavior that could have been more effective in escaping or avoiding the bully. They included making light of the situation or walking away.
General Process for Evaluating Social Validity
- Identify who will be evaluating
- Determine when to assess
- Identify what to assess
- Select methods to assess
- Identify who will conduct the assessment
- Collect & summarize the data
- Reconcile any low scores
Identify Who Will Evaluate
- Direct consumers
- Indirect consumers
- Members of the immediate community
- Members of the extended community
Determine When to Assess Goals
- Pre-intervention:
- Selection of the goal
- Criterion for goal achievement
- Post-intervention:
- Determine if goals led to outcome
Identify What to Assess
- Select subjective and/ or objective measures of the goals
- Some e.g:
- “Importance of the goal
- Current client performance compared to the goal
Methods for Assessing Social Validity of Goals
- Indirect techniques
- Interviews/ Questionnaires
- Rating scales
- Direct techniques
- Normative comparison
- Norm-referenced assessment or curricula
Who could be relevant to include in social validity assessments?
a. Direct consumers
b. Family members
c. Community members
d. All of these
e. A and B but not C
d. All of these
Which types of techniques can be used to assess social validity?
a. Indirect
b. Direct
c. Both
c. Both
Both indirect and direct social validity assessment techniques can be used. An example of the former would be an interview or rating scale. An example of the latter would be making social comparisons with “competent” peers.
Indirect Techniques for Assessing the Social Validity of Goals
- Purpose:
- Evaluation of stakeholder values
- Assessments used:
- Interviews, questionnaires, rating scales
- Schedule for assessment:
- Pre-intervention
Review: Behavioral Interview
*A series of ques posed by a Bx analyst to someone familiar with the bx of the individual service recipient
Purpose of interviews for Assessing Social Validity of Goals
- Prioritizing goals
- Identifying expectations of bx
- Client’s expectations for self
- Caregiver expectations
- Identifying values of the individuals & community
Sample Ques to ask for Assessing Social Validity of Goals
“If you could change 1 thing today that would make _______’s life better tomorrow, what would it be?
- “What is it about _____ that keeps you up at night?”
- “What’s imp to you?”
- Focus on the Client’s benefit
What is the purpose of interviews when assessing the social validity of goals?
a. Help prioritize potential targets
b. Ensure accurate procedures
c. Guarantee adherence to treatment
d. Ensure caregivers accept the targets you select
a. Help prioritize potential targets
The purpose of interviews when assessing the social validity of goals is to help prioritize potential targets. The accuracy of the procedures and adherence of treatment are related to treatment integrity, not social validity. Caregivers accepting the targets you select is not necessarily related to social validity since they might accept a target that has no major benefit to the client.
Review: Rating Scales
*Structured ques that use a Likert scale to gather info about bx & the env during a behavioral assessment
Purpose of Rating Scales for Assessing Social Validity of Goals
- Attach a # to subjective measures
* Helpful when there is disagreement about potential goals
Prioritizing Goals
- A learner may have multiple problems with Bx (skill deficits & or behavioral excesses)
- Cannot address them all simultaneously
- Different caregivers or professionals may disagree about priorities
- Use rating system
Rating Scales for Prioritizing Goals
- List potential target bxs
- Have team members rate each goal
- Client
- Parent
- Teacher
- Others
How can rating scales help in prioritizing goals?
a. Help identify satisfaction after goals have been determined
b. Can provide evidence that the goal you have already selected is indeed the best
c. Can help sort an acceptable sequence of targets
c. Can help sort an acceptable sequence of targets
We can use rating scales to help us select and prioritize goals—we don’t use them once goals have already been determined. Rating scales do not provide evidence a selected goal is the best because rating scales are subjective. Rating scales can help sort an acceptable sequence of targets by prioritizing goals.
The results of rating scales are considered:
a. Direct measures
b. Indirect measures
b. Indirect measures
The results of rating scales are considered indirect measures because they are based on opinion and people can use different criteria to select the importance of goals.
Direct Techniques for the social Validity of Goals
- Purpose: Identify bx of clients compared to others
- Assessments used: Normative comparisons & Norm-referenced assessment &/ or curricula
- Schedule for assessment:
- Pre-intervention
Normative Comparisons for Assessing Social Validity of Goals
- Collect data on target bx
- Of Client
- Of normative sample
- Compare data btw client & sample
- Set client goals
e.g. of Normative Comparison
- Goal: Student stays in his seat while in the classroom
- What is normal for the classroom?
- What is normal for the age?
- Does this impact academic performance?
Norm-References Assessment for Assessing Social Validity of Goals
- Established curricula
- Identify skill areas
- Level of complexity
- E.g:
- VB-MAPP
- Essential for Living
Normative comparison would likely be best used for which situation?
a. To help set the duration of brushing teeth for an adult
b. To determine how long to keep an arm still for a blood draw
c. To identify the appropriate speed for an employee bagging groceries
c. To identify the appropriate speed for an employee bagging groceries
Early Decisions in Service Delivery
- Selecting goals & targets
- Social validity
- Treatment needs
- Intensity of services
- Involvement from others
Intensity (Dosage) of Services
- # of direct service hours per week
* Does not include supervision, programming, parent training etc.
Factors in Determining intensity of Services
- Severity of behavioral issue(s)
- Response to prior treatment
- Settings for training & generalization
Severity of Problem(s)
- How significant is the delay?
- More services provided for greater delays
- How intense is the challenging bx?
- More services provided when there is higher risk of harm
Response to Prior Treatment
- Has client received services in the past?
- If so how many hours?
- How quickly did bx change?
- If change is slow, more hours maybe required
Settings for Training & Generalization
- Does prob bx occurring multiple settings (home, school, work etc)
- More settings may require more hours
CASP Guidelines
-The Council of Autism Service Providers
- ASD treatment guidelines written for funding sources
- Based on client need
- Intensity of services:
- Comprehensive (30-40 hrs per week)
- Focused (10-25 hrs per week)
Involvement From Others
- Stakeholders that interact with the client (family, teachers, staff)
- Identify need for specialist involvement
What factors should be considered when determining the intensity of services?
a. Number of technician available
b. Typical authorized hours
c. Severity of delay
d. All of these
c. Severity of delay
Assessments of Treatment Procedures
- Prior to selecting treatment procedures:
- Conduct risk-benefit analysis
- Assess social validity of procedures
- While implementing treatment procedures:
- Assess treatment integrity