Instructor's notes Flashcards
Targeting a student’s attitude in class would be an example of a(n) OBJECTIVE or SUBJECTIVE measure.
-Subjective
Which would be an objective measure to replace the student’s “attitude” in class?
A. How happy the student is in class
B. How many times the student makes comments
like “I hate this”
C. The student’s tone of voice and agitation level
B. How many times the student makes comments
like “I hate this”
Behavior-analytic assessments will never include subjective measures.
A. True
B. False
B. False
- Behavior-analytic assessments will always include objective measures but may supplement with subjective, particularly in measures of social validity
- Not sufficient, but necessary (Baer et al., 1987)
When behavior analysts attempt to identify if the participants, caregivers, and other consumers consider the intervention acceptable, we are assessing the social validity of the:
A. Goals
B. Procedures
C. Results
B. Procedures
Tucker is assessing the social validity of the goals selected for his client. He decides it is important to include the teacher, his client’s parent, and a sibling. Which step for conducting a social validity assessment does this describe?
A. Collect and summarize the data
B. Identify what to assess
C. Identify who will be conducting the assessment
D. Identify who will be evaluating
D. Identify who will be evaluating
Social Validity OF Goals
- Broad social goals - E.g. Make Friends
- Behavioral categories - Ex Skills for conversation
- Discrete responses - EX. Asking appropriate Q
John is a 45-year-old man who resides in a group home. The employees are concerned because John curses and refuses to cooperate when they direct him to shower. Which of the following would be a socially valid goal for John?
John will:
A. Follow staff directions 100% of the time
B. Independently initiate and take a shower
C. Reduce cursing to zero incidents a month
B. Independently initiate and take a shower
Methods for Assessing Social Validity
- Indirect Technique: Interviews, Questionnaires, Rating Scales
- Direct Techniques Normative comparison and Norm-ref’d assessment
Which of the following is a direct method for assessing the social validity of goals?
A. Normative comparison B. Norm-referenced assessment C. Rating scales D. All of the above E. A and B but not C
E. A and B but not C
You are working with a young child in a classroom, attempting to decrease call-outs. When selecting a target level of behavior, you observe her same- age peers and collect data on the rate of call-outs. This is a(n) ___ technique for meas. the SV of ___.
A. Direct; goals
B. Direct; procedures
C. Indirect; goals
D. Indirect; procedures
A. Direct; goals
*What direct method? Normative comparison
Assessing Risks & Benefits
- Reconcile with Key parties
- General Risk factors of Tx
- Benefits of Tx
- Risks for each procedure
You work with a student in her classroom. You are concerned about the fact that the student’s teacher has stated he does not agree with delivering reinforcers because of the negative effects of extrinsic motivation. Which risk factor?
A. Client and stakeholder buy-in B. Liability to the behavior analyst C. Nature of the behavior D. Risk to others E. Sufficient personnel
A. Client and stakeholder buy-in
Ongoing Assessments Including Treatment Integrity
Social Validity of Procedures
- Comprehensive Tx program: Ex. Reducing prob Bx
- Components of the program Ex. Fx comm. training
- Specific Bx procedures Ex. Using Extinction
Lily is a 5-yr-old who does not stay in her seat and runs around her classroom. She screams when her teachers attempt to physically guide her to do work. Which would be a socially valid procedure?
A. Assist Lily with completing a task using hand-over- hand prompting before allowing her to run around
B. Place preferred items at the table and attending to Lily when she comes and engages with them
C. Seat Lily in a high-chair with a seat-belt for the entire school day
B. Place preferred items at the table and attending to Lily when she comes and engages with them
Methods for Assessing Social Validity
- Indirect Techniques: Interviews, Questionnaires, Rating scales
- Direct Techniques: Participant preference, Sustained use
Before implementing a selected intervention, you ask your client’s parent to answer questions like, “How acceptable do you find the suggested procedures?” This is a(n) ___ meas. of SV of ___.
A. Direct; goals
B. Direct; procedures
C. Indirect ; goals
D. Indirect; procedures
D. Indirect; procedures
Can have a team member not involved in implementation conduct the assessment
Assessing Treatment Integrity
- Select which Tx
- Define steps of Tx
- Determine type of data (global or specific)
- Meas. implementation
- Compare data to criteria (train?)
Bella has created a data sheet that includes all the necessary steps to correctly implement the teaching procedure and plans to calculate a global score as the supervisee is proficient in the protocol. What is the next step Bella should do?
A. Compare data to criteria B. Define the steps of the treatment C. Determine the type of data to use D. Measure implementation E. Select which treatment to measure
D. Measure implementation
Bella’s supervisee, Charlie, is using a FR1 to teach the client beginner intraverbal skills. Charlie forgets to deliver the reinforcer on trial 3 after his client’s correct response. This is an example of which type of treatment integrity error?
A. Error of commission
B. Error of omission
C. Neither (not an error)
B. Intraverbal
Bella has collected data on her supervisee’s adherence to the teaching procedure and is analyzing the graph of % correct implementation. What step for assessing Tx integrity is she doing?
A. Compare data to criteria B. Define the steps of the treatment C. Determine the type of data to use D. Measure implementation E. Select which treatment to measure
A. Compare data to criteria
*What if there is low accuracy? Need to re-train
Assessments Conducted as Goals Are Reached
Social Validity of Results
- Proximal (Short-term) Ex. Reduce Prob Bx
- Intermediate: Ex. Able to go to park
- Distal (Long-term): Ex. Makes friends
Leslie is a 15-yr-old student with an intellectual disability. She has been receiving behavioral services through a social skills program so that she can expand and deepen her peer relations. Which would be a socially valid result? If Leslie:
A. Accurately answered all the therapist’s questions about how to be a good friend
B. Earned an A in the social skills program
C. Went to the roller-rink and exchanged phone numbers with a new friend
C. Went to the roller-rink and exchanged phone numbers with a new friend
Which of the following is an indirect method for assessing the social validity of results (outcomes)?
A. Questionnaires B. Rating scales C. Real-world test D. All of the above E. A and B but not C
E. A and B but not C
After providing services you ask your client’s teacher to fill out form indicating if she dis/agrees with statements like, ”The student is engaged in academic work tasks, sitting appropriately, and attending.” You are using a(n) ___ technique for measuring the social validity of ___.
A. Direct; goals
B. Direct; results
C. Indirect; goals
D. Indirect ; results
D. Indirect; results
After providing services you collect data on your client’s rate of responding to teacher’s questions and compare this to the rate that other students in the class are answering questions. You are using a(n) ___ technique for meas. the SV of ___.
A. Direct; goals
B. Direct; results
C. Indirect; goals
D. Indirect ; results
B. Direct; results
What type of technique? Normative comparison
In behavior analysis, we most often use OBJECTIVE or SUBJECTIVE measures.
*Which of the following is true of subjective measures:
A. Can change over time B. Counter to the natural science approach C. Can identify functional relations D. All of the above E. A and B but not C
*Objective
E. A and B but not C
Assessing consumer choice between treatment options cannot be accomplished if the client has limited expressive language.
A. True
B. False
B. False
The process of identifying both risks and benefits associated with a specific action and making a decision based on these factors
A. Formal reassessment B. Indices of happiness C. Objective measure D. Procedural fidelity E. Risk-benefit analysis F. Social validity G. Social validity assessment H. Subjective measure
E. Risk-benefit analysis
Which of the following is a characteristic of behavioral approaches to assessment?
A. Leads to broad “level” or global score
B. Leads to specific targets
C. Subjective self-report may be only measure
D. All of the above
E. A and B but not C
B. Leads to specific targets
Behavioral assessments require direct (objective) observation of behavior
Which of the following is a direct method for assessing the social validity of results (outcomes)?
A. Expert evaluation B. Normative comparison C. Norm-referenced assessment D. All of the above E. A and B but not C
D. All of the above
Lola’s mom is only supposed to give Lola a popsicle when she says, “popsie.” Lola bangs her hands on the freezer door and her mom opens the freezer and gives her a popsicle. This is an example of which type of treatment integrity error?
A. Error of commission
B. Error of omission
C. Neither (this is not an error)
A. Error of commission
Adherence to all conditions of research design (baseline and treatments)
A. Formal reassessment B. Indices of happiness C. Objective measure D. Procedural fidelity E. Risk-benefit analysis F. Social validity G. Social validity assessment H. Subjective measure
D. Procedural fidelity
Behavior-analytic assessments will always include objective measures.
A. True
B. False
A. True
An outside observer reviews a recorded pre- intervention performance and compares to post- intervention performance. This is a(n) ___ technique for measuring the social validity of ___.
A. Direct; goals
B. Direct; results
C. Indirect; goals
D. Indirect ; results
B. Direct; results
*What type of direct method? Expert evaluation
The degree to which the consumer finds professional involvement acceptable from beginning to end
A. Formal reassessment B. Indices of happiness C. Objective measure D. Procedural fidelity E. Risk-benefit analysis F. Social validity G. Social validity assessment H. Subjective measure
F. Social Validity
The purpose of a behavior-analytic assessment is to identify a diagnosis through measures that lead to a global score or grade level equivalent.
A. True
B. False
B. False
Leslie compares Ron’s red meat consumption to the Am. Heart Association’s recommendation to determine how meaningful a reduction in Ron’s red meat consumption will be to his health. This is a(n) ___ technique for meas. the SV of ___.
A. Direct; goals
B. Direct; procedures
C. Indirect; goals
D. Indirect; procedures
A. Direct; Goals
*What method? Norm-referenced assessment
Which of the following is a behavior-analytic assessment?
A. Assessment of IOA B. Grade placement test C. IQ test D. All of the above E. A and B but not C
A. Assessment of IOA
Kaya is evaluating social validity for a manding program. She has just finished collecting data and is currently summarizing. What is the next step Kaya should complete for conducting a social validity assessment?
A. Collect and summarize the data B. Identify what to assess C. Identify who will be conducting the assessment D. Identify who will be evaluating E. Reconcile any low scores
E. Reconcile any low scores
Measures that are influenced by personal opinions and can only be reported by the individual
A. Formal reassessment B. Indices of happiness C. Objective measure D. Procedural fidelity E. Risk-benefit analysis F. Social validity G. Social validity assessment H. Subjective measure
H. Subjective measure
When behavior analysts attempt to identify if the the participants, caregivers, and other consumers are satisfied the outcomes of services, we are assessing the social validity of the:
A. Goals B. Procedures C. Results D. All of the above E. A and B but not C
C. Results
When behavior analysts attempt to identify if whether the behavioral targets are important to the participants, caregivers, and other consumers, we are assessing the social validity of the:
A. Goals B. Procedures C. Results D. All of the above E. A and B but not C
A. Goals
You work with a student in her classroom. You are concerned about how the fact that this teacher’s class already has more students than it should will impact the teacher’s ability to implement your behavior plan as written. Which risk factor?
A. Client and stakeholder buy-in B. Experience of behavior analyst C. Liability to the behavior analyst D. Prior training of the mediator E. Sufficient personnel
E. Sufficient personnel
Periodic comprehensive assessment to identify progress toward goal, or to reevaluate existing problem behavior
A. Formal reassessment B. Indices of happiness C. Objective measure D. Procedural fidelity E. Risk-benefit analysis F. Social validity G. Social validity assessment H. Subjective measure
A. Formal reassessment
Which of the following is a characteristic of behavioral approaches to assessment?
A. Ongoing B. Requires direct (objective) observation of behavior C. Separates out each operant D. All of the above E. A and B but not C
D. All of the above
*Educational/psychological assessment often combine operants in a “snapshot”
Before designing a behavior plan, you ask your client’s parent to rate the importance of some potential social skills to determine a hierarchy which will guide treatment . You are using a(n) ___ technique for meas. the SV of ___.
A. Direct; goals
B. Direct; procedures
C. Indirect; goals
D. Indirect ; procedures
C. Indirect; goals
What type of indirect method? Rating scale
Which of the following is an indirect method for assessing the social validity of procedures?
A. Interviews B. Questionnaires C. Rating scales D. All of the above E. A and B but not C
D. All of the above
Measures that are impartial and independently verifiable
A. Formal reassessment B. Indices of happiness C. Objective measure D. Procedural fidelity E. Risk-benefit analysis F. Social validity G. Social validity assessment H. Subjective measure
c. Objective measure
The purpose of a behavior-analytic assessment is to gain specific information about individual performance within a specific environment.
A. True
B. False
A. True
A behavior analyst identifies the typical performance and compares this to a dimension of the client’s performance. This is a(n) ___ technique for measuring the social validity of ___.
A. Direct; procedures
B. Direct; results
C. Indirect; procedures
D. Indirect ; results
B. Direct; results
What type of technique? Normative comparison
You go back to the school you consulted with last month to see if the teachers are still using the token economy you designed and implemented. This is a(n) ___ measure of social validity of ___.
A. Direct; goals
B. Direct; procedures
C. Indirect ; goals
D. Indirect; procedures
B. Direct; procedures
What direct method? Sustained use
A way to measure behavior that is correlated with pleasant opinions and feelings
A. Formal reassessment B. Indices of happiness C. Objective measure D. Procedural fidelity E. Risk-benefit analysis F. Social validity G. Social validity assessment H. Subjective measure
B. Indices of happiness
Which of the following is a behavior-analytic assessment?
A. Narrative recording B. Reinforcer assessment C. Psychological inventory D. All of the above E. A and B but not C
E. A and B but not C
After providing services you ask your client’s teacher to fill out form indicating if she dis/agrees with statements like, ” The student is engaged in challenging behavior and not attending.”You are using a(n) ___ technique for meas. the SV of ___.
A. Direct; procedures
B. Direct; results
C. Indirect; procedures
D. Indirect ; results
D. Indirect ; results
What type of indirect method? Rating scale
Before implementing a selected intervention you ask your client’s parent to fill out a form where he answers questions like, “How well do you understand the suggested procedures?”You are using a(n) ___ technique for meas. the SV of ___.
A. Direct; procedures
B. Direct; results
C. Indirect; procedures
D. Indirect ; results
C. Indirect; procedures
*What type of indirect method? Rating scale
Examination of the acceptability, viability, and appropriateness of a client goal, programmed intervention, and/or outcome
A. Formal reassessment B. Indices of happiness C. Objective measure D. Procedural fidelity E. Risk-benefit analysis F. Social validity G. Social validity assessment H. Subjective measure
G. Social validity assessment
Annie has been asked to work with a new client who is having difficulty in the classroom setting. After careful consideration, Annie has identified an appropriate survey to use. What should have already been done?
A. Determine when to assess B. Identify what to assess C. Select methods and tools D. All of the above E. A and B but not C
E. A and B but not C
Which of the following is an indirect method for assessing the social validity of goals?
A. Interviews B. Normative comparison C. Norm-referenced assessment D. All of the above E. A and B but not C
A. Interviews
Bella is creating a task analysis for the teaching procedure to design a data collection sheet for observing and recording. What step for assessing treatment integrity is Bella completing?
A. Compare data to criteria B. Define the steps of the treatment C. Determine the type of data to use D. Measure implementation E. Select which treatment to measure
B. Define the steps of the treatment
Before designing a behavior plan, you ask your client’s parent to answer questions like, “If you could change one thing today that would make your child’s life better, what would it be?” You are using a(n) ___ technique for meas. the SV of ___.
A. Direct; goals
B. Direct; results
C. Indirect; goals
D. Indirect ; results
C. Indirect; goals
*What type of indirect method? Interview
Which of the following is a direct method for assessing the social validity of procedures?
A. Expert evaluation B. Participant preference C. Real-world test D. All of the above E. A and B but not C
B. Participant preference
What is another direct method for assessing the social validity of procedures? Sustained use
Johan observes an RBT running a backward chaining procedure for washing hands. He checks off each step on his sheet as it is completed.
Is this a behavior-analytic assessment?
A. Yes
B. No
A. Yes
After talking to a client’s parents and having them complete a form, Nisha concludes that their child is not ready for a classroom setting based on their assessment score
Is this a behavior-analytic assessment?
A. Yes
B. No
B. No
The ranking of a learner’s academic skills as “needs improvement”, “meeting expectations”, or “exceeding expectations”.
A. Objective measure
B. Subjective measure
B. Subjective measure
The number of times a student vocally states the correct answer to a multiplication problem.
A. Objective measure
B. Subjective measure
A. Objective measure
What is Social Validity?
-The degree of consumer acceptability of services
How is social validity assessed?
*A variety of both objective and subjective means
- ID who to conduct assessment with 2. ID when to assess
- ID what to assess
- ID how to assess (i.e., select methods) 5. ID who will conduct the assessment 6.Collect and summarize data
- Reconcile low scores
Joel has been asked to work with a new client who is having difficulty in the classroom setting. After careful consideration, Joel has identified an appropriate survey to use. What steps for conducting a social validity assessment should Joel have already completed?
A. Identify what to assess
B. Reconcile any low scores
C. Select methods and tools
D. Determine when to assess
E. Collect and summarize the data
F. Identify who to conduct assessment with
G. Identify who will be conducting the assessment
D. Determine when to assess
F. Identify who to conduct assessment with
Joel has been asked to work with a new client who is having difficulty in the classroom setting. After careful consideration, Joel has identified an appropriate survey to use. What steps for conducting a social validity assessment should Joel complete next?
A. Identify what to assess
B. Reconcile any low scores
C. Select methods and tools
D. Determine when to assess
E. Collect and summarize the data
F. Identify who to conduct assessment with
G. Identify who will be conducting the assessment
G. Identify who will be conducting the assessment
What to Measure…
- Goals
*Goals:
Levels: Broad social, Behavioral categories discrete responses
*Meaningful & appropriate to client & society?
What to Measure…..
- Procedures
- Levels: Comprehensive plan, components, specific procedures
- Are these acceptable to relevant parties?
What to Measure….
- Results
- Levels: Short-term, intermediate, long-term
- Are consumers satisfied with both intended & unintended results?
Indirect Methods
- Interview/ Questionnaires: Helps prioritize goals identifies expectations & values
- Rating Scales: May assist when there is a disagreement of priority
Direct Methods
- Normative Comparison: Compare current client data to sample to inform client goals
- Norm-referenced assessment or curricula: Use of a curriculum/ standard to identify valid goals
Which of the following is likely the most socially valid goal for a 7-year-old child who is behind on some academic skills and screams when given a difficult task?
A. Complete all seat work at 100% accuracy
B. Follow all instructions provided by an adult
C. Raise hand to request assistance when given difficult seat work
C. Raise hand to request assistance when given difficult seat work
Leslie compares Ron’s red meat consumption to the American Heart Association’s recommendation to determine how great a reduction in Ron’s red meat consumption will be appropriate/meaningful to his health. Which method for assessing social validity is being used?
A. Behavioral interview B. Rating scales C. Normative comparison Leslie compares Ron’s red meat consumption to the American Heart Association's recommendation to determine how great a reduction in Ron’s red meat consumption will be appropriate/meaningful to his health. Which method for assessing social validity is being used? A. Behavioral interview B. Rating scales C. Normative comparison D. Norm-referenced assessment or curricula
D. Norm-referenced assessment or curricula
Weighing Risks and Benefits
- Nature of the Bx
- Is there sufficient personnel?
- Is the mediator well-trained?
- Is the setting appropriate?
- Is the Bx analyst experienced?
- Risk to others
- Buy-in
- Personal liability
Izabella has identified that the classroom may be an inappropriate place to implement the treatment component of extinction for attention-maintained behavior as it is likely not possible to control for the attention delivered by peers.
A. Nature of the behavior B. Sufficient personnel C. If the mediator is well trained D. Appropriateness of the setting E. Experience of the behavior analyst F. Risk to others G. Buy-in H. Personal liability
D. Appropriateness of the setting
How to Assess: Procedures Indirect
Interview/ Questionnaires)
Assesses stakeholder opinion on the feasibility/ appropriateness of procedures
How to Assess: Procedures Indirect
Rating Scales
-May also include acquiring information on indices of happiness
How to Assess: Procedures
Direct
Participant preference
-Allow individual to indicate treatment preference(of options they have experienced). Commonly uses concurrent chains arrangement
How to Assess: Procedures
Direct
Sustained Use
-Observe if procedures continue to be used by implementers in the setting
Amar plans to train the parents of his client to delivery reinforcement paired with praise when the client engages in appropriate peer play with their sibling.
Is this likely to be a socially valid procedure?
A. Yes
B. No
A. Yes
Amar also plans to train the parents to use an escape extinction procedure when transitioning through a bedtime routine, this may include full physical guidance despite the parents expressing concerns about the use of manually forcing the child through actions.
Is this likely to be a socially valid procedure?
A. Yes
B. No
B. No
Simeon goes back to the school he consulted with last month to see if they are still implementing the token economy he had instituted. Which method for assessing social validity is being used?
A. Behavioral interview
B. Questionnaire/Rating scales C. Participant preference D.Sustained use
D. Sustained use
Procedural fidelity is how well _____ are adhered to.
Treatment integrity is how well _____ is implemented as designed.
- Conditions of the research design
* The Treatment Condition(s)
Types of Treatment Integrity Errors:
- Omission: A step missing (or omitted) that should have occurred
- Commission: A step was added (committed) that should NOT have occurred
