Measurement, Data, and Interpretation Flashcards
Completeness in an operational definition refers to
Completeness in an operational definition refers to
What would NOT be a helpful component to a definition of behavior?
o Results in others
o Including medical criteria
A topographical definition of a behavior is one that is written in terms of
Movements that comprise the behavior
Objectivity in an operational definition refers to…
Observable characteristics of the behavior or environment
What are the 3 criteria for defining behavior?
Objectivity, clarity, completeness
Clarity in an operational definition refers to…
Unambiguous description; specifies the exact behavior
Low frequency, high intensity behaviors can be addressed…
By treating high and low frequency behaviors of the same response class regardless of intensity
Response class theory suggests that interventions should address the
Entire response class
A functional definition of a behavior is one that is written in terms of…
outcomes or consequences
Event recording is a useful measure when the goal of an intervention is to…
Increase/decrease the number of occurrences
Event recording is not appropriate for measuring responses that…
o Occur so rapidly that observers cannot keep pace with recording every instance
o Vary widely in duration
o Do not have a clear and distinct onset/offset
Event recording is best suited to the measurement of responses that
Have a discrete beginning and end
Every day after dinner, a child is to put their plate in the sink. Which formula calculates present of occurrences?
o # of times plate was put in sink divided by # of dinners (x100)
Event recording is a frequency measure also referred to as
the Tally Method
Percent of occurrences based on too few opportunities yields
Over/under- estimated results
Use percent of occurrences only if there is a minimum of
30 opportunities
Continuous recording procedures involve recording
The occurrence of all instances of a target behavior
A student is to increase the amount of time interacting with peers. The best measure is
Duration
So that frequency measures can be meaningfully compared across observation sessions when the target response is opportunity-bound or trial-bound (i.e., the response can’t meaningfully occur in the absence of a specified stimulus), frequency measures should
Be converted to percent of opportunities to respond
So that frequency measures can be meaningfully compared across observation sessions when the duration of observation sessions varies, frequency measures should
Be converted to response rate
When the opportunities to respond are presented in blocks of trials, trials to criterion data are reported as
the number of blocks of trials required for the learner to emit the correct response on a predetermined percentage of trials.
Disagreements between observers
should be analyzed.
Minimally, interobserver agreement data should be collected
in 20-30% of the sessions and at least once per condition
Which characterizes the logic behind interobserver agreement?
If 2 people say that something occurred, it is more likely that it did.
Useful error patterns of observer’s data should be identified through
Daily comparisons of each observer’s recordings
Computation of data by the individuals who collect it
Should be supplemented with computation by others
While in the midst of conducting observations, it is OK if data collectors
Know that someone else is also measuring the same behavior
Interobserver agreement
Enhances believability of data
Interobserver agreement may be influenced by
o The complexity of the recording procedure
o The number of individuals upon whom data are being collected
o The number of behaviors upon which the data are being collected
To obtain more accurate interobserver agreement, observers should
o Be naïve to the objectives of the study
o Mark every interval
o Observe from the same vantage point
Minimum acceptable interobserver agreement for publication is usually
80%
Overall agreement of occurrences should be reported when
Most of the intervals indicate no response
Overall agreement of nonoccurrences should be reported when
Most intervals indicate a response
Interobserver agreement should be at an acceptably high level
Before the study begins formal data collection
Ideally, the only reinforcement contingencies operating on observers are related to
the accuracy of data
In addition to reporting interval-by-interval agreement, also report overall agreement of occurrences when the number of intervals in which the behavior occurs is
very low
In addition to reporting interval-by-interval agreement, also report overall agreement of nonoccurrences when the number of intervals in which the behavior occurs is
very high
To calculate interobserver agreement on frequency measures
Divide the low number by the high number (x100)
To calculate nonoccurrence interobserver agreement, divide the
of intervals in which both observers recorded no occurrence by the # of interval in which at least 1 observer recorded no occurrence (x100)
To calculate occurrence interobserver agreement, divide the
of intervals in which both observers recorded occurrence by the # of interval in which at least 1 observer recorded an occurrence (x100)
To calculate interobserver agreement on duration measures, divide the
Shorter duration by the longer duration (x100)
To calculate interval-by-interval interobserver agreement, divide the
Number of intervals in which both observers agreed by the total number of intervals (x100)
Which reflects the logic behind the need to report nonoccurrence agreement data. “Interval-by-interval agreement is high, but
o Because the behavior is so frequent, I think the observers just score each interval.
Which reflects the logic behind the need to report occurrence or nonoccurrence agreement data for responses that occur at, respectively, low or high rates? “Interval-by-interval agreement is high, but
Because the behavior is so frequent, they appear to be recording occurrences when there were none
Airport baggage screeners report 100% agreement on over 700 interobserver agreement trials of regular passengers. Which question reflects the logic behind the need to report occurrence/nonoccurrence agreement data?
Can they detect when contraband is present/not present?
A mean count-per-interval of interobserver agreement is percent agreement for each interval
Averaged across all intervals
Interobserver agreement can be negatively influenced by
o The complexity of the data collection system
o An observer reinterpreting operational definitions over time
o Subtle changes in interpretation
o An observer hearing staff complaints
o Reactivity
o Expectancy
A researcher avoids having a particular therapist who had bad experiences with a student collect data to avoid the influence of
Expectancy
A researcher avoids collecting data on more than 2 students at a time due to the influence of
Complexity
The extent wo which other are convinced that measures provide aa credible reflection of actual events is called
Believability