Chapter 5 Flashcards
the extent to which observed values, the data produced by measuring an event, match the true state, or true values, of the event as it exists in nature.
Accuracy
the extent to which the researcher convinces herself and others that the data are trustworthy and deserve interpretation. Measures of inter observer agreement (IOA) are most often used index of believability in applied behavioral analysis.
Believability
the process of comparing the data produced by a measurement system to know standard or true value and, when sourced of error are found, using that information to correct or improve the measurement system.
Calibration
measurement conducted in a manner such that all instances or the response class(es) of interest are detected during the observation period.
Continuous Measurement
the percentage of total intervals in which two observers recorded the same count; the most stringent description of IOA for most data sets obtained by event recording.
Exact Count-per-interval IOA
occurs when the behavior that is measured is in some way different from the behavior of interest; considered less valid than direct measurement because inferences about the relation between the data obtained and the actual behavior of interest are required.
Indirect measurement
the degree to which two or more independent observers report the same observed values after measuring the same events
Interobservation Agreement (IOA)
an index of the agreement between observers for data obtained by interval recording or time sampling measurement; calculated for a given session or measurement period by comparing the two observers’ recordings of the occurrence or nonoccurence of the behavior in each observation interval and dividing the number of intervals of agreement by the total number of intervals and multiplying by 100.
Interval-by-interval IOA
the average percentage of agreement between the counts reported by two observers in a measurement period composed of a series of smaller counting times; a more conservative measure of IOA than total count IOA.
Mean count per interval IOA
an IOA index fo duration per occurrence data; also a more conservative and usually more meaningful assessment of IOA for total duration data calculated for a given session of measurement period by computing the average percentage of agreement of the duration reported by two observers for each occurrence of the target behavior.
Mean duration-per- occurrence IOA
nonrandom measurement error; a form of inaccurate measurement in which the data consistently overestimate or underestimate the true value of an event.
Measurement Bias
an observer who is unaware of the study purpose and/or the experimental conditions in effect during a given phase or observation period. Data obtained by a naive observer are less likely to be influenced by observers expectations.
Naive observer
a measure produced by an observation and measurement system. Observed values serve as data that the researcher and others will interpret to form conclusions about an investigation.
Observed value
any unintended change in the way an observer uses a measurement system over the course of an investigation that results in measurement error; often entails a shift in the observers interpretation of the original definitions of the target behavior subsequent to being trained.
observer drift
influence on the data reported by an observer that results from the observers awareness that others are evaluating the data.
observer reactivity
refers to the consistency of measurement, specifically, the extent to which repeated measurement of the same event yields the same values.
reliability
an inter observer agreement index based only on the intervals in which either observer recorded the occurrence of the behavior; calculated by dividing the number of intervals in which the two observers agreed that the behavior occurred by the number of intervals in which either or both observers recorded the occurrence of the behavior and multiplying it by 100. Scored-interval IOA is recommended as a measurement of agreement for behaviors that occur at low rates because it ignores the intervals in which agreement by chance is highly likely.
Scored-interval IOA
the simplest indicator of IOA for event recording data; based on comparing the total count recorded by each observer per measurement period; calculated by dividing the smaller of the two observer’s counts by the larger count and multiplying it by 100.
total count IOA
a relevant index of IOA for total duration measurement; computed by dividing the shorter of the two durations reported by the observers by the longer duration and multiplying it by 100.
total duration IOA
an IOA index for discrete trial data based on comparing the observers counts (0 or 1) on a trial by trial, or item by item. basis; yields a more conservative and meaningful index of IOA fo discrete trial data than does total count IOA.
trial by trial IOA
a measure accepted as a quantitative description of the true state of some dimensional quantity of an event as it exists in nature. Obtaining true values requires “special or extraordinary precautions to ensure that all possible sources of error have been avoided or removed.”
true value
an inter observer agreement index based only on the intervals in which either observer recorded the nonoccurence of the behavior; calculated by dividing the number of intervals in which the two observers agreed that the behavior did not occur by the number of intervals in which either of both observers recorded the nonoccurrence of the behavior and multiplying by 100. Unscored interval IOA is recommended as a measure of agreement for behaviors that occur at high rates because it ignores the intervals in which agreement by chance is highly likely.
unscored-interval IOA
the extent to which data obtained from measurement are directly relevant to the target behavior of interest and to the reason(s) for measuring it.
Validity
