Chapter 5

Question 1

the extent to which observed values, the data produced by measuring an event, match the true state, or true values, of the event as it exists in nature.

Answer 1

Accuracy

Question 2

the extent to which the researcher convinces herself and others that the data are trustworthy and deserve interpretation. Measures of inter observer agreement (IOA) are most often used index of believability in applied behavioral analysis.

Answer 2

Believability

Question 3

the process of comparing the data produced by a measurement system to know standard or true value and, when sourced of error are found, using that information to correct or improve the measurement system.

Answer 3

Calibration

Question 4

measurement conducted in a manner such that all instances or the response class(es) of interest are detected during the observation period.

Answer 4

Continuous Measurement

Question 5

the percentage of total intervals in which two observers recorded the same count; the most stringent description of IOA for most data sets obtained by event recording.

Answer 5

Exact Count-per-interval IOA

Question 6

occurs when the behavior that is measured is in some way different from the behavior of interest; considered less valid than direct measurement because inferences about the relation between the data obtained and the actual behavior of interest are required.

Answer 6

Indirect measurement

Question 7

the degree to which two or more independent observers report the same observed values after measuring the same events

Answer 7

Interobservation Agreement (IOA)

Question 8

an index of the agreement between observers for data obtained by interval recording or time sampling measurement; calculated for a given session or measurement period by comparing the two observers’ recordings of the occurrence or nonoccurence of the behavior in each observation interval and dividing the number of intervals of agreement by the total number of intervals and multiplying by 100.

Answer 8

Interval-by-interval IOA

Question 9

the average percentage of agreement between the counts reported by two observers in a measurement period composed of a series of smaller counting times; a more conservative measure of IOA than total count IOA.

Answer 9

Mean count per interval IOA

Question 10

an IOA index fo duration per occurrence data; also a more conservative and usually more meaningful assessment of IOA for total duration data calculated for a given session of measurement period by computing the average percentage of agreement of the duration reported by two observers for each occurrence of the target behavior.

Answer 10

Mean duration-per- occurrence IOA

Question 11

nonrandom measurement error; a form of inaccurate measurement in which the data consistently overestimate or underestimate the true value of an event.

Answer 11

Measurement Bias

Question 12

an observer who is unaware of the study purpose and/or the experimental conditions in effect during a given phase or observation period. Data obtained by a naive observer are less likely to be influenced by observers expectations.

Answer 12

Naive observer

Question 13

a measure produced by an observation and measurement system. Observed values serve as data that the researcher and others will interpret to form conclusions about an investigation.

Answer 13

Observed value

Question 14

any unintended change in the way an observer uses a measurement system over the course of an investigation that results in measurement error; often entails a shift in the observers interpretation of the original definitions of the target behavior subsequent to being trained.

Answer 14

observer drift

Question 15

influence on the data reported by an observer that results from the observers awareness that others are evaluating the data.

Answer 15

observer reactivity

Question 16

refers to the consistency of measurement, specifically, the extent to which repeated measurement of the same event yields the same values.

Answer 16

reliability

Question 17

an inter observer agreement index based only on the intervals in which either observer recorded the occurrence of the behavior; calculated by dividing the number of intervals in which the two observers agreed that the behavior occurred by the number of intervals in which either or both observers recorded the occurrence of the behavior and multiplying it by 100. Scored-interval IOA is recommended as a measurement of agreement for behaviors that occur at low rates because it ignores the intervals in which agreement by chance is highly likely.

Answer 17

Scored-interval IOA

Question 18

the simplest indicator of IOA for event recording data; based on comparing the total count recorded by each observer per measurement period; calculated by dividing the smaller of the two observer’s counts by the larger count and multiplying it by 100.

Answer 18

total count IOA

Question 19

a relevant index of IOA for total duration measurement; computed by dividing the shorter of the two durations reported by the observers by the longer duration and multiplying it by 100.

Answer 19

total duration IOA

Question 20

an IOA index for discrete trial data based on comparing the observers counts (0 or 1) on a trial by trial, or item by item. basis; yields a more conservative and meaningful index of IOA fo discrete trial data than does total count IOA.

Answer 20

trial by trial IOA

Question 21

a measure accepted as a quantitative description of the true state of some dimensional quantity of an event as it exists in nature. Obtaining true values requires “special or extraordinary precautions to ensure that all possible sources of error have been avoided or removed.”

Answer 21

true value

Question 22

an inter observer agreement index based only on the intervals in which either observer recorded the nonoccurence of the behavior; calculated by dividing the number of intervals in which the two observers agreed that the behavior did not occur by the number of intervals in which either of both observers recorded the nonoccurrence of the behavior and multiplying by 100. Unscored interval IOA is recommended as a measure of agreement for behaviors that occur at high rates because it ignores the intervals in which agreement by chance is highly likely.

Answer 22

unscored-interval IOA

Question 23

the extent to which data obtained from measurement are directly relevant to the target behavior of interest and to the reason(s) for measuring it.

Answer 23

Validity