Chapter 5- Improving and Assessing the Quality of Behavioral Measurement

Question 1

Validity

Answer 1

Data is directly relevant to the phenomenon measured and to the reason(s) for measuring it.

Question 2

Accuracy

Answer 2

Extent to which the observed values matches the true value of the event.

Question 3

Measurement bias

Answer 3

Nonrandom measurement error, likely to be in one direction.

Question 4

Reliability

Answer 4

The consistency of measurement, specifically, the extent to which repeated measurement of the same event yields the same value.

Question 5

Indirect measurement

Answer 5

Occurs when the observer measures a proxy, or stand-in, for the actual behavior of interest. Secondhand information that requires the observer to make inferences.

Question 6

Direct measurement

Answer 6

Occurs when the behavior measured is exactly the same as the behavior that is the focus of the behavior change program.

Question 7

Continuous measurement

Answer 7

Measurement that detects all instances of the target behavior during the observation period.

Question 8

Discontinuous measurement

Answer 8

Any form of measurement in which some instances of the response class of interest may not be detected.

Question 9

Observer drift

Answer 9

The unintended changes in the way data are collected may produce measurement error.

Question 10

Naive observer

Answer 10

A trained observer who is unaware of the study’s purpose of experimental effect during a given observation period.

Question 11

Calibration

Answer 11

Comparing the data produced by a measurement system to a known standard of true value and, if necessary, adjusting the measurement system so the data it produces match the known standard.

Question 12

Total cont IOA

Answer 12

A percentage of agreement between the total number of responses recorded by two observers.
(smaller count/ larger count) x100

Question 13

Mean count-per-interval IOA

Answer 13

(int 1 IOA + int 2 IOA + int N IOA/ n intervals)

Question 14

Exact count-per-interval IOA

Answer 14

(number of intervals of 100% IOA/ n intervals) x100

Question 15

Trial-by-trial IOA

Answer 15

(number of trials agreement/ total number of trials) x100

Question 16

Total duration IOA

Answer 16

(shorter duration/ longer duration) x100

Question 17

Mean duration-per-occurrence IOA

Answer 17

(dur IOA R1 + dur IOA R2 + dur IOA Rn/ n responses with dur IOA) x100

Question 18

Interval-by-interval IOA

Answer 18

(number of intervals agreed/ total number of intervals) x100

Question 19

Scored-interval IOA

Answer 19

Only the intervals in which either or both observers recorded the occurrence of the target behavior
(agreed occurrence/ total trials with occurrences) x100

Question 20

Unscored-interval IOA

Answer 20

Only the intervals in which either or both observer recorded the nonoccurrence of the target behavior
(agreed nonoccurrence/total trials with nonoccurrences) x100