Threats to Valid Measurement

Question 1

What are the threats to valid measurement?

Answer 1

The validity of behavioral data is threatened when measurement
is indirect, when the wrong dimension of the target behavior is
measured, or when measurement is conducted in such a way that the data it produces are an artifact of the actual events.

Question 2

What is indirect measurement?

Answer 2

Indirect measurement occurs when the researcher or practitioner measures a proxy, or stand-in, for the actual behavior of
interest

Question 3

What is an example of indirect measurement?

Answer 3

Using a student’s score on a standardized math achievement
test as an indicator of mastery.

Question 4

What is direct measurement?

Answer 4

when the behavior measured is exactly the same as the behavior that is the focus of the
investigation or behavior change program.

Question 5

What is an example of driect measurement?

Answer 5

a student’s score on a properly constructed
test consisting of math problems from recently covered curriculum content.

Question 6

Why does indirect measurement rarely occur in ABA?

Answer 6

Meeting the applied dimension of ABA
includes the targeting and meaningful (i.e., valid) measurement
of socially significant behavior.

Question 7

When would an indirect measure be appropriate?

Answer 7

the researcher or practitioner has no direct and reliable access to the behavior of interest, to make inferences about private events or affective states

Question 8

What must the researcher do when using indirect measurement?

Answer 8

The researcher must provide a convincing case for the validity of the data.

Question 9

What is compromised when measurement produces values for a dimension of behavior ill suited for measuring the behavior?

Answer 9

validity

Question 10

What are some common causes of measurement artifacts?

Answer 10

Discontinuous measurement, poorly scheduled measurement periods, and using insensitive or limiting measurement scales.

Question 11

What is continuous measurement?

Answer 11

Measurement that detects all instances of the target behavior during the observation period.

Question 12

What has produced an increasing trend of continuous measurement in behavioral research?

Answer 12

Development of automated data collection technologies

Question 13

What is discontinuous measurement?

Answer 13

Discontinuous measurement is any form of measurement in which some instances of the response class( es) of interest may not be detected

Question 14

What problem does discontinuous measurement present?

Answer 14

A data set produced by discontinuous
measurement may be
an artifact of the measurement system rather than accurate portrayal of behavioral events.

Question 15

When might we use discontinuous measurement?

Answer 15

Continuous measurement is prohibited in the absence of automatic measurement technology

Question 16

What other factors besides absence of automatic measurement technology may prohibit continuous measurement?

Answer 16

The nature of the target behavior being measured; the number
of participants or clients whose behavior must be measured; the number, duration, and scheduling of observation periods; and the availability of trained personnel to observe and collect the data.

Question 17

What are the three primary methods of discontinuous measurement? (Chapter 4)

Answer 17

Partial-interval, whole-interval, momentary time sampling

Question 18

What study shows the artifactual variance of discontinuous vs. continuous measurement?

Answer 18

Thomson, Holmber, and Baer (1974) contiguous, alternating and sequential.

Question 19

What was meant by contiguous, alternating and sequential in Thomson, Holmber, Baer (1974)?

Answer 19

contiguous: subject 1, 2, 3, 4 (16 minutes each)
alternating: subject 1 , subject 2, subject 1, subject 2 (4 minutes each)
sequential: subject 1, 2, 3, 4 (4 minutes each)

Question 20

How did Thomson, Holmber, and Baer (1974) compare discontinuous vs. continuous measurement?

Answer 20

Recorded 3 discontinuous measurement types to a single continuous measurement called “actual rates”

Question 21

How do you minimize the threat to validity from discontinuous measurement?

Answer 21

Frequent measurement, as a general rule… daily or frequent basis, valid sampling procedure

Question 22

Which intervals are more preferable to limit the threat of validity to discontinuous measdurement?

Answer 22

Numerous brief intervals over longer, less frequent

Question 22

When is a sampling procedure sufficient for decision making and analysis?

Answer 22

the samples represent a valid approximation of the true parameters of the behavior of interest

Question 23

What two boxes should the measurement period check to prevent poorly scheduled measurement periods?

Answer 23

1. Equal opportunity for occurrence/nonoccurrence of behavior
2. Consistent environmental conditions

Question 24

What observation times should be selected to assess the effects of an intervention?

Answer 24

the most conservative times, or when their rate of occurrence is most likely to differ from the predicted outcome

Question 25

When should you measure behavior targeted for reduction?

Answer 25

At times when those behaviors are most likely to occur at their highest response rates.

Question 26

When should you measure behavior targeted for increase?

Answer 26

At times when high-rate responding is least likely.

Question 27

What problems with measurement scales pose threat to validity?

Answer 27

Insensitive (over or under sensitive), limited (does not detect full range of relevant performances)