Measurement that is...

Question 1

Valid, Accurate, and Reliable yields data that are…

Answer 1

…most useful for advancing scientific knowledge and guiding data-based practices.

Question 2

Accurate and Reliable yields data that are……

Answer 2

…meaningless for the purpose for which measurement was conducted.

Question 3

Valid and Reliable yields data that are…

Answer 3

…always wrong. Save data by adjusting for consistent measurement.

Question 4

Valid and Accurate yields data that are…

Answer 4

…sometimes wrong. Can not separate good data from bad.

Question 5

Validity (of measurement)

Answer 5

The extent to which data obtained from measurement are directly relevant to the target Bx of interest and to the reason(s) for measuring it. #RelevantDimension

Question 6

Reliability (of measurement)

Answer 6

Refers to the consistency of measurement, specifically, the extent to which repeated measurement of the same event yields the same values. #SameResultsRepeatedly #IOA

Question 7

Accuracy (of measurement)

Answer 7

The extend to which obsreved values, the data produced by mesuring an event, match the true state, or true values, of the event as it exists in nature. #TrueValues #Calibration

Question 8

Threats to Validity

Answer 8

1. Indirect measurement
2. Measuring the wrong dimension
3. Measurement Artificats #DiscontinuosMeasures #PoorlyScheduledMeasurementPeriods #Insensitive/limited

Question 9

Threats to Accuracy

Answer 9

Human Error #PoorlyDesignedMeasurementSystems #InadequateObserverTraining #ObserverBias #Obseverdrift #MeasurementBias #ObserverReactivity

Question 10

Threats to Reliability

Answer 10

Human Error #PoorlyDesignedMeasurementSystems #InadequateObserverTraining #ObserverBias #Obseverdrift #Measurement Bias #ObserverReactivity

Question 11

3 Required Validity elements

Answer 11

1. Measuring directly a socially significant target Bx
2. Measuring a dimension (rate, duration) of the target B relevant to the question or concern about the Bx
3. Ensuring that the data are representatie of the Bx’s occurrence under conditions and during time sthat are most relevant to the quesiton or concern about the Bx.

Question 12

If the measurement is not valid the accuracy is…

Answer 12

moot.

Question 13

Accuracy trumps

Answer 13

reliability.

Question 14

Treatment Drift

Answer 14

Occurs when the applicaiton of the IV differs from the way it was applied at the stuy’s outset,

Question 15

Observer Reactivity

Answer 15

Influences the data reprted by an observer that results from the observer’s awerness that others are evaluating the data

Question 16

Measurement Bias

Answer 16

Nonrandom measurement error; a form of inaccurate measurement in which the data consistenly overestimates or underestimates the true value of an event.

Question 17

Indirect Measurement

Answer 17

Occurs when the Bx that is measured is in some way different from the Bx of interest; considered less valid than direct measurement beacuse inferences about the relation between the data obtained and the actual Bx of interest are required.

Question 18

Prevent Observer Drift by

Answer 18

by retraining observers

Question 19

Prevent Observer Bias

Answer 19

with Naive observers

Question 20

Prevent Reactivity

Answer 20

with unobtrusive recording