C08 Evaluate the Validity and Reliability Part 3 Flashcards
A researcher avoids collecting data on more than two students at a time due to influence of
Complexity
Accurate data
All the above:
May be recorded by one observer even if interobserver agreement is low.
Reflect or closely approximate the true values of the observed event.
Can only be obtained using a reliable measurement system.
Accurate data
Reflect or closely approximate true values.
The practitioner compared one observer’s measures of spelling during an observation session to a different observer’s measures of the same session and there was perfect agreement. This demonstrates
IOA
Data are more believable when
They are obtained by reliable measures.
They are accurate.
IOA is high.
The extent to which others are convinced that measures are accurate is called
Believability
A practitioner compared a newly trained observer’s measures of math fact performance to a report generated by a math facts computer program. This is a procedure for assessing
Accuracy of the data
IOA of two observers improves over time because they have come to an unspoken agreement of what topographies get scored, which differs from the operational definition. This influence is called
Observer drift
IOA can be influenced by
Reactivity
Expectancy
Complexity of the data collection system.
Subtle changes in the definition of the target behavior.
Staff complaints about the person being observed.
Observers modifying operational definitions over time.
“We always get the same frequency when we both observe, indicating high
IOA”
When repeated measures consistently yield the same result for the same event, we say the measure demonstrates
Reliability
A practitioner compared one observer’s measure of SIB during a video taped observation session to that same observer’s earlier measure of the same video taped session. This is a procedure for assessing
Reliability of the data collection procedure
Everyone was convinced that the measures of SIB were accurate because there was 100% IOA. These data are
Believable
A researcher avoids having a particular therapist who had bad experiences with a student collect data to avoid the influence of
Expectancy
Using one-hour partial interval recording to measure high rate out of seat behavior is likely to result in a problem with the data’s
Accuracy