Accurracy/Reliability and Reactivity/Expectancy Flashcards

know the difference between accuracy, reliability and validity as well as reactivity, expectancy, observer drift and complexity

1
Q

“His first test score was good. However, when retested, he got a lower score, thus calling into question the test’s…
A. reliability”
B. accurracy”
C. validity”

A

A
ACCURACY: the extent to which a measure reflects or closely approximates the true value
RELIABILITY: repeated measurement of the same event yields the same result
VALIDITY: a measure measures what it purports to measure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

A reasearcher tries to collect data from a vantage point where the students will not know he’s there due to the influence of…
A. reactivity
B. observer drift
C. expectancy

A

A

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

A reasearcher avoids having a particular therapist who had bad experiences with a student collect daa to avoid the influence of…
A. expectancy
B. reactivity
C. observer drift

A

A
REACTIVITY: the presence of an observer influences behavior
OBSERVER DRIFT: over time observers modify operational definitions
EXPECTANCY: bias due to preconceived notions and information given

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

The practitioner compared one observer’s measures of spelling during an observation session to a different observer’s measures ofthe same session and there was a perfect agreement. This demonstrates…
A. IOA
B. believability
C. reliability

A

A

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

The practitioner compared one observer’s measures of SIB during an observation session to a different observer’s measures of the same session. This is aprocedure for assessing…
A. IOA
B. believability of the data
C. reliability of the data collection procedure

A

A

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

When repeated measures consistently yield the same result for the same event, we say the measure demonstrate…
A. accuracy
B. reliability
C. validity

A

B
ACCURACY: the extent to which a measure reflects or closely approximates the true value
RELIABILITY: repeated measurement of the same event yields the same result
VALIDITY: a measure measures what it purports to measure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Using one-hour partial interval recording to measure high rate out-of-seat behavior is likely to result in a problem with the data’s…
A. accuracy
B. validity
C. reliability

A

A

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

IOA can be influenced by…
A. interactivity
B. expectancy
C. all of the above

A

B

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Accurate data…
A. are valid
B. reflect or closely approximate true values
C. all of the above

A

B

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Data are more believable when…
A. they are obtained by reliable measures
B. IOA is high
C. all of the above

A

C

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

A practictioner compared a newly trained observer’s measures of math fact performance to a report generated by a math facts computer program. This is a procedure for assessing…
A. accuracy of data
C. validity of data
C. reliability of data

A

A
ACCURACY: the extent to which a measure reflects or closely approximates the true value
RELIABILITY: repeated measurement of the same event yields the same result
VALIDITY: a measure measures what it purports to measure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

“The test scores are always good. However, due to the possibility of someone else taking the test and putting their name on it, we question the test’s…
A. validity”
B. accuracy”
C. reliability”

A

A
ACCURACY: the extent to which a measure reflects or closely approximates the true value
RELIABILITY: repeated measurement of the same event yields the same result
VALIDITY: a measure measures what it purports to measure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

The only way to know if data are accurate is to…
A. compare the results to other observers
B. make sure they are directly relevant to the phenomena measured
C. compare them to true values

A

C

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

The practitioner compared one observer’s measure of SIB during a video taped observation session to that same observer’s earlier measure of the same video taped session. This is aprocedure for assessing…
A. IOA
B. accuracy of the data
C. reliability of the data collection procedure

A

C

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Data are more believable when…
A. they are collaboratively collected by multiple observers
B. they are obtained by reliable measures
C. all of the above

A

B

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Accurate data…
A. can only be obtained using a reliable measurement system
B. reflect or closely approximate the true values of the observed event
C. all of the above

A

C

17
Q

Data are more believable when…
A. there is little variability when they are graphed
B. they are accurate
C. all of the above

A

B