Interobserver Agreement (IOA) Flashcards

1
Q

Which is the correct interval-by-interval calculation of interobserver agreement?

A. 90%

B. 78%

C. 86%

D. 75%

A

A

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Which is the correct interval-by-interval calculation of interobserver agreement?

A. 40%

B. 71%

C. 60%

D. 80%

A

D

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Which is the correct nonoccurrence (unscored interval) calculation of interobserver agreement?

A. 80%

B. 78%

C. 75%

D. 86%

A

C

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Which is the correct occurrence (scored interval) calculation of interobserver aqgreement?

A. 78%

B. 90%

C. 75%

D. 86%

A

D

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Which is the correct occurrence calculation of interobserver agreement?

A. 80%

B. 60%

C. 71%

D. 40%

A

C

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Which is the correct nonoccurrence calculation of interobserver agreement?

A. 33%

B. 40%

C. 14%

D. 10%

A

C

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Which is the correct interval-by-interval calculation of interobserver agreement?

A. 40%

B. 33%

C. 30%

D. 14%

A

A

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Which is the correct nonoccurrence calculation of interobserver agreement?

A. 71%

B. 40%

C. 60%

D. 80%

A

C

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Which is the correct occurrence calculation of interobserver agreement?

A. 10%

B. 33%

C. 44%

D. 14%

A

B

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Minimally, interobserver agreement data should be collected…

A. In 20% to 30% of the sessions and at least once per condition

B. 80% to 90% of the sessions and at least once per condition

C. In 75% to 80% of the sessions and at least once per condition

D. At least once per condition

A

A

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Overall agreement of occurrences should be reported when…

A. Partial interval recording is used, but not when whole interval recording is used

B. Most of the intervals indicate no response

C. Whole interval recording is used, but not when partial interval recording is used

D. Most of the intervals indicate a response

A

B

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Interobserver agreement…

A. Enhances believability of data

B. Provides information on the reliability of data

C. Provides information on the accuracy of data

D. All of the above

A

A

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

In addition to reporting interval by interval agreement, also report overall agreement of occurrences when the number of intervals in which the behavior occurs is…

A. Occurring throughout the interval

B. Very high or very low

C. Very high

D. Very low

A

D

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

An acceptable criterion for interobserver agreement data…

A. Should be higher than 80% when there is a large degree of behavior change across conditions

B. Should be higher than 80% when there is a small degree of behavior change across conditions

A

B

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Interobserver agreement may be influenced by…

A. The number of individuals upon whom data are being collected

B. The complexity of the recording procedure

C. The number of behaviors upon which data are being collected

D. All of the above

A

D

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

A mean count per interval calculation of interobserver agreement is percent agreement for each interval…

A. Divided by the number of observers

B. Added across all intervals

C. Averaged across all intervals

D. Averaged across observers

A

C

A frequency-within-interval calculation increases the probability that agreements are based on both recorders observing the same behaviors. The calculation is percent agreement for each interval averaged across all intervals. For example, in the first interval, observer one records two occurrences and observer two Records for occurrences (50%). In the second interval, observer one records one occurrence and observer two record three occurrences (33%). The sum of 50%, 33%, etc., would be divided by the total number of intervals.

17
Q

Interobserver agreement may be influenced by…

A. The number of individuals upon whom data are being collected

B. The complexity of the disorder

C. The social impact of a person’s disability

D. All of the above

A

A

18
Q

Which reflects the logic behind the need to report occurrence/non-occurrence agreement data. “Their interval by interval agreement is high, but…

A. Their occurrence/non-occurrence agreement is high as well”

B. their overall agreement is even higher“

C. Because the behavior is so frequent, they appear to be recording occurrences when there were none“

D. Because the behavior occurs so rarely, I think they may be comparing data sheets or prompting each other when the behavior occurs“

A

C

19
Q

An acceptable criterion for inter observer agreement data…

A. Can be lower than 80% when there is a large degree of variability across conditions

B. Can be lower than 80% when there is a small degree of behavior change across conditions

C. Should be higher than 80% when there is a large degree of behavior change across conditions

D. Should be higher than 80% when there is a small degree of behavior change across conditions

A

D

20
Q

Computation of data…

A. Should be the exclusive responsibility of data collectors

B. Is not needed in single subject research

C. By data collectors should be supplemented with computation by others

D. By data collectors is advised due to their familiarity with the data

A

C

21
Q

Which reflects the logic behind the need to report nonoccurrance agreement data. “interval by interval agreement is high, but…

A. We know that already. I want to know when it is low“

B. Overall agreement is high too. This is unlikely if the data are accurate“

C. Because the behavior is so rare, I think observers just don’t care“

D. Because the behavior is so frequent, I think observers just score each interval“

A

D

22
Q

To calculate inter-observer agreement on frequency measures….

A. Divide the frequency of one observer by the sum of the frequency of both observers

B. Divide the number recorded by the observer who recorded the fewest by the number recorded by the other observer who recorded the most

C. Divide the number of intervals in which both observers recorded an occurrence by the total number of intervals in which both observers recorded a non-occurrence

D. Divide the number recorded by the observer who recorded the most by the number recorded by the other observer who recorded the fewest

A

B

23
Q

Observer A: freq. 6

Observer B: freq. 9

What is the inter observer agreement?

A. 80%

B. 67%

C. 1.5%

D. 15%

A

B

24
Q

To calculate non-occurrence interobserver agreement, divide the…

A. Number of intervals in which both observers recorded no occurrence by the number of intervals in which at least one observer recorded no occurrence

B. Frequency of occurrences recorded by one observer by the frequency of occurrences recorded by the other observer

C. Number of intervals in which both observers recorded an occurrence by the number of intervals in which at least one observer recorded an occurrence

D. Number of intervals in which both observers recorded an occurrence by the total number of intervals

A

A

25
Q

To calculate interval by interval inter-observer agreement divide the…

A. Number of intervals in which both observers agreed by the total number of intervals

B. Number of intervals in which both observers recorded an occurrence by the number of intervals in which at least one observer recorded an occurrence

C. Number of intervals in which both observers recorded no occurrence by the number of intervals in which at least one observer recorded no occurrence

D. Frequency of occurrences recorded by one observer by the frequency of occurrences recorded by the other observer

A

A

26
Q

To calculate inter-observer agreement on duration measures, divide the…

A. Number of intervals in which both observers recorded an occurrence by the total number of intervals

B. Time recorded by the observer who recorded the longest duration by the time recorded by the observer who recorded the shortest duration

C. Time recorded by the observer who recorded the shortest duration by the time recorded by the observer who recorded the longest duration

D. Duration of one observer by the sum of the duration of both observers

A

C