Chapter 4 - Reliability and Validity Flashcards

1
Q

When the doctor weighs Morgan as a measure of eating behavior, he uses what method of observation? __________

A

recording outcome

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

If two observers agree on their observations, you cannot conclude that their observations were reliable unless they were made on the same __________.

A

response

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Most of us tend to look for the causes of behavior in people’s thoughts. The problem with such private events is that we must still __________ them.

A

explain

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Dom observed the stories on the evening news one day. He found that 9 of the news items were biased. Jan also watched the evening news on the same day and found that 10 were biased. She decided Dom’s observations were reliable. Do you agree with her conclusion? __________ (Yes, No)

A

yes

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Marge defined good teaching behavior as having personal contact with students. She observed that Tom had few personal contacts with his students. She suggested that he start having more personal contacts with his pupils. She again observed and found that he had many personal contacts with them. Marge then had 10 parents view a videotape of Tom’s teaching. They rated Tom’s quality of teaching as low when they observed few personal contacts and high when he had many personal contacts. In other words, the parents’ ratings correlated with Marge’s observations based on her behavioral definition. This correlation showed that Marge’s behavioral definition of good teaching had __________.

A

social validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Barb inspected the cleaning jobs according to a 10-item checklist at 8:00 Thursday night. She found that 9 items had been done. Vince inspected the same cleaning jobs according to the same checklist at 8:00 Friday night and found only 3 of them done. Is this evidence that their observations are unreliable? __________ (Yes, No)

A

no

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Williams and colleagues developed a new behavioral definition of non-cooperation. Two of their observers agreed 83% during simultaneous observations. Is this level acceptable? __________ (Yes, No)

A

yes

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

The general formula for calculating reliability is __________.

A

100xA/(A+D)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Suppose you define pain behavior as holding the pained area, moaning, and complaining of pain. Suppose observers using this behavioral definition find Mark not engaging in those behaviors during videotape A. Suppose they find him engaging in those behaviors in videotape B. How would you use five nurses to test the social validity of your behavioral definition? *short answer

A

Ask the nurses to serve as an outside judge and rate the amount of Mark’s pain for each videotape. If the nurses rate pain as low for tape A and high for tape B, (in other words they correlate with the observer’s observations) then the behavioral definition

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Dan counted the number of consecutive 15-second intervals during which his baby sister was smiling. He was using __________ recording.

A

interval

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Reliability is a measure of the extent to which there is __________ between two independent variables.

A

agreement

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Tamara observed that Boris watched the news during 59 out of 60 half-minute intervals on Monday. Ann observed that Boris only watched the news during 23 out of the 60 half-minute intervals on Tuesday. Can you conclude that Tamara and Ann’s observations are unreliable? __________ (Yes, No)

A

no

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Kim and Jose counted shootings stars one might. Kim saw 17, and Jose saw 20. Compute their reliability: [a] %; is it acceptable? [b] (Yes, No)

A

85%; yes

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Suppose you observe three of Willie’s behaviors that you think are related to how good he is at having a conversation. Suppose you also have three adults watching the same conversations rate how good he was in the conversation. The correlation between your observations and their ratings gives you a measure of the __________ of your behavioral definition.

A

social validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Eileen checked to see whether her lazy roommate was studying during a short observation made at 19 random times during the day. What method of observation was she using? __________ recording

A

time-sample

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Behavior analysts consider everything that a person does to be __________.

A

behavior

17
Q

Explain in words the formula to compute the reliability of two observers using interval recording

A

Divide the number of agreements by agreements plus disagreements and multiply by 100

18
Q

When we ask people what TV programs they watch, they name educational programs more often than they actually watch them. This is an example of the problem with what approach to observing behavior? __________

A

self-reports

19
Q

Kim wanted to observe how well the typist for large companies typed. She counted the number of errors appearing on a letter from Exxon. She found 6. She is using what method to observe that typist’s typing? __________ recording

A

outcome

20
Q

Reliability can be measured only when two people observe using the same behavioral definition to observe the same __________.

A

response

21
Q

Joan counted the number of times Professor Brainbuster said “uh” during Monday’s lecture and found that he said it 50 times. If Nel counts 50 “uh’s” during Wednesday’s lecture, can we conclude that their observations are reliable? __________ (Yes, No)

A

no

22
Q

Larry observed how often Professor Green encouraged students to make comments in his discussion class. Larry decided to record agreements with the comment by the professor. he also recorded praise of the comment. Larry’s decision about what to record would be called a(n) __________

A

behavioral definition

23
Q

With a new behavioral definition, researchers will accept a reliability figure of __________%.

A

80

24
Q

Quinn et al. (1992) showed that adults rated accepting criticism as high when roommates kept calm and repeated the criticism and low when they did not. The researchers showed that using those behaviors to define “accepting criticism” has __________.

A

social validity

25
Q

Suppose that one observer using event recording counts 25 responses, and a second observer counts 20. What observations do you assume they agree on and what observations do you assume they disagree on? Compute the reliability for this case.

A

80%