Lesson 4 Flashcards
Reliability and Validity of Everyday Observations
What is the third tactic in an observational study?
Reliability and social validity of the observation.
What is the most basic question about an observation study?
If you could repeat it.
How does one measure accuracy indirectly?
By two independent observers using the same behavioral deffinition.
What is the agreement of a behavioral Deffinition called?
Reliability
Reliability:
The agreement between two independent observers
What are the two requirements for measuring reliability ?
1) The same behavioral deffinition
2) Both observers must observe the same response.
What two forms do reliability come in?
Trail Reliability and Frequency reliability
Trail Reliability:
Compares each observation of the two observers
How does the term Trail Reliability come about?
Because we get every chance to observe the behavior
How do you compute trial reliability?
Agreements/Agreements+Disagreements x 100 (The sum of agreements plus disagreements equal totally number of trials.
Can you use trial reliability with outcome or event recording?
No, these methods lead to a total count, but they don’t produce a trail-by-trail record. Can be used in complex outcome with a checklist.
Can you use trail reliability with time sample or interval recording?
Yes, by with a signal that both observers can here.
Why doesn’t trial reliability work with outcome and event recording?
Because we have no way in telling if the subject did or didn’t do the task/behavior. It could have been someone else.
Frequency reliability:
The total count between two observers
What percentage do most researcher aim for reliability?
90%
