reliability Flashcards
what is reliability
the consistency of the research, whether u would obtain the same results again
how can reliability be assessed?
test-retest
pilot study
what does test retest entail
repeat (method of investigation) a second time
- use same participants
- compare results (record data e.g video it/record)
if correlation co efficient is 0.8 or more then data is reliable
how can a pilot study be used
increase precision when measuring behaviour
Includes standardised instructions, debriefing and planning procedures properly. This will minimise human error and variation,
All key concepts must be operationalised so researcher knows what they are defining, measuring and observing
Make sure all obersevres properly trained
how can reliability be tested in observations
test retest
pilot study
how can u improve reliability in observtions
inter observer reliability
- use more than 1 observer to record the behaviour separately, compare results. is pos correlation of more than 0.8 then it is reliable
if low then
- ensure variables operationalised properly so each observer understands the categories properly
- give observers more training
how can u assess reliability in self report methods (interviews/questionaires)
test retest
how to improve reliability in self report techniques
ensure qs are not ambiguous - need to be able to answer the question the same way in the future if asked again, if ambiguous would need to be reworded or removed
inter researcher reliability -
Ensures self report is not biased - use more than 1 researcher (needs to act similar consistent ways and use exact same procedure) and then compare and if greater than 0.8 (spearmans rho) then it is reliable
what is intra observer reliabillty
when observation is recorded twice by the same researcher and data is compared to check correlation and consistency of research
what is used to assess reliability in experiments
test retest
how can reliability be improved in experiments
standardise instructions
- procedures should be the exact same for each participant
- and key concepts and variables should be operationalised
what is internal reliability
the extent to which a measure is consistent within itself
what is external reliability
extent to which a measure varies from one use to another
what is an example of testing internal reliability
split half method
what are examples of testing external reliability
test retest
inter rater
inter observer
