Research Methods: Reliability and Validity Flashcards
What is meant by the term validity?
It refers to whether …
the consistency of a study or a measuring device within a study
a study produces similar results if replicated
Name the 2 ways of assessing reliability
test-retest
inter-rater
Describe how test-retest is used to assess reliability
3 points
-the same study/analysis is carried out by same researcher twice times under the same conditions at different times
-results of the 2 analyses are compared and a correlation coefficient is calculated
-a correlation coefficient of + 0.80 indicates high reliabiltiy
Describe how inter-rater is used to assess reliability
-more than one researcher independently carries out the observation/analysis
-follow the same procedure regarding comparison and calculation of correlation coefficient
Give 3 ways the reliability of an experiment can be improved
-conduct lab experiments that follow standardised procedures
-operationalise variables
-use a pilot study to help identify any problems beforehand
Give 2 points about how the reliability of a questionaire can be improved
-use more closed questions
-deselect or rewrite questions is they are too complex or ambiguous
Give 3 ways the reliability of an interview can be improved
-use the same interviewer each time
-train interviewers to ensure they ask questions in the same way
-used structured interviews/scripted
Give 3 ways in which the reliability of an observation can be improved
-operationalise behavioural categories and discuss with other researchers so all are clear on how to interpret behaviour
-record data so it can be reviewed
-train observers
Validity concerns whether …
a test/measure/findings actually measure what they were intended to / claimed to measure
What is meant by internal validity
concerns the ability of a study to test the hypothesis it was designed to test
What is meant by external validity
concerns whether the findings of the study can be generalised beyond the study itself
What are the 3 main types of external validity ?
ecological validity
temporal validity
population validity
What is ecological validity?
the degree to which findings of a study can be generalised to other situations or are reflective of how a behaviour would occur under normal circumstances
What is temporal validity?
where research findings that took place at a certain time accurately reflect the way behaviour would occur at a different point in time
What is population validity?
where research findings can be generalised from the sample to other populations
