reliability Flashcards
1
Q
what is reliability?
A
extent to which test produces consistent results
2
Q
internal reliability
A
test is consistent in itself
eg whether different questions in questionnaire are all measuring same thing
3
Q
external validity
A
consistent over time
eg if repeat IQ test, expect same results on different day
4
Q
how do you assess reliability?
A
- test- retest
- inter- observer
5
Q
what is/how do test- retest?
A
- repeat same test/questionnaire on same person on 2 different occasions
test reliable= results are same - check whether significant positive correlation between the two
- cant be too quick so rememeber answers
- cant be too long that answers have changed
6
Q
what is inter-observer/inter-rater reliability?
A
researchers observe same behaviour independently (avoid bias) and compare data
data similar= reliable
7
Q
how to carry out inter-observer reliability?
A
- pilot study-> check observers applying same behavioural categories
- observers watch same event but record data indepently
- correlate data of 2 observers
- if correlation significant and positive= high
8
Q
how to improve reliability in experiments?
A
- strict control over variables= repeatable
- same conditions each time= no EVs
- standardised procedures= control EVs
9
Q
how to improve reliability in observations?
A
- operationalised behavioural categories= record same behav
- no overlapping cat
- behaviours covered in checklist
- further training/ dicussing decisions
10
Q
how to improve reliability in questionnaires?
A
- questionnaires replaced and rewritten that are unclear
- replace open with closed/fixed questions (less complex and ambigious)
11
Q
how to improve reliability in interviews?
A
- same interviewer each time, all trained
- no leading or unclear questions
- use structured where interviewers behaviour is more controlled
