5.1.2 Reliability and Validity of diagnoses Flashcards
Inter Rater Reliability
When two clinicians can review the same information about the symptoms of one patient and come to the same conclusion about diagnosis.
Reliability
Is about consistency within results whereby psychiatrists and classification systems can come to the same conclusion everything time.
Strength
Evidence
Brown found good agreement and inter rater between most of the categories and issues only arose about length, severity and amount of symptoms
Weakness
Opposing Evidence
Andes’s found little agreement between using the ICD and DSM showing low consistency
Test Retest Reliability
Test retest is about diagnosing at two different points and finding consistency throughout. Cohens Kappa measures the proportion of people who receive the same diagnosis at a later date.
Strength
Evidence
Cooper found 0.2 to 0.4 to be acceptable and the result of 0.28 for major depressive disorder
Cohens kappa
0.7 was seen to be in good agreement.
Weakness
Opposing Evidence
Spitzer and Felis found that 0.7 reliability is only satisfactory and reliability may not be important if the focus is on individualised treatment that will work to recover or lessen the mental health issues
Validity
How accurately the diagnosis matches symptoms.
Predictive validity
Whether the outcome is as predicted after being diagnosed,
Strength
Evidence
Mason found ICD 9+10 were good at predicting disability in sz people 13 years after.
Weakness
Criticism
Reductionist as it reduces down to symptoms/features and would be more valid if holistic.
Concurrent validity
Producing the same results/diagnosis using another diagnostic tool
Strength
Evidence
Lee found that when comparing a questionnaire from teachers about behaviour to the DSM criteria that there was similar relationships
Weakness
Criticism
Labels may affect questionnaire data and perceptions because they may be biased to give results.