Lecture 11: Application of Assessment in Clinical Settings Flashcards

1
Q

What is the difference between assessment and testing?

A

Testing: a particular scale is administered to obtain a specific score and a
descriptive meaning can be applied to the score on the basis of normative,
nomothetic findings.
• Assessment: concerned with the clinician who takes a variety of test
scores, generally obtained from multiple test methods, and considers data in
the context of history, referral information, and observed behaviour to understand the person being evaluated, to answer the referral questions, and then to communicate findings to the patient, his or her significant
others and referral sources.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Why should we assess?

A
  1. describe current functioning
  2. confirm, refute, or modify impressions formed by clinicians
  3. identify therapeutic needs, highlight issues likely to arise in treatment, recommend forms of interventions and offer guidance about likely outcomes
  4. aid in differential diagnosis
  5. monitor treatment over time to evaluate the success of interventions
  6. manage risk (untoward treatment reactions, potential legal liabilities)
  7. provide skilled, empathic assessment feedback as a therapeutic
    intervention in itself.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Why should we use standardised tests?

A

Clinicians are unreliable judges

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Why are clinicians unreliable judges?

A
Errors in gathering data:  -tendency to see patterns where none exist
• tendency to seek confirmatory evidence
• use of preconceived biases
 Errors in synthesising data
• heuristics in clinical judgement (Tversky & Kahneman, 1974)
• representativeness
• availability
• anchoring
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Types of tests used by clinicians

A
-Diagnostic interviews
• Self-report questionnaires
• Questionnaires completed by significant others
• Behavioural tests
• Observational methods
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What are diagnostic interviews?

A

Fully or semi structured
Ensure coverage of the diagnostic criteria as specified by DSM-5 (few errors in gathering data)
Rules for scoring the interview are specified (few errors in synthesing data)

e.g. 1 in 5 people etc etc

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is a reliability for structured diagnostic interview

A

Inter-rater agreement (two clinicians come up with same diagnosis)
-Test-retest reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is a validity for structured diagnostic interview

A
  • Validity of diagnostic criteria
  • What is the “gold standard”? Is a LEAD standard better?
  • Procedural validity

LEAD- expert who knows client, who has access to all data

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What are the statistics used?

A
  • Kappa coefficients

- Sensitivity (probability that a person will

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is Kappa?

A

A measure of agreement corrected by chance.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is sensitivity?

A

• Probability that a person with a clinical diagnosis will

receive the same diagnostic interview diagnosis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is specificity

A

Probability that a person without a clinical diagnosis will not receive that diagnosis via the diagnostic interview

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is Positive predictive values

A

Probability that a person with a diagnostic interview diagnosis is truly “ill”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is negative predictive values?

A

Probability that a person without a diagnostic interview

diagnosis is truly “well”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is the sensitivity equation?

A

a/a+c

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is specificity equation?

A

d/b+d

17
Q

What is the PPV equation

A

a/a+b

18
Q

What is NPV?

A

d/d+c

19
Q

What is the equation for Kappa?

A

k= Po-Pe/ 1-Pe

20
Q

What is Po?

A

Observed population

21
Q

What is the equation for Po?

A

Po=(a+d)/n

22
Q

What is Pe?

A

The proportion expected by chance?

23
Q

What is the equation for Pe?

A

(a+b)(a+c)/n + (c+d)(b+d)/n

24
Q

What are the interpretation scales?

A
≥ .75 - excellent agreement
.6 to .74 – good agreement
.4 to .59 – fair agreement
less than .4 – poor agreement
0 – agreement at chance level
25
Q

What is a global measure questionnaires?

A

Assess multiple symptoms

Provide an overall level of severity of psychopathology

26
Q

What is specific measures questionnaires

A

Assess a limited set of symptoms

Provide measures of the level of severity of a specified problem.

27
Q

What is the BSI?

A

Designed to reflect psychological symptom patterns of patients and non-patients.
53 items.
Items rated on 5 point scale
Adequate reliability and validity

28
Q

What is the BAT

A

BEhavioural avoidance test

29
Q

How do you judge whether the client is making appropriate progress or has had a good outcome as an outcome of treatment?

A

Statistical vs Clinical significance

30
Q

What is statistical significance?

A

Group means are compared and if the difference between the means is found to occur beyond the range of chance (generally 0.05 p), the difference is significant.

HOWever, the difference may not be meaningful, small changes can be statistically significant, and not everyone in the group improves

31
Q

What is clinical significance?

A

Individual level of analysis

Meaningful changes

32
Q

What are the two criteria necessary for an individual to to have clinically significant change

A

Improvement: The dependent measure must show a reliable change that is larger than the measurement error of the instrument (reliable change index)

Recovery: After treatment, the individual’s score on the dependent measure is more likely to be drawn from the distribution of a functional than a dysfunctional population.

33
Q

What is the equation for RCI?

A

RC=X2-X1/ Sdiff

X1 = individual’s pre-treatment score
X2 = Individual’s postttreatment score
Sdiff = standard error of the difference between the two scores
34
Q

What are 3 ways to operationalise normal functioning? (part of recovery)

A

a. post-treatment score should fall outside the range of the dysfunctional
population, where range is 2 sd’s beyond the mean
b. post-treatment score should fall within the range of the functional
population (within 2 sd’s of the mean)
c. post-treatment score is closer to the mean of the functional than of the
dysfunctional population