Assessment L1 - Principles of Assessment Flashcards

1
Q

What is the medicolegal standard for assessment?

A
  • medicolegal standard = appropriate benchmark
  • defensive practice*
  • that Clinicians need to be held ACCOUNTABLE for the things that they say and do - the only time psychs are really held accountable is in court.
  • near enough is not good enough.
  • Client has legal right to expect they will be treated INNOCENT UNTIL PROVEN GUILTY.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What does it mean if a clinician cannot prove that a deficit exists.

A

If you cannot find a reason to make a diagnosis - they are innocent.

Innocent until proven guilty.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is an example of a poor treatment?

A
  • Deep Sleep Therapy @ Chelmsford P Hospital - prolonged sleep treatment, used drugs to keep people unconscious.
  • for depression, scz, depression, PMS, obesity & addiction
  • 26 died
  • Psychologist took part in ABHORRENT ASSESSMENT PRACTICE to justify intervention - low validity and reliability tests, tests were in shortened forms, combined with other shortened tests which exaggerated the problem and undermined the ability of valid tests.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

what are the testing practices at chelmsford hospital known for?

A
  • Deep sleep therapy
  • inappropriate assessment practice
  • low validity and reliability tests
  • shorted forms tests combined with other shortened tests - exaggerating the problem and undermining valid tests
  • using clinical judgements on relationships or profiles from combo of tests in the absence of adequate objective material.
  • peculiar use of component traits in the case
  • using clinical and subjective historical material without proper explanation of source of material when providing conclusions.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What do we refer to when we talk about the clash of culture between scientist practitioners and the courts of law?

A
  • judicial process requires proof, science based on disproof
  • judicial process requires facts, science provides theories and models
  • judicial process requires uncertainty, science provides statements of probability and estimates of error.

–> science isn’t interested in individual performance, but rather group performance, by using measures of central tendency.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is clinical decision making?

A
  • the clinician OBSERVES the client, gathers DATA and formulates HYPOTHESIS about a client’s problem, processes this information in his or her head and then PREDICTS the OUTCOME.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is statistical decision making

A

The human judge is ELIMINATED and conclusions rest solely upon the EMPIRICALLY ESTABLISHED relationships between data and the condition or event of interest.

  • must be based on empirical FREQUENCIES or BASE RATES of occurrence of the particular pattern of results in the population of interest.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is Meehl’s stance on decision making?

A
  • He compared the predictive accuracy of clinical versus statistical methods
  • Statistical methods were equal to or BETTER THAN clinical models in 19 of 20 studies..
  • the 1 that didnt work was due to methodological error.
  • examined 50 studies and reaffirmed what he found earlier.

there is no aspect of human behaviour hat cannot be rendered statistical decision making, just need to devise the parameters.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is the Frye Standard?

A
  • this is the test of admissibility of scientific evidence.
  • evidence needs to be generally accepted by the scientific community

Used in Aus.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is the Daubert Standard?

A
  • Eliminates junk science & Pseudoscience
  • If an expert presents evidence in a court of law, he must be able to present evidence whether the technique used can be falsified, it was peer reviewed and published, technique error rate and maintenance of controls, and whether theory is accepted generally in the scientific community.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What are psychometrics?

A
  • deals with scientific measurement of individual differences. eg. personality and intelligence.
  • attempts to measure the psychological qualities of individuals and use that knowledge to make predictions about behaviour
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is a ‘test’?

A
  • A systematic procedure for obtaining samples of behaviour, relevant to cognitive or affective functioning and for scoring and evaluating responses according to standards which must be:
  • OBJECTIVE - every observer of an event would produce an identical account of what took place
  • SYSTEMATIC - A methodical and consistent approach to understanding an event.
  • STANDARDISED - Observations of an event are made in a prescribed manner.

‘tests’ are only for those procedures in which the responses are evaluated based on their CORRECTNESS. or QUALITY.
EG. WAIS.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is a ‘inventory’?

A

This is a psychological test which assess factors.
EG. PERSONALITY INVENTORY

Doesn’t measure quantify something, but rather, creates an individual profile of a series of dimensions.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What are tests used for?

A

3 PURPOSES:
1. Undertaking the pragmatic process of MAKING DECISIONS about people, as individuals or groups. Eg. Determining if someone is intellectually disabled.

  1. SCIENTIFIC RESEARCH on psychological phenomena and individual differences - eg. making theories based on the measurement. EG. SSRIs and depressive symptoms.
  2. THERAPEUTIC PROCESS of promoting self understanding and psychological adjustment - eg. wanting to know if people are getting better as a consequence of intervention
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is a ‘scale’?

A

EITHER:

  1. A WHOLE TEST made up of several parts - eg. stanford binet intelligence scale
  2. a SUBTEST, or set of items within a test, whose measures are distinct and measure discrete characteristics - eg. depression scale fro MMPI

In the psychometric context, SCALES are a group of items that pertain to a single variable which are arranged in order of difficulty or intensity. The process of producing this result is referring to as scaling.

> lowest items must discriminate the low performance, as well as from high performance.
notion of scaling takes place as a consequence of the construct naturally being distributed.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is affirmation bias?

A

When the clinician hears you have a certain condition, they will look for evidence to confirm it.

It would be a good idea to have two people involved in the psychological assessment - one take the history and one do the tests to avoid bias!

17
Q

What is the role of tests in diagnosis?

A
  • They do not diagnose, clinicians do.
  • Use of tests for making decisions is always in context of psych assessment
  • psych assessment is a flexible, non standardised process aimed at reaching a defensible determination concerning psychological questions, through the collection, evaluation and analysis of data
18
Q

What is the difference between tests and assessments?

A

ASSESSMENTS refer to the entire process of collating info about individuals and using it to make predictions.

TESTS represent only ONE source of info within the assessment process.

19
Q

What are the two principle types of psychological tests used by practitioners?

A
  1. Tests of COG ABILITY - attempts to measure an individuals ability to process info from their environment.
  2. Tests of PERSONALITY - more concerned with people’s dispositions to behave in certain ways in certain situations.
20
Q

Describe cognitive testing.

A
  • Intelligence tests are commonly used in 3 main areas - neuropsych, occupational psych and educational psych.
  • Cog ability tests can be administered in 2 ways - individually administered, or group administered.
21
Q

Describe personality testing.

A
  • concerned with attempting to measure people’s characteristics or traits.
  • 2 forms :
    OBJECTIVE personality tests - rate their own actions or feelings in set situations
    PROJECTIVE tests - asked to formulate an unstructured response to some form of ambiguous stimuli - eg. Rorschach ink-blot test - These have problems with reliability, validity and standardisation - we don’t use them.
22
Q

How do we control the quality of psychological testing?

A

6 FACTORS:

  1. SCOPE - the range of attributes that are covered by the test and the range of people with whom it can be used
  2. RELIABILITY - accuracy
  3. VALIDITY - relevance
  4. ACCEPTABILITY - to potential users
  5. PRACTICALITY - cost, equipment
  6. FAIRNESS - to various groups of people.
23
Q

Why standardise tests?

A
  • Ensures that conditions are as similar as possible for all people who are given the test.
  • i.e. that the normative sample is directive comparable to the person being assessed.
  • Also ensures that no matter WHO gives the test and scores it, results should be the same.

Only variability = change within the client, NOT due to poor test administration

24
Q

What info is necessary to evaluate the applicability of a normative sample?

A
  • size of sample
  • when sample was gathered
  • where the sample was gathered
  • who tested the sample
  • how individuals were selected for the sample
  • how examiners were qualified to do the testing
  • what the position of the norm sample was - sex, ethnicity, age, race, linguistic background, education, socioeconomic status, geo distribution, and more.

goal - to know whether the normative sample is equiv to the sample you are going to measure this instrument with - so you can compare the person as if they were a part of the normative sample!

25
Q

What is a normative sample

A

a group of people presumed to be representative of the universe of people who may take a particular test, whose performance data on a particular test may be used as a reference source or context for evaluating individual test scores

26
Q

What is the frequency dist of IQ scores?

A
  • Normal distribution
  • SD = 15
  • Mean = 100

95% OF THE POPULATION ARE WITHIN 2 SD of MEAN.

27
Q

What is a raw score?

A
  • number that summarises or captures some aspect of a person’s performance
  • of itself, the raw score doesn’t mean anything.
    eg. scores of above 70T on MMPT show maladjustment, but lower scores (>30T) don’t necessarily mean good adjustment. The FRAME OF REFERENCE in which the interpretation is made is crucially important.
    eg. Higher personality score doesn’t mean MORE personality.
28
Q

How are scores expressed within group norms?

A
  • Percentile scores - indicates relative position compared to a reference group
  • Standard scores
29
Q

Difference between percentile and percentage score?

A

Percentile - reflects rank or position of an individual’s performance on a test as compared to a reference group

Percentage - reflect the number of correct responses that an individual obtains from a total possible number correct.

30
Q

What is skew and when does it happen?

A
  • Some measures are not normally distributed, but are skewed.
  • Eg. Recognition memory scores are usually negatively skewed.
  • in this case you cannot report PERCENTILES. Don’t normalise it.