Week 2 Flashcards
Methods of Self-Report Test Construction
Rational
Factorial
Empirical
Methods of Self-Report Test Construction: Rational
items are written to capture understanding of what a trait is
characteristics:
- tend to be face valid
- susceptible to response biases (easily faked, know what you are being asked)
- may not be internally consistent or valid
ex. I feel blue
ex. i feel manic`
Methods of Self-Report Test Construction: Factorical
items are selected on the basis of factor analysis
characteristics:
- highly internally consistent
- tend to be face valid
- somewhat susceptible to response bias
can combine this method with rational, see similar questions
Methods of Self-Report Test Construction: Empirical
items are selected on their ability to empirically distinguish one group from another
characteristics
- often have low internal consistency
- often items are not face valid
- may be less susceptible to response biases
Questions are randomly generated, see what item responses different between two groups (one group being normal, another with diagnosis)
ex. i like blue shoes
first MMPI
Clinical judgement
are we better at understanding people through algorithms (MMPI) or interacting with them?
Dawes, Faust, and Meehl (1989) “Clinical Versus Actuarial Judgment“
- Using statistical methods to derive algorithms (i.e., MMPI) for decision-making is superior to clinical decision-making
- “some studies use artificial tasks that failed to tap their expertise”
- humans do have superior observational skills but better to enter them into decision-making algorithm.
AKA USE ALGORITHIMS
OVERVIEW: APA Report, June 1998, “Benefits and Costs of psychological assessment in Healthcare Delivery“
(specific information in slides to follow)
There is a nature of some errors in clinical judgment
The assessment process provides some checks on these potential errors
Clinical judgment can sometimes be as good as statistical decision rules, but it never exceeds them.
APA Report: Nature of some errors in clinical judgment:
Nature of some errors in clinical judgment:
- May only elicit information that confirms hypotheses and ignore questions/ information that would disprove it.
- May compare patient to prototype rather than systematically evaluating on specific criteria
- May be overconfident rather than appropriately tentative
- Hindsight bias (wrongly assume we could have predicted the result AFTER being told result)
- May not consider relative frequency of the event they are predicting (rare events are harder to predict than common ones)
APA Report: The assessment process provides some checks on these potential errors:
- Staying true to data forces one to consider many possibilities to accommodate conflicting data
- Must integrate seemingly conflicting data (Consider: the nature of various types of data (multi-method), reliability and validity, the peculiarities of measures, the motivational and environmental circumstances of testing, client history, the understanding of complex conditions being assessed) - corrective strategies one can use:
- systematically identify characteristics of condition you want to diagnose
- test indicators & their absence should be directly linked to these characteristics
- systematically revise your impressions by considering data that temper your hypothesis
- predictions of rare events should be made sparingly
- use empirically validated, statistically derived predictions when available
- anticipate making mistakes - Feedback from the client can be a powerful corrective mechanism
APA Report: Clinical judgment can sometimes be as good as statistical decision rules, but it never exceeds them.
Clinical judgment can sometimes be as good as statistical decision rules, but it never exceeds them.
BUT there are problems:
- Decision rules do not generalize well to different settings
- There are no decision rules for the vast majority of decisions that must be made (infinite complexity prohibits relying on rules)
SUMMARY of clinical decision making
Clinical intuition is very fallible, but we tend to ignore this fact
Actuarial algorithms are better than clinical judgment
Diversity considerations: Language
In clinical work, use the term diversity (or idiographic) over multicultural, because:
- diversity is borader
- it focuses on the individual (idiographic) which is more in line with clinical group
- it better guards against stereotyping (seeing individual as individual)
–> therapeutic assessment is powerful agent of bias reduction and of understanding the person in front of us
Diversity considerations: Privilege
Socially, privilege generally refers to the advantages enjoyed by majority social groups (whites, heterosexuals, cis-gendered), which no doubt have effects that influence everyone psychologically
But Psychologically, privilege may be understood, for example, as the advantages of having parents who made possible a cohesive sense of self, and secure attachment status, because they lead to resilience, successful relationships, productive careers, and satisfying lives. This psychological level of our lives captures a universal concern–and perhaps a unifying force. And is certainly the focus of clinical work .
Diversity considerations: nomothetic tests
Nomothetic tests/methods can be extremely useful when used wisely
BUT thy can be misused. Thoughtless application of tests can:
- unfairly discriminate
- misdiagnose those from cultural groups not captured by the normative group as well as the idiographically different
- unfairly deny opportunities
One of the most compelling reasons FOR testing: to rise above our own biases/limitations
(ACTS AS BIAS MITIGATOR)
Overall diveristy considerations
We all have a multitude of unique life influences, and we make sense of them in a myriad of unique ways
> Must consider the individual’s life influences AND what effect they have had on that particular individual
Psychological assessment, especially Collaborative / Therapeutic Assessment is a powerful agent of bias reduction and of understanding the person in front of us-
HEXACO
six factor model
works across 16 languages (comparable)
Percentile Ranks for Uniform T-scores
Magic number is 65, only 8% of norm sample scored higher
38 is for low range
