Assessment Final Flashcards
Models of Test Construction
Empirical Reasoning
Relies on Data and Analysis rather than Logic and Reason
Deductive Reasoning
In general, uses logic and reasoining to determine what a test response/score means
Logical-Content Strategy
Test developer tries to use logic to determine what content that needs included in their measure
Distinguising Characteristic
Assumption that the test item is accurately describing the content you want
- is the question doing what you think it’s doing
Theoretical Strategy
starts with a theory about your characteristic and then logically dedces items that are in line with that theory
- all items are going to be consistent with this theory
- logical-content guided by theory
Criterion-Group Strategy
- Begins with administering items to the Criterion group and control group
- Look for items that distinguish (or differ) between the two groups
- we don’t care what the content of the items that are different are - Then do Cross Validation
- Do research to find out what it means when the item is continuously endorsed
- what characteristics are the same
Cross Validation
- replicate the study with an independent sample with two completely new groups
- If we get the same results, we can say its cross validated
Control Group
should be a representative sample that is statistically different than the criterion group
Criterion Group
Group of People who share a characteristic/criterion
- i.e schitzophrenia, BPD, etc
Factor Analytic Strategy
- Uses Factor analysis to creat the measure
- look at correlations between items to see how they hang in order to create the factors
- starts with inner-correlations
-how are the items related- trying to determine the minimum number of factors that account for all variability
- then you must label each factor
The MMPI Heart of the MMPI
Validity Scales- give us info about how a person is approaching a test (are they trying to fake good/bad)
Clinical Scales- Designed to assess psychological disorders
Content Scales- gives clinically useful information
History of the MMPI
Was originally developed to distinguish between normal and abnormal psychological functioning
How was the MMPI Constructed?
- originally had like 500 items
- 8 groups with 50 persons in each group
- Made no assumption about what a person’s response to any item means
T-Score Cutoffs of the MMPI
- Initial Interpretations:
- Raw scores are converted into T-scores.
- T = 50, SD = 10.
- Scores of 70 or higher indicate 2 standard deviations above the mean.
- Renormed to be 1.5 standard deviations, considered significantly elevated.
- Original Approach:
- Aimed to aid in diagnosis.
- Pattern Analysis by Meehl:
- Examines index scores and patterns in different scales.
- Utilizes two-point code or numerical code for interpretation.
These cutoffs help clinicians interpret MMPI results and identify significant elevations indicative of potential psychological disorders.
Strengths of the MMPI
-
Criterion-Group Strategy:
- Provides valuable information without assuming the meaning of responses.
- Data-driven approach enhances objectivity.
-
Empirical Basis:
- Utilizes True/False statements, offering self-referential insights.
- Incorporates validity scales to assess test-taking approaches and clinical scales to evaluate psychological disorders.
-
Original Development:
- Developed with a vast item pool to distinguish between normal and abnormal psychological functioning.
- Utilized eight criterion and control groups to ensure robustness.
-
Validity Scales:
- Includes scales like L, K, and F to detect response biases and omitted items.
Weaknesses of the MMPI
-
Cross Validation:
- Relies on a convenience sample, potentially limiting generalizability.
-
Validity Scale Criticisms:
- While the inclusion of validity scales is essential, they may not entirely mitigate response biases or omitted items.
-
Initial Interpretations:
- Conversion to T-scores may simplify interpretations but might overlook nuances in individual responses.
-
Pattern Analysis:
- While pattern analysis is conducted, determining the significance of certain patterns can be subjective and prone to interpretation biases.
-
Numerical Code:
- Reliance on numerical codes might overlook the qualitative aspects of responses, potentially missing important contextual information.
Validity Scales for the MMPI
-
L Scale (Lie Scale)
- Detects individuals favorably presenting themselves.
-
K Scale
- Empirical version of the L scale.
- Compares non-disturbed, healthy individuals with a healthy MMPI to disturbed individuals with a healthy MMPI.
-
F Scale (Infrequency Scale)
- Identifies individuals attempting to appear sick.
- Includes items rarely endorsed by healthy control individuals.
-
Cannot Say Scale
- Addresses omitted items.
- If someone skips 10% of the items, the entire profile is deemed invalid.
What is the CPI
The California Psychological Inventory
- Originally designed to tap into developing NORMAL psych functioning and development
- Sister to MMPI and mostly used in counseling centers or education settings
What is the 16 PF
- Stands for 16 Personality Factors.
- Developed by psychologist Raymond Cattell.
- Comprehensive model describing personality based on sixteen primary factors.
- Factors include warmth, reasoning, emotional stability, dominance, liveliness, rule-consciousness, social boldness, sensitivity, vigilance, abstractedness, apprehension, openness to change, self-reliance, perfectionism, tension, and privateness.
What is the Rogers Q Sort
- a diagram to find the things you most agree wit and the things you most disagree with
- combination strategies
- more modern - usually theoretical combined with empirical
What is the NEO
- NEO-PI-R: A comprehensive inventory to predict various aspects:
- Psychological well-being
- Physical well-being
- Coping styles
- Interests
- Most well-researched currently.
- Major 3 factors:
- Neuroticism
- Extroversion
- Openness
- Each factor has 6 facets, totaling 9 each.
- It clearly overlaps all theories of the Big Five personality traits.
- Taps into all dimensions of the Big Five.
- Provides a comprehensive assessment of personality traits.
Projective Hypothesis (KNOW THIS)
when individuals are presented with ambiguous or vague stimuli, their interpretations reveal underlying aspects of their personality and psychological functioning.
- typical or atypical responses convey significant information
What is the Barnum Effect
- Occurs when generalized statements are perceived as highly accurate descriptions of oneself.
- Characteristics:
- Based on vague or general statements.
- Individuals perceive them as personally relevant.
- Example:
- Horoscopes claiming personality traits that could apply to many.
- Psychological Mechanism:
- Individuals interpret statements in a way that fits their self-concept.
- Criticism:
- Lack of specificity and scientific validity.
- Usage:
- Common in astrology, fortune-telling, and personality assessments.
Basic History of the Rorschach
- Hermann Rorschach developed the Rorschach Inkblot Test in the early 20th century.
- Intended to identify psychological disorders by analyzing interpretations of inkblot images.
- The test involves free association and inquiry phases during administration.
- The Exner Comprehensive Scoring System attempted to address issues but didn’t resolve major problems.
- Major problems include:
- Norms were misrepresented.
- Scoring was unreliable and controversial.
- The “R” problem led to inflated scores with more responses.
- Over-pathologizing occurred, misidentifying disorders.
- Lack of relationship with diagnoses and incremental validity.
- Used in various contexts, including custody cases.
- Criticisms include lack of reliability, validity, and potential harm.
Development of the Rorschach
-
Clinical Validation:
- Blind Analysis: Worked due to the Barnum Effect.
- Barnum Effect: Generalized statements that many people identify with, like horoscopes.
- Confirmation Bias: Seeking evidence that supports inkblot responses while disregarding contrary evidence.
-
Exner Comprehensive Scoring System:
- Didn’t address major problems.
-
Major Problems:
- Norms: Original norms misrepresented.
- Unreliable Scoring: Messy and controversial, lacking validity.
- Problem of “R”: More talking leads to higher scores, related to intelligence and cooperation.
- Over-pathologizing: Incorrectly identifies disorders in nearly 50% of cases, especially in custody battles.
- Lack of Relationship with Diagnoses: No evidence supporting its predictive value.
- Lack of Incremental Validity: Claims of unique clinical insights are false; evidence suggests harm.
Incremental Validity
Gives us information we cannot get elsewhere that will help clinical because it helps us - which is false
Exner System of Scoring
- Scoring:
- Allows for norming but can be complicated and subjective.
- Psychometric Properties:
- Clinical Validation through “Blind Analysis” influenced by the Barnum Effect.
- Confirmation Bias: Seeking supporting evidence while disregarding contradictory evidence.
Problems with the Rorschach - all of them :)
- Exner’s system failed to address critical issues.
- Norms misrepresented, leading to unreliable scoring.
- Problem of “R” where more responses increase scores, correlated with intelligence.
- Over-pathologizing and lack of relationship with diagnoses.
- Lack of incremental validity, evidence suggests harm.
What theory is the TAT Based on
Psychdynamic theory
Murries Theory of Needs
- Proposed by Murray in 1938.
- Main needs include accomplishment, conformity, and attention.
- Edward developed a measure based on this theory.
- Social Desirability measured through forced-choice pairs.
- Individuals select which option is more like them, rather than rating individual items.
- Helps solve the balancing problem in measurement.
TAT Scoring Parameters
- Thematic Apperception Test (TAT) scoring involves several parameters:
- Content Analysis: Interpretation of the story’s themes, characters, and plot.
- Motive: Assessment of underlying needs, desires, and conflicts portrayed in the story.
- Imagery: Evaluation of the vividness and detail in the story’s imagery.
- Affect: Analysis of the emotional tone and intensity displayed in the story.
- Dynamic Components: Identification of interpersonal relationships, power dynamics, and resolution of conflicts depicted in the story.
- Defense Mechanisms: Recognition of psychological defenses employed by the storyteller.
- These parameters help assess the individual’s personality traits, unconscious processes, and interpersonal dynamics.
