Assessment Final Flashcards
Models of Test Construction
Empirical Reasoning
Relies on Data and Analysis rather than Logic and Reason
Deductive Reasoning
In general, uses logic and reasoining to determine what a test response/score means
Logical-Content Strategy
Test developer tries to use logic to determine what content that needs included in their measure
Distinguising Characteristic
Assumption that the test item is accurately describing the content you want
- is the question doing what you think it’s doing
Theoretical Strategy
starts with a theory about your characteristic and then logically dedces items that are in line with that theory
- all items are going to be consistent with this theory
- logical-content guided by theory
Criterion-Group Strategy
- Begins with administering items to the Criterion group and control group
- Look for items that distinguish (or differ) between the two groups
- we don’t care what the content of the items that are different are - Then do Cross Validation
- Do research to find out what it means when the item is continuously endorsed
- what characteristics are the same
Cross Validation
- replicate the study with an independent sample with two completely new groups
- If we get the same results, we can say its cross validated
Control Group
should be a representative sample that is statistically different than the criterion group
Criterion Group
Group of People who share a characteristic/criterion
- i.e schitzophrenia, BPD, etc
Factor Analytic Strategy
- Uses Factor analysis to creat the measure
- look at correlations between items to see how they hang in order to create the factors
- starts with inner-correlations
-how are the items related- trying to determine the minimum number of factors that account for all variability
- then you must label each factor
The MMPI Heart of the MMPI
Validity Scales- give us info about how a person is approaching a test (are they trying to fake good/bad)
Clinical Scales- Designed to assess psychological disorders
Content Scales- gives clinically useful information
History of the MMPI
Was originally developed to distinguish between normal and abnormal psychological functioning
How was the MMPI Constructed?
- originally had like 500 items
- 8 groups with 50 persons in each group
- Made no assumption about what a person’s response to any item means
T-Score Cutoffs of the MMPI
- Initial Interpretations:
- Raw scores are converted into T-scores.
- T = 50, SD = 10.
- Scores of 70 or higher indicate 2 standard deviations above the mean.
- Renormed to be 1.5 standard deviations, considered significantly elevated.
- Original Approach:
- Aimed to aid in diagnosis.
- Pattern Analysis by Meehl:
- Examines index scores and patterns in different scales.
- Utilizes two-point code or numerical code for interpretation.
These cutoffs help clinicians interpret MMPI results and identify significant elevations indicative of potential psychological disorders.
Strengths of the MMPI
-
Criterion-Group Strategy:
- Provides valuable information without assuming the meaning of responses.
- Data-driven approach enhances objectivity.
-
Empirical Basis:
- Utilizes True/False statements, offering self-referential insights.
- Incorporates validity scales to assess test-taking approaches and clinical scales to evaluate psychological disorders.
-
Original Development:
- Developed with a vast item pool to distinguish between normal and abnormal psychological functioning.
- Utilized eight criterion and control groups to ensure robustness.
-
Validity Scales:
- Includes scales like L, K, and F to detect response biases and omitted items.
Weaknesses of the MMPI
-
Cross Validation:
- Relies on a convenience sample, potentially limiting generalizability.
-
Validity Scale Criticisms:
- While the inclusion of validity scales is essential, they may not entirely mitigate response biases or omitted items.
-
Initial Interpretations:
- Conversion to T-scores may simplify interpretations but might overlook nuances in individual responses.
-
Pattern Analysis:
- While pattern analysis is conducted, determining the significance of certain patterns can be subjective and prone to interpretation biases.
-
Numerical Code:
- Reliance on numerical codes might overlook the qualitative aspects of responses, potentially missing important contextual information.
Validity Scales for the MMPI
-
L Scale (Lie Scale)
- Detects individuals favorably presenting themselves.
-
K Scale
- Empirical version of the L scale.
- Compares non-disturbed, healthy individuals with a healthy MMPI to disturbed individuals with a healthy MMPI.
-
F Scale (Infrequency Scale)
- Identifies individuals attempting to appear sick.
- Includes items rarely endorsed by healthy control individuals.
-
Cannot Say Scale
- Addresses omitted items.
- If someone skips 10% of the items, the entire profile is deemed invalid.
What is the CPI
The California Psychological Inventory
- Originally designed to tap into developing NORMAL psych functioning and development
- Sister to MMPI and mostly used in counseling centers or education settings
What is the 16 PF
- Stands for 16 Personality Factors.
- Developed by psychologist Raymond Cattell.
- Comprehensive model describing personality based on sixteen primary factors.
- Factors include warmth, reasoning, emotional stability, dominance, liveliness, rule-consciousness, social boldness, sensitivity, vigilance, abstractedness, apprehension, openness to change, self-reliance, perfectionism, tension, and privateness.
What is the Rogers Q Sort
- a diagram to find the things you most agree wit and the things you most disagree with
- combination strategies
- more modern - usually theoretical combined with empirical
What is the NEO
- NEO-PI-R: A comprehensive inventory to predict various aspects:
- Psychological well-being
- Physical well-being
- Coping styles
- Interests
- Most well-researched currently.
- Major 3 factors:
- Neuroticism
- Extroversion
- Openness
- Each factor has 6 facets, totaling 9 each.
- It clearly overlaps all theories of the Big Five personality traits.
- Taps into all dimensions of the Big Five.
- Provides a comprehensive assessment of personality traits.
Projective Hypothesis (KNOW THIS)
when individuals are presented with ambiguous or vague stimuli, their interpretations reveal underlying aspects of their personality and psychological functioning.
- typical or atypical responses convey significant information
What is the Barnum Effect
- Occurs when generalized statements are perceived as highly accurate descriptions of oneself.
- Characteristics:
- Based on vague or general statements.
- Individuals perceive them as personally relevant.
- Example:
- Horoscopes claiming personality traits that could apply to many.
- Psychological Mechanism:
- Individuals interpret statements in a way that fits their self-concept.
- Criticism:
- Lack of specificity and scientific validity.
- Usage:
- Common in astrology, fortune-telling, and personality assessments.