A - done Flashcards
4 typical evaluative procedures?
Clinical interview, informal, personality, ability
Number of assessments needed for Dx & Txt?
Multiple is best.
Assessment vs test?
Test is a subset of assessment, which could include interviews, observations, etc
Interpretation vs evaluation?
Interpretation assigns meaning. Evaluation assigns value/worth, eg progress or effectiveness.
Types of assessments? (5 pairs)
Individual/group, standardized/nonstandardized, power/speed, maximal/typical performance, objective/subjective.
Standardized/nonstandardized tests?
Standardized - consistent administration, validity & reliability, comparison to norms. Nonstandardized - flexible, variable use, use of judgement by administrator eg Rorschach, TAT.
Purposes of assessment? (6)
Dx & Txt planning, placement services, admission (ed), selection (job), monitoring progress, evaluation of overall outcomes.
Ethics of Appraisal: competence & assessment?
Use only instruments trained in and competent to use.
Ethics of Appraisal: assessment & informed consent
Explain in advance the nature & purpose of the assessment & intended use.
Ethics of Appraisal: release of results?
To professionals qualified to interpret results. With consent.
Ethics of Appraisal: conditions of administration?
Conditions that facilitate optimal results.
Ethics of Appraisal: instrument selection? (5)
Current, valid, reliable, multiculturally appropriate, w consideration for psychometric limitations.
Ethics of Appraisal: scoring and interpretation?
Document any concerns about the tests, the administration, and how they will be used in counseling.
Ethics of Appraisal: assessment construction?
Use scientific methodology & knowledge, inform of benefits, limits, encourage use of multiple sources of info
Civil Rights Act of 1964 plus amendments?
Assessments for employability must relate strictly to the job description, and must not discriminate.
FERPA?
Family Education Rights & Privacy Act, 1974. Provides confidentiality for test results, but access for both student & parent.
IDEA?
Individuals w Disabilities Education improvement Act, 2004. Right to testing at expense of school system. Right to IEP w accommodations.
Vocational and Technical Education Act? (7)
- Vocational assistance for those: w disabilities, the economically disadvantaged, entering nontraditional occupations, w limited English, the incarcerated, adults needing voc training, & single parents.
ADA?
Americans w Disabilities Act, 1990. Employment testing must measure ability to do job tasks without confounding results with a disability. Ensures accomodations.
HIPAA?
Health Insurance Portability & Accountability Act, 1996. Obtain consent to release. CTs have access to their records.
NCLB?
No Child Left Behind Act, 2001. Improve accountability. Requires states to assess basic skills.
Larry P vs Riles
Document use of nondiscriminatory & valid assessments.
Diana v. California State Board of Educ.
Counselors must provide testing Information in the CT’s 1st language, as well as English.
Bakke v Regents of the University of California.
Barred use of quotas for admissions.
Soroka v Dayton-Hudson Co.
Psychological screening tests for hiring are an invasion of privacy. Controversial.
Sources of info on assessments?
Mental Measurementse Yearbook (Buros). Tests in Print. Tests. Test Critiques.
MMY?
Mental Measurements Yearbook. Details for commercially available assessments, including reliability, validity.
TIP.
Tests in Print. All published and commercial tests for psych and Educ. No critiques or psychometric data.
Test Critiques?
Comprehensive reviews, 8 pp, for pro & lay person.
Definition of Validity?
Property of?
To increase credibility?
- How accurately does an instrument measure what it purports to measure?
- A property of the scores of an instrument. Will vary according to intended purpose and intended test takers.
- More types of validity means greater credibility.
8 Types of validity?
Content, criterion (concurrent/predictive), construct, experimental design validity, convergent/discriminant.
Not face.
Content validity?
Content is appropriate to purpose, w all major content areas covered w an appropriate number of items for an area’s importance.
Criterion validity?
Effectiveness relative to a specific criterion. Can be concurrent or predictive validity.
Concurrent validity?
Comparison to a criterion collected at the same time.
Ex: depression scores & data collected on hospitalizations for SI in the last 6 months.
Predictive validity?
Predicts performance on a criterion collected in the future.
Ex: can a depression score predict hospitalizations for SI in the future?
Construct validity?
Extent to which an instrument measures a theoretical construct,
esp. an abstract one.
Experimental design validity?
Implementation of a design to show an instrument measures a specific construct.
Statistical technique used to check construct validity?
Factor analysis - looks for statistical relationships between subscales and with the construct.
Convergent validity?
Relationship can be shown with other constructs where theoretically there should be relationship.
Discriminant validity?
No relationship is found w constructs where no relationship should be found.
Validity coefficient?
A correlation between a test score and the criterion measure.
A test of prediction validity?
Regression equation to predict an individual’s future score.
Standard error of estimate?
The expected margin of error in a predicted criterion score. Prediction validity is never 100%.
Define decision accuracy.
The accuracy of instruments in supporting decisions in counseling.
Decision accuracy-
Definition?
6 types?
Assesses the accuracy of an instrument in supporting counseling decisions.
Sensitivity, specificity, false positive, false negative, efficiency, incremental validity.
Decision accuracy - sensitivity?
Instrument’s ability to identify the presence of a phenomenon.
Decision accuracy - specificity?
Instrument’s ability to identify the absence of a phenomenon.
Decision accuracy - false positive?
Instrument wrongly identifies the presence of a phenomenon.
Decision accuracy - false negative?
Instrument inaccurately identifies the absence of a phenomenon.
Decision accuracy - efficiency?
Ratio of correct counseling decisions indicated by the instrument over total decisions.
Decision accuracy - incremental validity?
Concerned w the extent an instrument enhances the accuracy of prediction of a criterion, eg job performance or GPA.
Reliability?
Consistency of scores obtained by the same person over different administrations of the same test. Reliability is concerned w the error found in instruments.
Reliability - test-retest?
AKA temporal stability. Consistency of scores across time.
Alternative form reliability?
AKA parallel form or equivalent form reliability. Consistency of scores across alternative, equivalent tests.
Reliability - Internal consistency?
Consistency of responses from 1 item to another during a single administration of the test.
Split half reliability?
Correlates 1/2 the test against the other half.
Spearman-Brown Prophecy formula?
Used to compensate for short length in split half estimates of reliability in tests.
A test for inter-item reliability?
Correlate all possible split half combinations in a test.