Appraisal Flashcards
1
Q
Appraisal
A
- the process of assessing or estimating attributes
2
Q
ACA ethics consider it unethical to administer a test to a client from a given population unless that particular test or inventory has been normed on that specific population.
A
- Always inform clients about the limitations of any test
3
Q
Subject Paradigm
A
- relies mainly on the scorer’s opinion
4
Q
Objective test
A
- rater’s opinion plays little or no part in the scoring process
5
Q
Halo Effect
A
- If the rater knows the test taker’s attributes, the rater’s personal bias significantly impact the rating
- colleagues being familiar with the the test taker so it rates him/her higher
6
Q
Short Answer
A
- It’s a free choice or free response test (short open-ended)
7
Q
Free choice (free response)
A
- test taker can respond in any manner
- short answer questions
8
Q
Recognition Item
A
- give the examinee 2 or more alternatives to choose from
9
Q
Dichotomous recognition items
A
- present two opposing choices
10
Q
Multipoint item
A
- When a test gives the examinee 3 or more forced choices in an item
11
Q
Social desirability phenomenon
A
- asserts that individuals will choose answers that they feel are socially acceptable
12
Q
Difficulty index
A
- percentage of individuals who answered each items; individual’s score is evaluated by comparing it to others who took it
13
Q
Normative
A
- each item is independent of all other items; individual’s score is evaluated by comparing it to other who took it
14
Q
Ipsative
A
- compare traits within the same individual, do not compare a person to other persons, does not reveal absolute strengths, measured in response to his or her own standard of behavior, points out highs and lows
15
Q
Speed test
A
- limited testing time to prevent perfect scores
16
Q
Power test
A
- designated to evaluate the level of mastery without a time limit- include difficult test items
17
Q
Projective test
A
- are free responses
- subjective vs. objective
18
Q
Achievement test
A
- measures maximum performance
19
Q
Personality/interest inventory
A
- measure typical performance
20
Q
Spiral test
A
- items get progressively more difficult
21
Q
Cyclical test
A
- several sections, which are spiral in nature
22
Q
Vertical test
A
- versions for various age brackets, levels of education
23
Q
Horizontal test
A
- measures various factors during the same testing procedure
- e.g battery test
24
Q
Validity
A
- whether the test measures what is supposed to measure
25
1. Content Validity
- whether or not the test examines or samples the behavior under scrutiny
- is the instruments' content appropriate for its purpose? it must contain items measuring physical, cognitive, and psychological factors
26
2. Construct Validity
- test ability to measure a theoretical construct like intelligence
- experiment factor analysis
- any trait that you cannot directly measure or observe
27
3. Concurrent Validity
- how well the test compares to other instruments that are intended for the same purpose
28
4. Criterion Validity
- the effectiveness of an instrument predicting an individual's performance on a specific criterion
29
5. Consequential validity
- tries to ascertain the social implications of using tests
30
6. Convergent Validity
- the relationship/correlation of a test to an independent measure/trait
31
7. Predictive Validity
- test's ability to predict performance now and in the future
- high criterion
e. g: GRE, LSAT, SAT
32
8. Face Validity
- looks or appears to measure the intended attribute
33
9. Incremental Validity
- process by which a test is refined and becomes more valid as contradictory items are dropped
34
10. Synthetic Validity
- helper looks for test that have been shown to predict each job element
35
11. Discriminant Validity
- test will not reflect unrelated variables
| - depression measure are not related to achievement instrument
36
Physical vs. Psychological Measurements
- Physical measurements are more reliable than psychological ones
37
Factor Analysis
- analysis the interrelationships of an instruments items revealing hidden traits of dimensions (data reductions)
38
Validity Coefficient
- A correlation between a test score and the criterion measure
39
A RELIABLE TEST is NOT Always VALID! bUT...
A VALID TEST is Always Reliable!
40
Standard Error of Measurement
- Indicates expected margin of error in a predicted criterion score due to imperfect validity
41
Construct
- any trait that cannot be directly measured or observed
| - abstract: intelligence
42
Observed Score
- his/her true score plus the amount of error during the administration
43
Reliability
- How consistent a test measures an attribute
44
Equivalent alternate forms reliability
- Occurs when half of a group takes one form of a test and the other half takes another parallel form, after which a reliability coefficient is determined for all scores. This method control for fatigue, practice, and motivation
45
Tes-retest reliability
- give the same test to the same group of people two times and then correlate the scores
46
Split-half method
- the individual takes the entire test as a whole then the test is divided into halves, the correlation between the half scores yields a reliable coefficient
1. Kudar Richardson Formula 20: when items are dichotomous
2. Cronbach coefficient alpha used when there are multipoint responses
47
Interrater/interobserver reliability
- utilized with subjective tests, several raters assess the same performance
48
Increasing a test length raises reliability
- Increasing a test length raises reliability
49
Reliability of 1.00
- indicates a perfect score that has no error. This generally occurs only in physical measurements.
50
Reliability of 0.90
- Indicates that 90% of the score measured the attribute in question while 10% of the score is indicative of error. 90% id true variance while 10% is error variance. Meaning that 90% of the score is accurate whole 10% is inaccurate.
51
To calculate a coefficient of determination or true variance of a reliability coefficient, square the correlation
- Example: 0.70 x 0.70 = .49 x 100 = 49%
52
IQ =
- Mental Age (MA)/Chronological Age (CA) X 100
| - IQ formula has been replaced by the standard age score (SAS)
53
Francis Galton
- Intelligence primarily genetic, unitary factor
| - unitary faculty
54
Spearman
- Intelligence was comprised of 2 factors: a general ability (G) and a Specific (S) which were thought to be applicable to any mental task
55
J.P. Guilford
- Isolated 120 factors which added up to intelligence
- Convergent thinking: occurs when divergent thoughts/ideas are combined into a singular concept
- Divergent thinking: ability to generate a novel idea
56
Convergent thinking:
- occurs when divergent thoughts/ideas are combined into a singular concept
57
Divergent thinking:
- ability to generate a novel idea
58
Alfred Binet and Theodore Simon
- created 1st intelligence test
| - test was created to discriminate normal from retarded Parisian children
59
Lewis Terman
- Americanized the Binet, associated with Stanford University
60
Classical test theory
- Most influential sum of true + amount of error presents item response - detects bias.
61
Survey Achievement Batteries
- SAT 10
- Iowa test of basic skills
- MAT 8
- Weschler Scales - most widely used
62
The Weschler Preschool and Primary Scale of Intelligence
| WPPSI-III
- It's an IQ test designed for children between the ages of 2 years 6 months and 7 years and 3 months
63
The Weschler Adult Intelligence Scale (WAIS-III)
- It's an IQ test intended for ages 16 and up
64
The Weschler Intelligence Scale for Children (WISC-IV)
- It's appropriate for kids ages 6 to 16 years 11 months
65
The Merrill-Palmer Scale of Mental Tests
- It's an intelligence test for infants
66
WWI
- provided the impetus for the group testing movement
67
Culture fair test
- items are known to be subject regardless of his/her culture
68
Arthur Jensen
- Black vs. White IQ controversy, Blacks were bred for strength not intelligence
69
John Ertl
- claimed he invented an electronic machine to analyze neural efficiency and take the place of a paper/pencil IQ test
70
MMPI-2
- Standardized personality test, self-report personality inventory intended to help clinicians diagnose and treat patients over the age of 18
71
Psychometric
- form of mental testing
72
Francis Galton
- 1st intelligence theory
73
Projective testing
- Association: what comes to mind when you look at this?
- Completion: complete these sentences with real feelings
- Construction: drawing a person
* neutral stimuli
* Examiner bias is common when using projective testing
74
Howard Garner
- 8 primary intelligence
75
Raymond Cattell
- 16 PF (Personality Factor) called factor analytic test, measures personality factors such as assertiveness, emotional maturity
- Fluid and Crystallized Intelligence Theory
- Fluid: measured by content-free reasoning such as block design or pectoral analogy problem, think logical.
- Crystallized: measured by test that focus on content, ability to use skills, knowledge gained through learning
76
Buros
- Mental Measurement Yearbook
77
Thematic Apperception Test (TAT)
- by Murray
| - uses pictures, intentionally ambiguous, client is asked to make up a story for each of them
78
Test Bias
- results from a test being normed solely on white middle clients
79
Bender Visual Motor Gestalt Test
- known for its ambiguity to discern whether brain damage is evident
80
Interest Inventories
- work best with clients in high school or above, criticism is it emphasizes professional positions and minimizes blue collar jobs, not highly correlated, reliable, not threatening
81
AMECD
- Association for measurement and evaluation counseling development
82
Standard Error of Measurement
- tells you how accurate/inaccurate a test score is, low standard of error means high reliability
83
Informal assessment techniques
- self-report, case notes, checklist, interviews
84
Clients should know a test is merely a single source of data and not infallible
Clients should know a test is merely a single source of data and not infallible
85
More public education is needed in the area of testing
More public education is needed in the area of testing
86
Never generalize on the basis of a single test score
Never generalize on the basis of a single test score
87
Buckley Amendment
- individuals over 18 can inspect their own records and those of their children
88
Item Difficulty
- number of people who answered the item correctly Divided by Total of people tested
89
Parallel Form of test
- An equivalent form of the same test
90
The Kuder-Richardson coefficients of equivalence
-
91
Cross validation
- it's indeed smaller than the initial validity coefficient
| - called shrinkage
92
SAS
- standard age score replace Binet;s IQ formula
93
Wechsler IQ replaced Binet
- because Binet didn't seem to be the best test for adults
94
Mean 100 and SD 15
- IQ test Wechsler and Binet
95
The IQ movement began with
- the work of Binet
96
MMPI-2
- standardize personality test
97
Psychometric
- any form of mental test
98
Psychometric
- any form of mental test
| - branch of counseling or psychology that dedicates to testing
99
projective test
- neutral stimuli
100
16 PF (personality factors)
- Raymond B. Cattell
101
aptitude test
- potential and predicts
102
Achievement test
- examines what you know
103
TAT (thematic apperception test)
- pictures
| - 30 cards and one blank. the cards are ambiguous so the client can make up a story
104
Bender Gestalt - the Bender visual motor gestalt test
- utilized when counselor suspects the clients has a motoric disability
105
AMECD
- Association for Measurement and Evaluation in Counseling Development
106
social desirability
- person often answers questions in a socially acceptable manner
107
Standard error of measurement
- it tell you how accurate or inaccurate a test score is
- Low SEOM = high reliability
- x = t + or - e
108
sefl-reports
- counselor shy away from them since clients can provide inaccurate answers
109
clinical psychologist
- have the most training in testing
110
IQ TEST
- SD = 15
| - Mean = 100
111
Public Law 93-380 Buckley Amendment
- a person over 18 years old can inspect their own records and their children
112
Lewis Terman
- Americanized the Binet
- he was associated with the Stanford University
- the test became Standford-Binet
