Appraisal Flashcards

1
Q

Appraisal

A
  • the process of assessing or estimating attributes
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

ACA ethics consider it unethical to administer a test to a client from a given population unless that particular test or inventory has been normed on that specific population.

A
  • Always inform clients about the limitations of any test
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Subject Paradigm

A
  • relies mainly on the scorer’s opinion
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Objective test

A
  • rater’s opinion plays little or no part in the scoring process
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Halo Effect

A
  • If the rater knows the test taker’s attributes, the rater’s personal bias significantly impact the rating
  • colleagues being familiar with the the test taker so it rates him/her higher
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Short Answer

A
  • It’s a free choice or free response test (short open-ended)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Free choice (free response)

A
  • test taker can respond in any manner

- short answer questions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Recognition Item

A
  • give the examinee 2 or more alternatives to choose from
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Dichotomous recognition items

A
  • present two opposing choices
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Multipoint item

A
  • When a test gives the examinee 3 or more forced choices in an item
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Social desirability phenomenon

A
  • asserts that individuals will choose answers that they feel are socially acceptable
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Difficulty index

A
  • percentage of individuals who answered each items; individual’s score is evaluated by comparing it to others who took it
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Normative

A
  • each item is independent of all other items; individual’s score is evaluated by comparing it to other who took it
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Ipsative

A
  • compare traits within the same individual, do not compare a person to other persons, does not reveal absolute strengths, measured in response to his or her own standard of behavior, points out highs and lows
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Speed test

A
  • limited testing time to prevent perfect scores
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Power test

A
  • designated to evaluate the level of mastery without a time limit- include difficult test items
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Projective test

A
  • are free responses

- subjective vs. objective

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Achievement test

A
  • measures maximum performance
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Personality/interest inventory

A
  • measure typical performance
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Spiral test

A
  • items get progressively more difficult
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Cyclical test

A
  • several sections, which are spiral in nature
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Vertical test

A
  • versions for various age brackets, levels of education
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Horizontal test

A
  • measures various factors during the same testing procedure

- e.g battery test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Validity

A
  • whether the test measures what is supposed to measure
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q
  1. Content Validity
A
  • whether or not the test examines or samples the behavior under scrutiny
  • is the instruments’ content appropriate for its purpose? it must contain items measuring physical, cognitive, and psychological factors
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q
  1. Construct Validity
A
  • test ability to measure a theoretical construct like intelligence
  • experiment factor analysis
  • any trait that you cannot directly measure or observe
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q
  1. Concurrent Validity
A
  • how well the test compares to other instruments that are intended for the same purpose
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q
  1. Criterion Validity
A
  • the effectiveness of an instrument predicting an individual’s performance on a specific criterion
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q
  1. Consequential validity
A
  • tries to ascertain the social implications of using tests
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q
  1. Convergent Validity
A
  • the relationship/correlation of a test to an independent measure/trait
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q
  1. Predictive Validity
A
  • test’s ability to predict performance now and in the future
  • high criterion
    e. g: GRE, LSAT, SAT
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q
  1. Face Validity
A
  • looks or appears to measure the intended attribute
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q
  1. Incremental Validity
A
  • process by which a test is refined and becomes more valid as contradictory items are dropped
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q
  1. Synthetic Validity
A
  • helper looks for test that have been shown to predict each job element
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q
  1. Discriminant Validity
A
  • test will not reflect unrelated variables

- depression measure are not related to achievement instrument

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
36
Q

Physical vs. Psychological Measurements

A
  • Physical measurements are more reliable than psychological ones
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
37
Q

Factor Analysis

A
  • analysis the interrelationships of an instruments items revealing hidden traits of dimensions (data reductions)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
38
Q

Validity Coefficient

A
  • A correlation between a test score and the criterion measure
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
39
Q

A RELIABLE TEST is NOT Always VALID! bUT…

A

A VALID TEST is Always Reliable!

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
40
Q

Standard Error of Measurement

A
  • Indicates expected margin of error in a predicted criterion score due to imperfect validity
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
41
Q

Construct

A
  • any trait that cannot be directly measured or observed

- abstract: intelligence

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
42
Q

Observed Score

A
  • his/her true score plus the amount of error during the administration
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
43
Q

Reliability

A
  • How consistent a test measures an attribute
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
44
Q

Equivalent alternate forms reliability

A
  • Occurs when half of a group takes one form of a test and the other half takes another parallel form, after which a reliability coefficient is determined for all scores. This method control for fatigue, practice, and motivation
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
45
Q

Tes-retest reliability

A
  • give the same test to the same group of people two times and then correlate the scores
46
Q

Split-half method

A
  • the individual takes the entire test as a whole then the test is divided into halves, the correlation between the half scores yields a reliable coefficient
    1. Kudar Richardson Formula 20: when items are dichotomous
    2. Cronbach coefficient alpha used when there are multipoint responses
47
Q

Interrater/interobserver reliability

A
  • utilized with subjective tests, several raters assess the same performance
48
Q

Increasing a test length raises reliability

A
  • Increasing a test length raises reliability
49
Q

Reliability of 1.00

A
  • indicates a perfect score that has no error. This generally occurs only in physical measurements.
50
Q

Reliability of 0.90

A
  • Indicates that 90% of the score measured the attribute in question while 10% of the score is indicative of error. 90% id true variance while 10% is error variance. Meaning that 90% of the score is accurate whole 10% is inaccurate.
51
Q

To calculate a coefficient of determination or true variance of a reliability coefficient, square the correlation

A
  • Example: 0.70 x 0.70 = .49 x 100 = 49%
52
Q

IQ =

A
  • Mental Age (MA)/Chronological Age (CA) X 100

- IQ formula has been replaced by the standard age score (SAS)

53
Q

Francis Galton

A
  • Intelligence primarily genetic, unitary factor

- unitary faculty

54
Q

Spearman

A
  • Intelligence was comprised of 2 factors: a general ability (G) and a Specific (S) which were thought to be applicable to any mental task
55
Q

J.P. Guilford

A
  • Isolated 120 factors which added up to intelligence
  • Convergent thinking: occurs when divergent thoughts/ideas are combined into a singular concept
  • Divergent thinking: ability to generate a novel idea
56
Q

Convergent thinking:

A
  • occurs when divergent thoughts/ideas are combined into a singular concept
57
Q

Divergent thinking:

A
  • ability to generate a novel idea
58
Q

Alfred Binet and Theodore Simon

A
  • created 1st intelligence test

- test was created to discriminate normal from retarded Parisian children

59
Q

Lewis Terman

A
  • Americanized the Binet, associated with Stanford University
60
Q

Classical test theory

A
  • Most influential sum of true + amount of error presents item response - detects bias.
61
Q

Survey Achievement Batteries

A
  • SAT 10
  • Iowa test of basic skills
  • MAT 8
  • Weschler Scales - most widely used
62
Q

The Weschler Preschool and Primary Scale of Intelligence

WPPSI-III

A
  • It’s an IQ test designed for children between the ages of 2 years 6 months and 7 years and 3 months
63
Q

The Weschler Adult Intelligence Scale (WAIS-III)

A
  • It’s an IQ test intended for ages 16 and up
64
Q

The Weschler Intelligence Scale for Children (WISC-IV)

A
  • It’s appropriate for kids ages 6 to 16 years 11 months
65
Q

The Merrill-Palmer Scale of Mental Tests

A
  • It’s an intelligence test for infants
66
Q

WWI

A
  • provided the impetus for the group testing movement
67
Q

Culture fair test

A
  • items are known to be subject regardless of his/her culture
68
Q

Arthur Jensen

A
  • Black vs. White IQ controversy, Blacks were bred for strength not intelligence
69
Q

John Ertl

A
  • claimed he invented an electronic machine to analyze neural efficiency and take the place of a paper/pencil IQ test
70
Q

MMPI-2

A
  • Standardized personality test, self-report personality inventory intended to help clinicians diagnose and treat patients over the age of 18
71
Q

Psychometric

A
  • form of mental testing
72
Q

Francis Galton

A
  • 1st intelligence theory
73
Q

Projective testing

A
  • Association: what comes to mind when you look at this?
  • Completion: complete these sentences with real feelings
  • Construction: drawing a person
  • neutral stimuli
  • Examiner bias is common when using projective testing
74
Q

Howard Garner

A
  • 8 primary intelligence
75
Q

Raymond Cattell

A
  • 16 PF (Personality Factor) called factor analytic test, measures personality factors such as assertiveness, emotional maturity
  • Fluid and Crystallized Intelligence Theory
  • Fluid: measured by content-free reasoning such as block design or pectoral analogy problem, think logical.
  • Crystallized: measured by test that focus on content, ability to use skills, knowledge gained through learning
76
Q

Buros

A
  • Mental Measurement Yearbook
77
Q

Thematic Apperception Test (TAT)

A
  • by Murray

- uses pictures, intentionally ambiguous, client is asked to make up a story for each of them

78
Q

Test Bias

A
  • results from a test being normed solely on white middle clients
79
Q

Bender Visual Motor Gestalt Test

A
  • known for its ambiguity to discern whether brain damage is evident
80
Q

Interest Inventories

A
  • work best with clients in high school or above, criticism is it emphasizes professional positions and minimizes blue collar jobs, not highly correlated, reliable, not threatening
81
Q

AMECD

A
  • Association for measurement and evaluation counseling development
82
Q

Standard Error of Measurement

A
  • tells you how accurate/inaccurate a test score is, low standard of error means high reliability
83
Q

Informal assessment techniques

A
  • self-report, case notes, checklist, interviews
84
Q

Clients should know a test is merely a single source of data and not infallible

A

Clients should know a test is merely a single source of data and not infallible

85
Q

More public education is needed in the area of testing

A

More public education is needed in the area of testing

86
Q

Never generalize on the basis of a single test score

A

Never generalize on the basis of a single test score

87
Q

Buckley Amendment

A
  • individuals over 18 can inspect their own records and those of their children
88
Q

Item Difficulty

A
  • number of people who answered the item correctly Divided by Total of people tested
89
Q

Parallel Form of test

A
  • An equivalent form of the same test
90
Q

The Kuder-Richardson coefficients of equivalence

A

-

91
Q

Cross validation

A
  • it’s indeed smaller than the initial validity coefficient

- called shrinkage

92
Q

SAS

A
  • standard age score replace Binet;s IQ formula
93
Q

Wechsler IQ replaced Binet

A
  • because Binet didn’t seem to be the best test for adults
94
Q

Mean 100 and SD 15

A
  • IQ test Wechsler and Binet
95
Q

The IQ movement began with

A
  • the work of Binet
96
Q

MMPI-2

A
  • standardize personality test
97
Q

Psychometric

A
  • any form of mental test
98
Q

Psychometric

A
  • any form of mental test

- branch of counseling or psychology that dedicates to testing

99
Q

projective test

A
  • neutral stimuli
100
Q

16 PF (personality factors)

A
  • Raymond B. Cattell
101
Q

aptitude test

A
  • potential and predicts
102
Q

Achievement test

A
  • examines what you know
103
Q

TAT (thematic apperception test)

A
  • pictures

- 30 cards and one blank. the cards are ambiguous so the client can make up a story

104
Q

Bender Gestalt - the Bender visual motor gestalt test

A
  • utilized when counselor suspects the clients has a motoric disability
105
Q

AMECD

A
  • Association for Measurement and Evaluation in Counseling Development
106
Q

social desirability

A
  • person often answers questions in a socially acceptable manner
107
Q

Standard error of measurement

A
  • it tell you how accurate or inaccurate a test score is
  • Low SEOM = high reliability
  • x = t + or - e
108
Q

sefl-reports

A
  • counselor shy away from them since clients can provide inaccurate answers
109
Q

clinical psychologist

A
  • have the most training in testing
110
Q

IQ TEST

A
  • SD = 15

- Mean = 100

111
Q

Public Law 93-380 Buckley Amendment

A
  • a person over 18 years old can inspect their own records and their children
112
Q

Lewis Terman

A
  • Americanized the Binet
  • he was associated with the Stanford University
  • the test became Standford-Binet