Appraisal Flashcards
Appraisal
- the process of assessing or estimating attributes
ACA ethics consider it unethical to administer a test to a client from a given population unless that particular test or inventory has been normed on that specific population.
- Always inform clients about the limitations of any test
Subject Paradigm
- relies mainly on the scorer’s opinion
Objective test
- rater’s opinion plays little or no part in the scoring process
Halo Effect
- If the rater knows the test taker’s attributes, the rater’s personal bias significantly impact the rating
- colleagues being familiar with the the test taker so it rates him/her higher
Short Answer
- It’s a free choice or free response test (short open-ended)
Free choice (free response)
- test taker can respond in any manner
- short answer questions
Recognition Item
- give the examinee 2 or more alternatives to choose from
Dichotomous recognition items
- present two opposing choices
Multipoint item
- When a test gives the examinee 3 or more forced choices in an item
Social desirability phenomenon
- asserts that individuals will choose answers that they feel are socially acceptable
Difficulty index
- percentage of individuals who answered each items; individual’s score is evaluated by comparing it to others who took it
Normative
- each item is independent of all other items; individual’s score is evaluated by comparing it to other who took it
Ipsative
- compare traits within the same individual, do not compare a person to other persons, does not reveal absolute strengths, measured in response to his or her own standard of behavior, points out highs and lows
Speed test
- limited testing time to prevent perfect scores
Power test
- designated to evaluate the level of mastery without a time limit- include difficult test items
Projective test
- are free responses
- subjective vs. objective
Achievement test
- measures maximum performance
Personality/interest inventory
- measure typical performance
Spiral test
- items get progressively more difficult
Cyclical test
- several sections, which are spiral in nature
Vertical test
- versions for various age brackets, levels of education
Horizontal test
- measures various factors during the same testing procedure
- e.g battery test
Validity
- whether the test measures what is supposed to measure
- Content Validity
- whether or not the test examines or samples the behavior under scrutiny
- is the instruments’ content appropriate for its purpose? it must contain items measuring physical, cognitive, and psychological factors
- Construct Validity
- test ability to measure a theoretical construct like intelligence
- experiment factor analysis
- any trait that you cannot directly measure or observe
- Concurrent Validity
- how well the test compares to other instruments that are intended for the same purpose
- Criterion Validity
- the effectiveness of an instrument predicting an individual’s performance on a specific criterion
- Consequential validity
- tries to ascertain the social implications of using tests
- Convergent Validity
- the relationship/correlation of a test to an independent measure/trait
- Predictive Validity
- test’s ability to predict performance now and in the future
- high criterion
e. g: GRE, LSAT, SAT
- Face Validity
- looks or appears to measure the intended attribute
- Incremental Validity
- process by which a test is refined and becomes more valid as contradictory items are dropped
- Synthetic Validity
- helper looks for test that have been shown to predict each job element
- Discriminant Validity
- test will not reflect unrelated variables
- depression measure are not related to achievement instrument
Physical vs. Psychological Measurements
- Physical measurements are more reliable than psychological ones
Factor Analysis
- analysis the interrelationships of an instruments items revealing hidden traits of dimensions (data reductions)
Validity Coefficient
- A correlation between a test score and the criterion measure
A RELIABLE TEST is NOT Always VALID! bUT…
A VALID TEST is Always Reliable!
Standard Error of Measurement
- Indicates expected margin of error in a predicted criterion score due to imperfect validity
Construct
- any trait that cannot be directly measured or observed
- abstract: intelligence
Observed Score
- his/her true score plus the amount of error during the administration
Reliability
- How consistent a test measures an attribute
Equivalent alternate forms reliability
- Occurs when half of a group takes one form of a test and the other half takes another parallel form, after which a reliability coefficient is determined for all scores. This method control for fatigue, practice, and motivation