Assessment and Diagnosis Flashcards
norm- vs criterion- referenced tests
norm: compare an examinee’s performance to the performance of a specified group of participants (norms)
criterion: used to assess where an examinee stands on a particular criterion, or domain of scale, status, or functioning.
Classical Test Theory
Spearman
score = true score + error
can’t individually observe either
Generalizability theory
extension of CTT
Identifies sources of measurement error, separates the influence of each source, estimates the individual sources of measurement error
Item response theory
examines individual items in test development
relationships between constructs being measured and individual items responses are examined at multiple levels
ICC
item difficulty
item discrimination
reliability coefficient
r, ranges 0-1
degree to which test scores are consistent
4 types of internal consistency reliability estimates.
split-half
inter-rater reliability (Kappa)
Cronbach’s alpha
Kuder-Richardson Formula 20 (for dichotomous)
Spearman-Brown formula
used to estimate the internal consistency of an entire test from the reliability of one half of a test
types of validity
content
construct
criterion (includes concurrent and predictive validity)
content validity
how well a test includes the range of information needed to test the construct being measured
criterion validity
how well a test aligns with other tests that are intended to measure
the same thing
construct validity
how well a test measures the concept it was designed to evaluate
type I error
false positive
type II error
false negative
multitrait-multimethod matrix
way of examining construct validity: compare your test with others that are designed to measure the same and different things - do you get the expected correlation matrix?
test bias
somethign in test that results in systematic variation or error, such that the test performs dfiferently in different groups
fairness in test creation
how fairly a test is used to classify/categorize
lack of bias
equitable treatment in the testing process
equality in outcomes
opportunity to learn
Achenbach System of Empirically Based Assessment yields
3 primary index scores:
Total problems
internalizing probs
externalizing probs
age range for WJ-IV cog
2 to >90
**based on cattell-horn-carrol theory of intelligence!
Halstead Reitan
fixed-battery approach, core tests include
Category test
Tactual performance test
Speech-sounds perception test
Seashore rhythm
finger tapping
trail making test