Assessment Flashcards
Item difficulty index
percentage of people who got an item CORRECT
The lower the score, the more difficult the question is
Who Americanized the Binet?
Lewis Terman
at Stanford University
thus, Stanford-Binet
The Buckley Amendment
AKA FERPA (Family Education Rights and Privacy Act of 1974)
Those over 18 can view their school record (including test data)
Can view their children’s test data
Can demand corrections to their file
Educational testing information cannot be released without adult consent
Projective tests may also be called
self-expressive (e.g., sentence completion or word association)
reactivity
clients/participants monitoring their own behavior and thus giving inaccurate answers
How can you increase reliability?
Increase the test’s length
Spearman-Brown Prophecy formula
used to estimate the impact that lengthening or shortening a test will have on a test’s reliability coefficient
when estimating split-half reliability, the Spearman-Brown prophecy formula can be used to compensate mathematically for the shorter length
Aptitude-achievement tests
GRE, MAT, MCAT, SAT
Ex: GRE attempts to predict graduate school performance but also tests level of current knowledge
Generally, school selection tests assess
aptitude
The ACA division for testing
AMECD
Association for Measurement and Evaluation in Counseling and Development
Interests and abilities are ____ correlated.
not highly
Bender Visual Motor Gestalt Test
named after Lauretta Bender
expressive projective measure, though known most for its ability to discern whether brain damage is present. Suitable for ages 4+ — client copies 9 geometric figures
Interest inventories
Work best with high-school age and beyond
Interests are not stable until age 25
Aptitude tests
assess Potential and Predict (aPtitude)
Tests that analyze data outside of a given theory
factor-analytic tests
Raymond Cattell
developed 16 Personality Factors
Responsible for defining fluid and crystallized intelligence
James Cattell
coined the term “mental test”
Projective tests use one of 3 formats
Association (word)
Completion (sentence)
Construction (draw a person)
Projective tests use ___ stimuli
vague
MMPI-2 for adolescents
MMPI-A
suitable for 14 to 18 y.o.s
Arthur Jensen
tremendous controversy for his 1969 Harvard Educational Review article
Said Whites score 11-15 IQ points higher than Blacks because due to slavery, Blacks were bred for strength rather than intelligence
Said that heredity contributes 80% to IQ and environment only 20%
Robert Williams
made the BITCH (Black Intelligence Test of Cultural Homogeneity) to demonstrate that Blacks often excel when given a test with questions familiar to their community. Argued that IQ tests were part of “scientific racism”
John Ertl
weirdo who claimed he invented an electronic machine to take the place of paper and pencil IQ tests. It literally had a strobe light on it.
Group tests are ___ accurate and have __ reliability, compared to individual tests
less accurate and less reliable
Means and SDs of Weschler and Binet IQ tests
Difference between the two
Weschler: M-100 SD-15
Stanford-Binet: M-100 SD-16
Binet seems to be not the best for adults and so Weschler is most popular
Forms of the Weschler IQ tests
WPPSI - preschool and primary; ages 2.6-7
WAIS - age 16+
WISC - for children; 6-16.11 years
A 9 year old task on the Binet is one that X of 9-year-olds could answer correctly
50%
Today’s Binet is scored…
with a Standard Age Score (SAS)
Mean of 100
SD of 16
IQ is calculated by
Mental Age / Chronological Age X 100
Alternatives to the split-half method of measuring internal consistency (inter-item consistency) of a test
Cronbach’s alpha
Kuder-Richardson-20 or KR-21
Cross-validation
When a researcher further examines a test’s criterion validity by administering the test to a new sample.
This helps ensure the test is applicable to other populations who will take the exam. Helps guard against error factors, which are likely to be present if the original sample was small.
The cross-validation coefficient will likely be smaller than the initial validity coefficient. This is called “shrinkage”
J. P. Guilford
isolated 120 factors that added up to intelligence
Two of the dimensions are divergent thinking (coming up with new ideas) and convergent thinking (when divergent thoughts and ideas are combined into a singular concept)
Charles Spearman
in 1904, said that two factors were applicable to any mental task:
G - general ability
S - specific ability
Francis Galton
cousin of Darwin! first intelligence theory believed intelligence was a single "unitary" factor and that exceptional abilities were genetic and ran in families eugenics :/ Hereditary Genius (1869)
coefficient of determination
variance of one factor accounted for another;
square the correlation
ex: same test is given to the same group of people and the correlation between the administrations is .70. The % of shared variance is .70 squared, which is .70x.70 = .49 (49%)
For psychological tests, an acceptable reliability coefficient is X. For admissions to jobs/schools (achievement), it is X.
Psycholgical - .70 reliability is good
For admissions to jobs/schools (achievement) - .80 or even .90
A reliability coefficient of .70 means…
70% of the obtained score on the test represented the true score
30% of the obtained score could be accounted for by error
AKA 70% is true variance while 30% is error variance.
(NOT that 70% of ppl who are tested will get their true score)
A reliable test is ___ valid.
A valid test is ___ reliable.
A reliable test is not always valid.
A valid test is always reliable.
Incremental validity (2 definitions)
The process by which a test is refined and becomes more valid as contradictory items are dropped
ALSO refers to a test’s ability to improve predictions when compared to existing measures. When a test has incremental validity, it gives you additional good info that wasn’t available from other tests.
According to the 1974 committee that drafted Standards for Education and Psychological Tests, face validity is ___
not required