Test Bias Flashcards
What is the definition of test bias?
gives SYSTEMATICALLY wrong results
What makes a test biased?
THE USE of the test (native vs non native english speakers)
Why is test bias controversial?
tests determine who gets to use certain resources
Are group differences in test scores evidence for bias?
NO - it is the USE that makes them biased
What are arguments against the argument that test are in principle biased?
1) scrutiny over decades/constant revision
2) consider WHOLE test
3) information vs. outcomes
4) overall prediction utility
5) criterion validity
6) results with “culture fair tests”
7) Differential Item Function analysis (DIF)
Why is scrutiny a good argument that tests aren’t in principle biased?
major test constantly revised
Why is it important to consider the WHOLE test when arguing that tests aren’t in principle biased?
whole test vs. individual items
- items have wide domain therefore not everyone SHOULD know them
Why is it important to consider the information vs. outcomes when arguing that tests aren’t in principle biased?
tests give info about future, not logical to blame tests (tool for testing)
e.g. blaming thermometer for temperature reading
Why is criterion validity a good argument that tests aren’t in principle biased?
test score = predictor (SAT score)
validity = success later/outcome (GPA)
*shown that this is a good predictor
Why is it important to consider culturally fair tests when arguing that tests aren’t in principle biased?
eg. Ravens is best indicator of (g) and is NON verbal therefore culturally fair
What is DIF analysis and why is it important in the argument that test are not in principle biased?
Differential Item Function analysis (DIF): term preferred to “test bias”
- method of eliminating test bias
What is the procedure in elimination biased questions from a test? (DIF)
1) from groups (e.g. 90%, 80%, 70% etc)
2) look at difference between them
3) difference = biased item
Does removing a biased test item change the outcome for different groups?
NO
How is criterion validity evaluated between test scores and criterion scores? e.g. SAT & GPA
CORRELATIONS (diff correlations for diff groups)
When is it okay to use test scores as predictors?
when there is a high correlation bw test scores and criterion scores e.g. SAT and GPA
What is an average regression line? What is the consequence of using it?
when the intercept differ between two correlations, draw a line in between
RESULT: will lower one groups test score predication and raise the others
A steeper slope gives you a higher correlation. (T/F)
TRUE - up until 45 degrees
What happens when the slopes of two correlations (bw SAT & GPA) are DIFFERENT?
test score good predictor for one group (steeper line)
but NOT the other therefore BIASED TEST
What are 3 tests used in testing minorities?
1) Chitling
2) BITCH test
3) SOMPA