week 9 - bias Flashcards

1
Q

test bias

A

arises when there is a factor inherent in a test that systematically prevents accurate, impartial measurement

- Bias in the test in regards to a particular group

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

construct bias

A

bias within the meaning of the test, two groups see the construct differently

eg, two groups of people see the construct of intelligence differently

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

predictive bias

A

bias in the predictive use of a test

eg, atar being baised towards western children as a predictor for academic success in uni

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

methods of detecting test bias

A

internal evaluations for construct bias
external evaluations for predictive bias

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

types of internal evaluations

detecting construct bias

A

Item Discrimination Index
Factor Analysis
Differential Item Functioning
Rank-Order Consistency

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

an item is biased if

A
  1. people belonging to different groups respond in different ways to the item, and
    1. if it could be shown that these differing responses were not related to group differences associated with the psychological construct measured by the test
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

item discrimination index

A

measures if the items correlate with the total score heavily

must use these seperately for both groups
is the item good and will it actually discriminate between the two groups

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

differential item functioning

A

an assesment of consruct bias which assumes it can measure trait levels directly from test data
in looking at the curve wed hope to see the same function between the two groups

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

rank order consistency

A

looking at the average rankings of responses to items
ensuring the order matches across groups

eg, item 3 is the highest scored item for men but second highest for woemn

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

rank order consistency

A

looking at the average rankings of responses to items
ensuring the order matches across groups

eg, item 3 is the highest scored item for men but second highest for woemn

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

external evaluations for test bias

looking at predicitive bais

A

bivariate regression
* slope bias
* intercept bias
* slope + intercept bias
* outcome score bias

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

2 steps in external evaluations

A
  1. you need to determine whether the test scores predict the dependent variable to start with
    1. you then need to determine whether the test scores predict the dependent variable equally well across groups

are they a good measure
are they a good measure across groups

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

outcome score bias

A

?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly