Item fairness and CAT

Question 1

Differential item functioning

Answer 1

Can be used to inform development and interpretation of important measures by differentiating between for example gender differences. Or for example items that require more than just the construct that’s tested.

Question 2

Person fit

Answer 2

Attempts to identify individuals whose response pattern doesn’t seem to fit expected pattern.

Question 3

Computerized adaptive testing (CAT)

Answer 3

Intended to provide accurate and efficient assessment of individual trait levels. While the. person is making the test, the computer adapts the difficulty based on the correct/incorrect response to check the theta. Does so till the participant remains at one theta level.

Question 4

Checking for DIF

Answer 4

to find DIF items you divide two groups and compute the ICC. You can see whether the P differs for people who are equal on the latent variable.

Question 5

IRT advantage and disadvantage

Answer 5

Advantage;
Population and test independent
Focus on items io tests

Disadvantage
statistically complexF
Need for large sample

Question 6

CTT vs IRT

Answer 6

CTT
- Focus on sumscore
- Focus on tests
- focus on reliability of tests

IRT
- Focus on theta (latent variable score)
- Focus on item (difficulty and discrimination)
- Item scale information and CAT io reliability (which is intertwined)