19 - CAT

Question 1

Computerized Testing Pros

Answer 1

1. Time efficient
2. Increased access to services
3. Pts may disclose more
4. Comprehensive and accurate
5. Treatment utility

Question 2

Computerized Testing Challenges

Answer 2

• Impersonal
• Lack of researcher control
• Extraneous factors can influence responses
• Computer anxiety
• Different ratings in person v online
• Possibility of careless/fraudulent responding

Also, test and data security challenges

Question 3

Adaptive Testing

Answer 3

-Goal: get the most accurate info of a person’s level on a construct with the fewest possible items

Question 4

AT: Manual Administration

Answer 4

1. Skip Rules
2. Basal/Ceiling level: start at recommended level for that pt, establish basal level, then increase difficulty to reach ceiling
3. Countdown methods
   A. Classification: stop administering items once elevation is either ruled in or out (no actual score)
   B. Full Score on Elevated Scale Method: stop only if elevation is ruled out; otherwise, continue until score is generated

Question 5

CAT

Answer 5

• Based on IRT: extent to which an item reduces uncertainty of a person’s standing on a construct
• Typically used in unidimensional constructs
• Works best with large item banks
• Saves time/frustration/boredom
• Equivalent reliability, validity to full-scale counterparts (better than short-form counterparts)
• Process:
  1. Starts with 50th percentile item
  2. Based on pt’s response, they get next item that will provide most info (so either 25th or 75th percentile question); largest adjustment happens early on
  3. Continues this until it finds the level that the pt is getting 50%, and uncertainty is smaller than a predefined threshold (confidence level)

Disadvantage: assumes that if you get a difficult item correct, you would have gotten an easier one correct, may be wrong.