Chap 7 Flashcards
What is test utility ?
The usefulness or practical value of testing to improve efficiency
What are 3 main factors that affect utility ?
- psychometric soundness
- Costs
- benefits
What is utility analysis ?
it is a strategy that determines the cost/benefit ratio for specific tests to determine their utility
What are cut scores ?
A reference point to divide data into two or more classifications
What are fixed versus relative cut scores
Relative: there are norm referenced, meaning being in the top 10% of something for example
Fixed: these are criterion based meaning having to have minimal proficiency to be considered a safe driver, for example
What is the Angoff method of cut scores?
Here judges are brought in, and their average judgements provide an estimate in yielding the cut scores
What is the known groups method of cut scores ?
a discriminatory method diving people into groups of either possessing a trait or not
What is the IRT method ?
Each item has a difficulty level and test takers must pass a certain amount a minimum difficulty to move forwards
What is decision theory
strategies for optimal decision making between two options that have different risk and benefit consequences
What is sensitivity ? specificity ?
Sensitivity: if the person has the condition, this is the likelihood the test will indicate the condition is present
Specificity: if the person does not have the condition, this the likelihood the test will indicate the condition is absent
What is a positive predictive value and a negative predictive value?
Positive: If a test indicates a condition, this is the likelihood that the person actually has the condition = A/ (A +B)
Negative: If a test indicates no condition, this is the likelihood the condition is truly absent = D/ (D+C)
What is the base rate and overall accuracy ?
Base rate: the proportion of individuals with the condition of interest (hits and misses combined)
Overall accuracy: the proportion of decision that are correct (hits and correct rejections combined)
