Test Validation Flashcards
What is the purpose of validation?
To establish the truthfullness.
What is a test compared to?
a “gold standard” for accuracy.
Gold standards used for VU comparison are typically what?
- Angiography
- CTA
- MRA
- Pathology
- Re-test same day/ different tech (DVT)
What are the 4 steps in a test validation process?
- Question defined.
- Data log created and completed.
- Calculate the statistics.
- Report te statistics.
How should you define the question?
- Presence of disease.
- Severity of disease.
- Location of disease as defined.
How should a data log be designed?
- Set time limit for data
- Set population description.
- ie. patients with no intervention in carotid.
- Set parameters to be collected.
- log according to diagnostic criteria grade as indicated in the conclusion.
What are some tips for collecting data?
- Stay blinded to the opposite test while completing log.
- Keep a list of ALL exams thrown out.
When is a matrix used?
It is used when there are more than 2 categories for test results.
What are 3 parts of a matrix statistics?
- precent agreement
- percent overestimated
- percent underestimated.
What is the percent agreement?
Diagonal boxes on diagram.
How do you find the percent agreement?
(# matched)/(total)
What is the percent overestimated?
Duplex hugher grade than angio.
How do you find the percent overestimated?
(# overestimated)/(total)
*above diagonal
What is the percent underestimated?
Duplex lower grade than angio.
How do you find the percent underestimated?
(# underestimated)/(total)
*above diagonal.