Diagnostic Test Accuracy Studies Flashcards

1
Q

Reasons for carrying out a diagnostic test

A

Detection / exclusion - we need to rule out a disease/
Make sure you’re not missing anything out
Legal / financial reasons
Protocols
The patient should be better off for having a diagnostic test (the probability of the condition before the test should be altered by the test result)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Name 2 reasons why it is important to evaluate medical tests?

A

avoiding evaluation bypass

medical tests are not regulated in the same way as treatments

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What 3 things might cause evaluation bias?

A

enthusiasms
convictions
commercial pressure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are the consequences of false positives?

A

stress + anxiety

unnecessary further tests and treatement

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What are the consequences of false negatives?

A

wrongly reassures patients
results in disease being missed
harm to others (infectious diseases)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

How might a new test be beneficial even if it has a slightly worse accuracy?

A
cheaper
easier
less invasive
safer
quicker
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What about a DTA makes is a useful indication of the potential value of a test?

A

they are readily available in contrast to test treat RCTs
they don’t require prohibitively large sample sizes
answers can be obtained quickly

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is sensitivity in DTA?

A

what proportion of those with the disease does the test detect?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is specificity in DTA?

A

what proportion of those without the disease get negative test results?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What are the components of PITR?

A

Participants (presentation, prior tests before index test)
Index test (conduct, technology)
Target disorder
Reference standard (the most accurate method available of detecting the target disorder)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What do we mean by blinded cross-classification?

A

comparing the results of the index test and reference standard for detection of target disorder

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Name 3 key sources of bias in a DTA

A

Spectrum bias
Review bias
Verification bias

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

When might spectrum bias arise?

What questions might combat this?

A

If ‘difficult to diagnose’ patients are purposefully excluded –this will make the index test appear more accurate than it will be in practice

Are characteristics of the tested population clearly described; did the study avoid inappropriate exclusions?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

When might review bias arise?

What questions might combat this?

A

If interpretation of the index test is not independent (and blind) of the reference standard -this has the potential to make the index test appear more accurate than it actually is

Was the index test interpreted without knowledge of (blind to) the reference standard result and vice versa?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

When might verification bias arise?

What questions might combat this?

A

There is a tendency for patients with negative index test results not to get the reference standard -this will result in over or under estimation of the accuracy of the index test

Did all the participants get both index test and reference standard?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What sensitivity / specificity value would be indicative of an uninformative test?

A

0.5

50%

17
Q

What would a high sensitivity suggest about false negative rate?

A

high sensitivity -> low FN rate

18
Q

What would a high specificity suggest about false positive rate?

A

high specificity -> low FP rate