Diagnostic Test Accuracy Flashcards

1
Q

What are DTAs?

A

Studies used to tell us about the accuracy of medical tests

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

When is a test useful?

A

When it changes the ability to predict whether a patient has a condition or not

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What effect should a test result have on diagnosis?

A

It should alter the probability of diagnosing the condition

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Why can’t one assume that the evaluated test accuracy is the same in different contexts, even if the same diagnostic test is used?

A

A change of context results in a change of accuracy and change of probability of outcome of the diagnostic test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Why should diagnostic tests be evaluated?

A

To avoid adoption of non-useful, non-beneficial or harmful diagnostic tests
To choose the most cost-effective of the useful diagnostic tests

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What are the two criteria that diagnostic tests have to meet to be implemented?

A

To be proven as safe
To be proven to measure what they say they measure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is important factor is not required to be proven when a diagnostic test is implemented?

A

The usefulness of the test in diagnosis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What evidence is not required when a diagnostic test is implemented?

A

The overall benefit of the diagnostic test
How the diagnostic test is best used

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What are some consequences of using inappropriate diagnostics?

A

Anxiety, discomfort and pain
Unnecessary further investigations
Waste of money
False positive results, which cause unnecessary stress and investigation
False negative results, which causes false reassurance and allows the disease to progress unnoticed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Other than different accuracy, give some positive ways in which diagnostic tests can impact on patient outcomes

A

Safer, easier to perform, faster results, less invasive,

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is required for a diagnostic test to have potential value?

A

It must be evaluated as accurate

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Give three reasons why DTA studies are useful

A

They are readily available, unlike RCTs
They do not required prohibitively big sample sizes
Answers are obtained quickly

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What are the two dimensions of test accuracy?

A

Sensitivity and specificity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What does sensitivity measure?

A

The proportion of individuals with the disease

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What does specificity measure?

A

The proportion of individuals without the disease who have negative results (true negative)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is the inverse of sensitivity?

A

False negative rate

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What is the false negative rate?

A

The proportion of individuals with the disease but a negative test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What is the inverse of specificity?

A

False positive rate

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What is the false positive rate?

A

The proportion of individuals without the disease but with a positive test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What acronym gives the DTA evaluation components?

A

PITR

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What does the P stand for in P?

A

Participants or population

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Give two examples of things which would fall under the participants/population component of DTA evaluation

A

Presentation
Prior tests

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

What does the I stand for in PITR?

A

Index test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

What is the index test?

A

The new diagnostic test which is being evaluated

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

What must be considered when evaluating the index test?

A

Whether the test is affected by the conductor or skill of the officer
Whether the test is affected by technology

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

What does the T stand for in PITR?

A

Target disorder

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

What is the Target disorder?

A

The condition that we want the index test to indentify

28
Q

What does the R stand for in PITR?

A

Reference standard

29
Q

What is a reference standard?

A

The most accurate method available to detect the target disorder

30
Q

What statistical check must be done is different reference standards are used for index positive and index negative patients?

A

It must be assessed whether there is a statistically significant difference between the two reference standard tests

31
Q

What role does the reference standard play?

A

It is a control

32
Q

What is Blinded Cross Classification?

A

A comparison of the index test and the reference standard test results for detection of a target disorder

33
Q

What are the three source of bias which can arise in DTA evaluation?

A

Spectrum bias, review bias, verification bias

34
Q

What is spectrum bias?

A

Purposefully excluding ‘difficult to diagnose’ patients

35
Q

What effect does spectrum bias have on the DTA evaluation?

A

The index test appears more accurate at diagnosing than it is

36
Q

How can spectrum bias be avoided?

A

Clear descriptions of the characteristics of the population
Avoidance of inappropriate exclusions

37
Q

What is review bias?

A

When the interpretation of an index test is not independent and blind to the reference standard

38
Q

What effect does review bias have on the DTA evaluation?

A

It makes the index test seem more accurate than it is

39
Q

How can review bias be avoided?

A

Ensure interpretation of the index test was independent and blinded to interpretation of the reference standard, and vice versa

40
Q

What is verification bias?

A

The tendency not to give the reference standard test to patients who were negative on the index test, because the reference

41
Q

What is verification bias?

A

The tendency not to give the reference standard test to patients who were negative on the index test, because the reference standard is more invasive

42
Q

How can verification bias be avoided?

A

Ensure all patients have both the index test and reference standard test, regardless of result

43
Q

What is the effect of verification bias on the DTA evaluation?

A

Over/underestimation of the index test accuracy

44
Q

What four questions need to be asked to apply the results of a DTA evaluation/what factors contribute to the impact of test use on patient outcomes?

A

Was there a clear study question?
Is the study population similar to patients in my practice?
Can the index test be applied in the same way in my healthcare setting?
Does the definition of the target condition match the condition I want to identify in my practice?

45
Q

What are the four steps to critically appraising a DTA study?

A

Construct a diagnostic 2*2 table
Assess sensitivity and specificity
Assess precision for the estimates of accuracy
Evaluate consequences for patients

46
Q

What is sensitivity (in a DTA)?

A

The proportion of true positive results in individuals with the target condition

47
Q

How is sensitivity calculated?

A

True positive results/True positive results + False negative results

48
Q

What does sensitivity indicate in terms of usefulness of the test?

A

How good a test is at ruling out a condition

49
Q

What does sensitivity indicate in terms of false results?

A

The magnitude of false negatives

50
Q

How can sensitivity be expressed in terms of probability?

A

The probability that a patient has a positive test, given that they have the disease

51
Q

A negative test with high sensitivity will be better at doing what?

A

Ruling out a condition

52
Q

When is a highly sensitive test less reliable?

A

When the test result is positive

53
Q

What does a highly sensitive test have fewer of?

A

False negatives

54
Q

If a patient is negative on an index test with high sensitivity, what does this mean statistically?

A

They are statistically more likely to be a true negative

55
Q

What is specificity (in a DTA)?

A

The proportion of true negative results in those without the target condition

56
Q

How is specificity calculated?

A

True negative results/True negative results + False positive results

57
Q

What does specificity indicate in terms of usefulness of a test?

A

How good a test is at ruling in a condition

58
Q

What does specificity indicate in terms of false results?

A

The magnitude of false positives

59
Q

How can specificity be expressed in terms of probability?

A

The probability that the result is negative, given that the patient is well

60
Q

A positive test with high specificity will be better at doing what?

A

Ruling in a condition

61
Q

When is a highly specific test less reliable?

A

When the result is negative

62
Q

What does a highly specific test have fewer of?

A

False positives

63
Q

If a patient is positive on an index test with high specificity, what does this mean statistically?

A

They are more likely to be a true positive

64
Q

When is a test considered uninformative?

A

When specificity or sensitivity are below 50%

65
Q

What is used to assess the precision of an estimate of accuracy of a diagnostic test?

A

Confidence intervals

66
Q

Give 3 consequences of false positives for patients

A

Unnecessary intervention with associated risks
Unnecessary stress and anxiety
Waste of money and time

67
Q

Give 3 consequences of false negatives for patients

A

Delayed diagnosis
Disease progression
Need for more invasive intervention later