MDM Flashcards

1
Q

What is the Y-axis on a receiver operating curve?

A

True positive rate = sensitivity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is negative predictive value?

A

If the test result is negative, the chance the patient does not have disease

Negative predictive value = TN / (TN+FN)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Draw a 2x2 table for a diagnostic study

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is the formula for negative likelihood ratio?

A

LR- = P(negative result in diseased person) / P(negative result in non-diseased person)

= false negative rate / true negative rate

= [FN/(TP+FN)] / [TN/(FP+TN)]

= (1 – sensitivity) / specificity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Increased sensitivity is related to [direction, sign] predictive value

A

Increased sensitivity is related to increased negative predictive value

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

When is specificity prioritized in diagnostic testing?

A

When you need a very accurate diagnosis

  • Treatment is very morbid (e.g. chemo)
  • Label can be harmful (e.g. HIV)
  • Later in the work up
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Describe the important points about sensitivity

A

Given the presence of disease, the probability that a test will be positive

Minimize false negatives

SNOUT - sensitivity, rule out

Most useful when test is negative

Increased negative predictive value

Screening

Sensitivity = TP / (TP+FN)

(use left column)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is the likelihood ratio?

What advantages does it have over sensitivity and specificity?

What is it used to calculate?

What is the formula for likelihood ratio?

A

Another way to describe the performance of a test

Can be used across a spectrum of test

Used to calculate post-test probability of a disease

LR = P(result in diseased person) / P(result in non-diseased person)

= true rate / false rate

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Negative LR is influenced by ______

A

Sensitivity

(important to rule out disease)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is a completely unhelpful LR?

A

1

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Is specificity used to rule in or out?

A

SPIN - specificity, rule in

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is serial testing?

When is it used?

A

Do tests in sequence

Only do next test if first one is positive, so all tests done must be positive to label w/ diagnosis

  • Rapid assessment not needed
  • Tests are expensive or risky
  • Want to maximize specificity
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is the X-axis on a receiver operating curve?

A

False positive rate = 1 – specificity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is an index test?

Why is it used?

A

The test that we are studying

Always want easier and cheaper tests that give same info as gold standard

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is negative post-test probability?

A

If patient has a negative test result, the probability the disease is still present but the test missed it

Negative post-test probability = FN / (TN+FN)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is the best positive LR?

A

Infinity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What are three important uses of the receiver operating curve?

A
  • Comparing the performance of two or more tests
  • Determining the best cutoff value of a test to determine disease versus no disease
  • Understanding how good a test is overall (area under the curve)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

When is parallel testing used?

A
  • Rapid assessment necessary
  • Patient cannot return easily
  • Costs of tests relatively low
  • Want to maximizine sensitivity
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What is spectrum bias?

A

Performance of diagnostic test varies because the people tested are not part of a clinically relevant population

Occurs if a study population does not represent a true diagnostic dilemma

Affects external validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Is sensitivity more useful for screening or confirming a diagnosis?

A

Sensitivity is useful for screening

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Describe the important points about specificity

A

Given the absence of disease, the probability that a test will be negative

Minimize false positives

SPIN - specificity, rule in

Most useful when test is positive

Increased positive predictive valuie

Confirming a diagnosis

Specificity = TN / (FP+TN)

(use right column)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What is the best negative LR?

A

0

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

What three things do you need to calculate post-test probability?

A
  • Sensitivity of the test
  • Specificity of the test
  • Pre-test probability (prevalence) of disease
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

When would you want a more specific test?

A

When you do not want to falsely label someone

  • Late in diagnostic workup
  • When false positives can harm patient (label is harmful, treatment is risky)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Why is diagnostic dilemma a criteria for performing a test?
A test is most helpful when it helps reduce uncertainty Performing a test in a patient whose diagnosis is known is not helpful Tests are most helpful when they distinguish between 2+ likely diagnoses
26
What is a useless test on a receiver operating curve?
Area under curve = 0.5
27
What is a perfect test on a receiver operating curve?
Area under curve = 1
28
What is a gold standard test?
A test generally accepted to be definitive in diagnosis of disease, reference test
29
What is a receiver operating curve?
Visual representation of the relationship between sensitivity and specificity Slope = positive LR X-axis: false positive rate = 1 – specificity Y-axis: true positive rate: sensitivity
30
What is the formula for specificity?
Specificity = TN / (FP+TN) Use right column
31
If prevalence increases, what happens to positive and negative predictive value?
If prevalence (pre-test probability) increases: Positiive predictive value increases Negative predictive value decreases
32
What is post-test probability?
Given a certain test result, what is the probability of disease?
33
How do you convert pre-test probability to post-test probability?
1. Pre-test probability to pre-test odds using odds = probability / (1 – probability) 2. Pre-test odds to post-test odds using pre-test odds x LR = post-test odds 3. Post-test odds to post-test probability using probability = odds / (1 + odds)
34
When would you want a more sensitive test?
When you cannot miss anyone with the disease * Dangerous, treatable illness * Screening * Early in workup when several diagnoses are being considered
35
Differentiate sensitivity/specificity from predictive value
* Sensitivity and specificity are characteristics of the test itself * Predictive value tells us how the test will perform in the population
36
What is the formula for positive likelihood ratio?
LR+ = P(positive result in diseased person) / P( positive result in non-diseased person) = true positive rate / false positive rate = [TP/(TP+FN)] / [FP/(FP+TN)] = sensitivity / (1 – specificity)
37
Why do we perform diagnostic tests?
Reduce uncertainty about the true condition of the patient * Distinguish between disease and no disease * Provide prognostic information * Determine response to therapy * Provide reassurance
38
How can you convert odds into probability?
Probability = odds / (1 + odds)
39
In calculating a likelihood ratio, sensitivity is in the _____ and specificity is in the \_\_\_\_\_
In calculating LR, * sensitivity is in the numerator * specificity is in the denominator
40
What is specificity? How do you calculate specificity?
Given the absence of disease, the probability that a test will be negative Specificity = TN / (FP+TN) (use right column)
41
Say you use a serial testing strategy with three tests. How can you easily calculate the post-test odds?
Pre-test odds x LR1 x LR2 x LR3 = Post-test odds
42
When is serial testing used?
* Rapid assessment not needed * Tests are expensive or risky * Want to maximize specificity
43
Draw a 2x2 table with formulas for positive and negative likelihood ratio
44
Draw a 2x2 table with formulas for positive and negative predictive value and positive and negative post-test probability
45
When are sensitive tests most useful?
When they are negative | (rule out the disease in question)
46
What is positive post-test probability?
If patient has a positive test result, the probability a disease is present Positive post-test probability = TP / (TP+FP)
47
When are specific tests most useful?
When they are positive and rule in the disease in question
48
What is the relationship between positive predictive value and positive post-test probability?
Positive predictive value = positive post-test probability = TP / (TP+FP) (use top row)
49
What is the formula for sensitivity?
Sensitivity = TP / (TP+FN) Use left column
50
What is the relationship between negative post-test probability and negative predictive value?
Negative post-test probability = 1 – negative predictive value (use bottom row)
51
What is the relationship between pre-test odds, LR, and post-test odds?
Pre-test odds x LR = Post-test Odds
52
What is the formula for positive post-test probability?
Positive post-test probability = TP / (TP+FP) (use top row)
53
How can you convert probability into odds?
Odds = probability / (1 – probability)
54
Increased specificity is related to [direction, sign] predictive value
Increased specificity is related to increased positive predictive value
55
What is the formula for negative post-test probability?
Negative post-test probability = FN / (TN+FN) (use bottom row)
56
What is prevalence? What is the formula for prevalence?
Proportion of individuals in a population who have a given clinical characteristic at a given point in time At time point X: Prevalence = cases of disease / entire population
57
Positive LR is influenced by \_\_\_\_\_\_
Specificity | (important to rule in diseasea)
58
What types of bias can be present in a diagnostic study?
* Spectrum bias (affecting external validity) * Selection bias (test referral bias, in which haveing a positive test makes it more likely that a subject also gets the gold standard test) * Measurement bias (non-blinding, inaccurate measurements, inaccurate gold standard)
59
What occurs if all tests are negative in a parallel testing strategy?
False negatives decrease Sensitivity increases
60
What is incidence? What is the formula for incidence?
The number of new cases of disease that accumulate during a specified time period divided by the number of persons in population at risk From time period A to B: Incidence = new cases of disease / population without disease at time A
61
Is specificity more useful for screening or confirming a diagnosis?
Specificity is useful for confirming a diagnosis
62
What is sensitivity? How do you calculate sensitivity?
Given the presence of disease, the probability that a test will be positive Sensitivity = TP / (TP+FN) (use left column)
63
Is sensitivity used to rule in or out?
SNOUT - sensitivity, rule out
64
Which tests do participants in a diagnosis study receive?
Every patients gets both index test and gold standard test
65
What is positive predictive value?
If test result is positive, the chances the patient has the disease Positive predictive value = TP / (TP+FP)
66
What do you look at to see if a test is a good test on an ROC?
Area under the curve (the higher the AUC, the better the test)
67
What is parallel testing? When is it used?
Do all tests at the same time Need only one positive to label w/ diagnosis * Rapid assessment necessary * Patient cannot return easily * Costs of tests relatively low * Want to maximizine sensitivity
68
What occurs with each subsequent positive result in a serial testing strategy?
False positives decrease Specificity increases
69
When is sensitivity prioritized in diagnostic testing?
When you cannot miss a diagnosis * Screening * Early in the work up * Terrible but treatable diseases (TB, syphillis, etc)