DTA Flashcards

1
Q

Why do we use diagnostic tests?

A

Detect/exclude disease, reassure we are not missing something, medico-legal or financial reasons, follow protocol, easy

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

How would you evaluate histories/examinations?

A

Consider them at diagnostic tests (DTA studies)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Why do we evaluate a medical test?

A

See if it will benefit a patients, cost considerations with similar efficacy, avoid evaluation bypass

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Are medical tests or treatments regulated more?

A

Treatments

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Which agency regulates medical tests?

A

Medical healthcare regulatory agency (MHRA)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What does the MHRA require of tests?

A

They are safe and measure what they say they do

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What can be a big contributing pressure to medical tests and why?

A

Commercial pressure, as there is no requirement for the manufacturers to prove the benefit or say how it is best used.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What are consequences of inappropriate testing?

A

Cost, anxiety, discomfort, pain, unnecessary further treatments and adverse effects

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What are consequences of false negatives?

A

Wrongly reassure patient, missed diseases, infectious diseases spread

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What makes clinicians use one test over another?

A

Accuracy, cost, ease of use, quicker to give results, less invasive, safer, test process

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What do DTAS compare?

A

Presence of condition estimated with index test compared to reference standard

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Which 3 types of bias are important for internal validity of DTAS?

A

Spectrum, verification and review

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

When is a test useful?

A

Changes our ability to predict if person has a condition or not

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

In what circumstances does improved test accuracy not lead to improved patient outcome?

A

Not acted upon appropriately, practitioner error, diagnosis not changed, treatment errors

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What aspects of a test are evaluated?

A

Accuracy, safety, benefit to patient, harm to patient, will a colleague get same result

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

In what ways can the administration of a test impact the patient outcomes?

A

Test process, timing test, feasibility of test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

In what ways can the production of test results affect the patient?

A

Diagnostic test accuracy, timing of results, interpretability of results

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

In what ways can the diagnostic decision based on a test affect the patient?

A

Timing of diagnosis, diagnostic yield, diagnostic confidence

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

In what ways can the way the treatment decision is made based on a test affect the patient?

A

Therapeutic yield and confidence

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

In what ways can treatment implementation based on a diagnostic test vary and affect the patient?

A

Adherence and timing of treatment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What 2 things impact patients in outcome of a diagnostic test?

A

Treatment and test harms and direct effects

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What are diagnostic tests used for?

A

Screening, diagnosis and surveillance

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

What percentage of diagnostic tests have no diagnostic errors?

A

1%

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

What are the 2 components of test accuracy?

A

Sensitivity and specificity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

What is sensitivity?

A

The proportion of those with the disease that the test detects

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

What is specificity?

A

The proportion of those without the disease that have a negative result (e.g. 100% = no false positives)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

What are the 4 steps of the basic design to assess test accuracy?

A
  1. Collect of patients suspected to have target disorder (similar to those test would be used on in practice)
  2. Perform index test
  3. Perform reference standard (assumed to be more accurate)
  4. Blinded cross-classification to compare results
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

What are the components of a test accuracy question?

A

PITR: Participants, index test, target disorder, reference standard

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

What is important to identify about the population in a DTA question?

A

Presentation of disorder (presence of symptoms, severity and duration) and any prior tests

30
Q

What is important to identify about index tests in the question in order to apply in own setting?

A

The conduct (experience/skill of operator) and technology (old/new, fixed/mobile)

31
Q

Can the reference standard comprise of more than 1 test?

A

Yes

32
Q

What is the composite reference standard?

A

Combines results of several available tests to produce better indicator of true disease status?

33
Q

What 4 questions do we need to appraise with DTAS?

A
  1. Internal validity (bias potential)
  2. What are results? (Numerical expression of test accuracy)
  3. Can I apply results to own patients?
  4. What would be impact of using index test in own patients?
34
Q

What is spectrum bias?

A

‘Difficult to diagnose’ patients purposefully excluded so test appears more accurate

35
Q

What shows a DTAS does not have spectrum bias?

A

Characteristics of population clearly described and the study avoids inappropriate exclusions (representative of those who would be tested in practice as suspected of having disease)

36
Q

What is review bias?

A

Interpretation of an index test is not independent (and blind to) the reference standard and vice versa

37
Q

What is verification bias?

A

A tendency for patients with negative index tests not to get the reference standard (esp if more invasive or difficult to access)

38
Q

What does verification bias result in?

A

A tendency in over or under estimation of accuracy of index test

39
Q

What description shows that all patients had all tests?

A

Fully paired

40
Q

What should you consider when looking at the results of DTAS?

A
  • Sensitivity & specificity: including precision and statistical significance of these measures of accuracy
  • False negatives/positives and their consequences
41
Q

Does sensitivity correlate to false positives or negatives?

A

False negatives

42
Q

Does specificity correlate to false negatives or positives?

A

False Positives

43
Q

When is sensitivity useful?

A

Ruling out a condition

44
Q

When is specificity useful?

A

Ruling in a condition

45
Q

What does a sensitivity or specificity of 0.5 indicate?

A

The test is uninformative

46
Q

What adds up to 100% with sensitivity?

A

False negative rate

47
Q

What does the 95% CI indicate?

A

That 95% of the time the true result is within this limit

48
Q

Which 4 questions should you ask to determine applicability of DTAS?

A
  1. Clear study question?
  2. Population similar to own patients?
  3. Can index test be applied in the same way?
  4. Does definition of target condition match the one you want to identify in practice?
49
Q

What elements of the study population should you consider when looking at applicability?

A
  • Presentation of symptoms in terms of severity, duration and associated symptoms
  • Prior tests: e.g. HX, examination
50
Q

Which elements of the index test should you look at for applicability of DTAS?

A
  • Technology: old/new, manufacturers, fixed/mobile, lab/bedside (rapid)
  • Who performs and interprets: experience & skill
51
Q

Which outcomes important for the patient should be considered by DTAS?

A

Safety, anxiety, repeatability, benefit for patient

52
Q

Does the reference standard or index test need to be more accurate?

A

Reference standard!

53
Q

What variation could change the prior tests, target condition and index tests so must be mentioned in the question?

A

The setting! E.g. GP vs A&E

54
Q

When is a medical test useful?

A

Changes our ability to predict if an individual has a condition or not

55
Q

What determines the potential for medical tests to do harm?

A

The size and type of medical test errors

56
Q

What is important to assess when evaluating the validity of a test accuracy study?

A

Spectrum bias, review bias and verification bias

57
Q

What are key factors to consider when judging generalisability of test accuracy estimates?

A

Spectrum of population to be tested and way index test was conducted

58
Q

Which framework do you use to critically appraise DTAS?

A

CASP

59
Q

What do the 2 initial screening questions in the CASP tool look at?

A

PITR and the reference standard

60
Q

What is partial verification bias?

A

The result of the index test determined if the reference standard is received

61
Q

What is differential verification bias?

A

Different patients receive different reference standards

62
Q

Which aspects of the disease status should be clearly described to eliminate the possibility of spectrum bias?

A

Presenting symptoms, prior tests, disease severity, exclusion criteria

63
Q

What does an ROC curve plot?

A

Sensitivity against specificity

64
Q

If more than 1 index test is being compared, how do you assess if accuracy differences have occurred by chance?

A

Using p values and if CIs for estimates of sensitivity and specificity overlap

65
Q

What is an artificial decision?

A

Where test accuracy is not based on using real time clinical decisions. eg if clinician knows their diagnosis is being reviewed they may have more confidence leading to falsely increased accuracy of index test.

66
Q

What should you consider when looking at the outcomes importance to the individual or population?

A

Whether maximising sensitivity (correct identification of positives) or specificity (reducing harm due to false positive) is more important

67
Q

Which research method do you need to adopt to identify impact of test use on patient outcome?

A

Trial of test use

68
Q

What is pre-test probability?

A

The probability a patient will have the disease prior to index test e.g. based on signs and symptoms (clinical evaluation)

69
Q

What is post-test probability based on?

A

The probability the patient has a disease based on the pre-test probability, sensitivity and specificity and result of the index test

70
Q

If a post-test probability is not altered much by getting a positive result, what does this mean?

A

The specificity is low and the number of false positives is large