Brainscape's Knowledge GenomeTM

Browse over 1 million classes created by top students, professors, publishers, and experts.


See full index

5th (Final year) > Critical Appraisal > Flashcards

Critical Appraisal Flashcards

1
Q

Critical appraisal algorithm/mnemonic?

A

WSSI CCF TCA CHL

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is Internal Validity?

A

Did the intervention definitely result in the change in the dependent variable.

Affected by confounds, bias, error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is External Validity?

A

Whether your results can be applied to groups other than the one you studied. Considering: Setting, Time, Population factors.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is selection bias what are the two important (imo) types?

A

Selection bias is bias that has been introduced through the selection of groups/individuals in a study.

Sampling bias
- Sample is non-random, this can affect external validity

Attrition bias
- Loss of participants has caused a potential difference in exposure to the intervention

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is the difference between efficacy and effectiveness trials?

A

Efficacy can be defined as the performance of an intervention under ideal and controlled circumstances.

Effectiveness refers to its performance under ‘real-world’ conditions.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What are the different types of variables? (Psychology, let’s hope it applies)

A

Categorical

  • Ordinal: they have a rank
  • Nominal: No rank/order

Continuous

  • Ratio: has true zero, e.g. height, weight, bp
  • Interval: no true zero, e.g. temperature
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What questions do you need to ask when thinking about the justification of the study?

A
  1. Was there a clear gap
  2. Does this study address this gap
  3. Were the hypotheses clearly set out
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

For patient characteristics what percentage should they roughly be within each other?

A

Roughly within 5%, especially for larger studies

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is a confounder variable?

A

A variable that could have effected to the outcome. (It is correlated to both the intervention and the outcome)

If added to model and it has an effect on the results it is a confounder.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What percentage follow up is acceptable?

A

80% is good
70% is okay
60% is poor

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is Type 1 and Type 2 error?

How do you assess for each?

A

Type one error is false positive
- to assess look at the p value, <0.05 is 95%, and 0.01 is 99%.

Type two is false negative

  • To assess essentially look for power
  • 80% is good, 90% is better (90=0.1)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What percentage or beta value is acceptable for power?

A

80% is acceptable, 90% is good

  1. 1 = 90%
  2. 2 = 80%
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What can a confidence interval tell you about an intervention, how can you work this out?

A

Confidence interval can help to tell the likely effect, so they are the spread of likely effects. i.e. If the 95% confidence intervals are -5 to -15, then the effect could be as small as -5 mmHg but as large as -15mmHg.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is Intention to Treat (ITT)?

A

ITT is the principle that whatever group the pt was in, even if they stopped the intervention, they are still analysed in that group

If it is done, then it reflects practice well, it takes into account the people who will stop taking the drug due to side effects.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is Per protocol analysis?

A

Per protocol analysis, this is the opposite of ITT, and uses only the patients who complied with the treatment, shows the effect if people do adhere.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is Number needed to treat (NNT), how do you calculate this?

A

Calculate by doing 100/difference in percentage between groups.

e.g. if 50% of people die (categorical) following a new ‘life saving drug’ in the intervention arm and 60% in the placebo arm, the absolute difference is 10% and the NNT= 100/10=10.

17
Q

What does MCID stand for? What can it be used for?

A

Minimally clinically important difference.

Needed if the measurement is a questionnaire, can be used to tell if the intervention is meaningful if it has achieved the MCID.

18
Q

What is opportunity cost?

A

Opportunity cost - what service might need to be stopped if the NHS is cash strapped.

19
Q

What is the QALY?

A

Quality adjusted Life Year (QALY) for an intervention – below £30,000 for each year it provides fo good quality life.

20
Q

WHat do you need to consider in the sample point?

A
  1. Think about the sample exclusion/inclusion criteria. It can be appropriate to introduce exclusion criteria in order to target the population that may benefit, this however needs to be stated clearly. If they have not clearly stated this then the results may be misleading, as they have reduced the variance to get a statistically significant result.
    - The sample may not apply to your patient (or will apply loosely)
  2. Method for Inclusion/exclusion criteria. Scan the baseline table for patient characteristics – think how this relates to your patient(s)
  3. Look at consort diagram for any drop off
21
Q

What do you need to consider in the setting point?

A
  1. Think about setting: Community care, Primary care, Secondary care, tertiary, UK or other? This matters as:
  • The spectrum of comorbidities differ
  • The ease of diagnosis differs
  • The health system may function differently

Therefore, the Intervention may work better in certain settings.

22
Q

What do you need to consider in the intervention and control point?

A
  1. Is the intervention actually going to be applicable to your practice, think about time, resources and input.
  2. Is it an efficacy or effectiveness trial?
  3. What type of control is it?
    - Attention control
    - Usual care control

Usual care is usually actually the most meaningful, as it is pragmatically what patients will receive.

Read the Methods section.

23
Q

What do you need to consider in the Confounding/randomisation point?

A
  1. Did randomisation work?
  • Read the method – see if anything in there could have undermined the randomisation
  • Eyeball the baseline table with age and gender variables, they should be within 5% of each other for large studies
  1. If you have identified a problem ask whether that variable could be a confounder, they might have added it to the statistical model and seen if it had an effect?

If it is a confounder, have they attempted to control for it? (e.g. ANOVA etc)

24
Q

What do you need to consider in the clinically important outcomes included point?

A
  1. Any key outcomes missing. E.g. quality of life.
  2. Were the outcomes valid e.g. all the measurements measuring exactly the same thing, if questionnaire need the Minimally clinically important difference (MCID).
  3. Were the outcomes measured the same way in both groups.
25
Q

What do you need to consider in the follow up point? (4)

A
  1. Was it long enough?
    - Acute conditions 10 days – 1 month
    - Chronic conditions at least 1 year
  2. Did they follow up enough patients (attrition bias).
    i. 80% is good
    ii. 70% is okay
    iii. 60% is poor
    iv. If many were lost to follow up then this may have significantly altered the results
  3. Look at the characteristics of those lost to follow up – to see if they were different
  4. Have they tried to predict the difference
    - Last observation carried forward
    - Multiple imputation (all characteristics of sample used to predict)
26
Q

What do you need to consider in Type one and type two error?

A

Type one is false positive

  • Look at p value
  • Was the primary outcome specified in advance
  • Subgroups specified in advance
  • (if all outcomes, or many are sig. it is unlikley to be due to chance).

Type 2 error (False negative)

  • Power claculation (at least 80%/0.2)
  • MCID if questionnaire
27
Q

What do you need to consider in the confidence interval point?

A
  1. Confidence interval can help to tell the likely effect, so they are the spread of likely effects. i.e. If the 95% confidence intervals are -5 to -15, then the effect could be as small as -5 mmHg but as large as -15mmHg.

Related to effect size?

28
Q

What do you need to consider in the analysis appropriate point?

A

ITT or Per protocol

  1. ITT (intention to treat).
    - If it is done, then it reflects practice well.
  2. Per protocol analysis, shows the effect if people do adhere.

(Look at statistical methods to see which they used)

29
Q

What do you need to consider in the clinically important results section?

A

Number needed to treat (NNT) for categorical variables.

  • e.g. if 50% of people die (categorical) following a new ‘life saving drug’ in the intervention arm and 60% in the placebo arm, the absolute difference is 10% and the NNT= 100/10=10.

(Not as easy to apply to continuous outcomes as they are likely proxy measures of health)

With questionnaires you need some clue as to what the actual point change will mean, can look in methods. If MCID has been specified and achieved, it is likely to be meaningful.

30
Q

What do you need to consider in the Harms vs benefits & Costs point?

A
  1. Harms vs benefits
  2. Cost effectiveness
    - Opportunity cost
    - QALY
31
Q

What do you need to consider in the limitations and strengths point?

A

Have the limitations been acknowledged?

Any interests declared?

5th (Final year) (34 decks)

Brainscape helps you reach your goals faster, through stronger study habits.
© 2024 Bold Learning Solutions. Terms and Conditions