Critical Appraisal of medical literature Flashcards

1
Q

PICO

A

P- population
I- intervention
C- community
O- outcome

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is a Randomized Controlled Trial (RCT)?

A

An RCT is a scientific experiment designed to test interventions in an unbiased way, ensuring that the results are reliable and valid.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What does “Randomized” mean in the context of an RCT?

A

“Randomized” means that participants are randomly allocated to different treatment groups, which helps eliminate selection bias and ensures that the groups are comparable.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What does “Controlled” mean in an RCT?

A

“Controlled” means that there is a control group, which may receive no treatment or the standard of care, allowing for a comparison between the treatment and control conditions.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What does “Double-Blinded” mean in an RCT?

A

“Double-Blinded” means that neither the investigator nor the participant knows which group (intervention or control) the participant is in, reducing bias in treatment administration and outcome assessment.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Why are these features important in an RCT?

A

These features are crucial because they help:

  1. Minimize Bias: Randomization and blinding reduce the risk of selection bias, performance bias, and detection bias, leading to more reliable and valid results.
  2. Ensure Comparability: Random allocation ensures that the treatment and control groups are similar at baseline, making it easier to attribute differences in outcomes to the intervention.
  3. Enhance Validity: Double-blinding helps ensure that the results are not influenced by the expectations or beliefs of the researchers or participants, enhancing the study’s internal validity.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Sources of error

A

Random error
- chance

Bias
- Selection bias
- Information bias
- Cofounding

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is bias in the context of research studies?

A

Bias is a systematic error that leads to a statistical overestimation or underestimation of the population parameter being measured.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What are the main types of bias in research studies?

A

The main types of bias include:

  1. Selection bias
  2. Information bias
  3. Recall bias
  4. Confounding
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is selection bias?

A

Selection bias occurs when there is poor or no randomization, causing the two groups in a study to be different and not comparable.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is information bias?

A

Information bias occurs when there is misclassification or measurement error, such as using a scale that has not been zeroed, leading to inaccurate data collection

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is recall bias and when is it most likely to occur?

A

Recall bias occurs when participants remember past events inaccurately, often seen in retrospective studies where memories may be influenced by personal experiences.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is confounding?

A

Confounding is a form of bias where an outside variable influences both the independent variable and the dependent variable, leading to a spurious association.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Can confounding be corrected after the trial is complete?

A

Yes, confounding can generally be corrected for through statistical adjustments after the trial is complete.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Can you give an example of information bias?

A

An example of information bias is measurement bias, such as when a scale that has not been zeroed makes everyone appear 5 kg heavier than they really are.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What are some other types of bias in research?

A

Other types of bias include:

  1. Survivorship bias
  2. Omitted variable bias
  3. Observer bias
  4. Funding bias
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

How can bias be minimized in research studies?

A

Bias can be minimized by designing the study well, including proper randomization, blinding, accurate measurement tools, and appropriate statistical adjustments.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Cofounding definition

A

Occurs when estimate of association between exposure & disease (outcome) is wholly or partly due to effect of another exposure on the same disease (outcome), & the two exposures are correlated

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Why should we randomise interventions?

A
  1. Randomisation unbiased comparison between groups
    controls for known and unknown confounding variables
  2. balanced groups with same prognostic variables
  3. If all groups are prognostically balanced, a difference in outcomes may be attributed to the intervention.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What is a placebo?

A

A placebo is an intervention (substance or treatment) that has no intended therapeutic value and does not contain the active substance that affects health.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What is the placebo effect?

A

The placebo effect is a beneficial effect produced by a placebo drug or treatment, not attributable to the properties of the placebo itself, but rather due to the patient’s belief in that treatment.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What is the standard of care?

A

The standard of care is the treatment agreed upon by experts to be appropriate, acceptable, and widely used for a particular condition.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Why is having a control group important in clinical trials?

A

Having a control group is important because it allows for comparison to determine if the intervention has a true effect. The control group may receive a placebo or standard of care to provide a baseline for comparison.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Why might it be unethical to use a placebo in some clinical trials?

A

It might be unethical to use a placebo if there is already a proven, effective treatment for a condition. Omitting this treatment would be negligent and could harm patients.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

How does the placebo effect impact the interpretation of clinical trial results?

A

The placebo effect can cause changes or perceived changes in patients, even if there is no active substance in the placebo. Without a control group, it is difficult to determine if the observed effect is due to the intervention or just a placebo effect.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

How does comparing the effect of an intervention to a placebo help in clinical trials?

A

Comparing the effect of an intervention to a placebo helps determine if the intervention has an additional effect beyond the placebo effect, indicating a true therapeutic benefit.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

What is the endpoint?

A

The endpoint is the outcome we are looking at

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

Primary endpoint

A

Main result measured at endof a study to see if a given treatment worked

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

Clinical endpoint

A

Occurrence of a disease, symptom, or sign that constitutes one of the target outcomes of the trial

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

Secondary endpoint

A

Other result (s) being measured at different time points of the study to assess impact of intervention

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

Surrogate endpoint

A

Measure of effect of treatment that may correlate with a realclinical endpointbut does not have a guaranteed relationship, e.g. laboratory marker

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

Composite endpoint

A

A composite endpoint combines two primary outcomes together. This may be if patients develop vomiting and/or diarrhoea or something like heart failure and/or death.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

What is the purpose of measures of effect or association in epidemiology?

A

The purpose is to determine if a disease (outcome) is more common in one (exposed) population compared with another (unexposed) population by comparing the frequency of the disease in both populations.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

How do we compare the frequency of disease in exposed and unexposed populations?

A

By calculating and comparing the incidence or prevalence of the disease in the exposed group to the incidence or prevalence in the unexposed group

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

How can the size of the effect or relationship between a disease/outcome and exposure be measured?

A

The size of the effect can be measured by calculating ratios or differences between the frequencies of the disease in the exposed and unexposed populations.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
36
Q

What is the Risk Ratio (Relative Risk) and how is it calculated?

A

The Risk Ratio (Relative Risk) is a measure of association that compares the risk of a disease/outcome in the exposed group to the risk in the unexposed group. It is calculated as:

RiskRatio = IncidenceinExposedGroup
/ IncidenceinUnexposedGroup

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
37
Q

What is the Odds Ratio and how is it used in studies?

A

The Odds Ratio is a measure of association that compares the odds of a disease/outcome occurring in the exposed group to the odds in the unexposed group. It is commonly used in case-control studies.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
38
Q

Absolute measures of effect

A

Calculate excess risk caused by exposure in the exposed compared to unexposed group.
- Rate difference
- Rate difference percent
- Risk difference
- Risk difference percent

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
39
Q

Risk (Absolute risk- AR)

A

Is the probability of occurrence of disease

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
40
Q

Odds

A

Ratio of probability of outcome in exposed group to probability in of outcome in unexposed group

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
41
Q

Odds ration (OR)

A

Comparison of odds in unexposed and exposed groups

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
42
Q

Risk ratio (RR)

A

Comparison of risk in unexposed and exposed groups

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
43
Q

Hazard ratio (HR)

A

Comparison between the probability of events in a treatment group, compared to probability of events in a control group

Used to see if patients receiving a treatment progress faster (or slower) than those not receiving treatment.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
44
Q

Absolute risk reduction (ARR)

A

Amount by which therapy/intervention reduces risk of bad outcome

Difference in AR between two groups

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
45
Q

Number needed to treat (NNT)

A

): Number needed to treat in order to prevent one additional bad outcome

NNT =1/ ARR

46
Q

Normal distribution

A

mean= median

47
Q

hypothesis testing in research

A
  1. hypothesis
  2. null hypothesis (H0)
  3. alternative hypothesis (H1)
48
Q

Hypothesis

A

A precise, testable statement predicting the outcome of the study

49
Q

Null hypothesis (H0)

A

There is no difference in outcome estimate between two groups

50
Q

Alternative hypothesis (H1)

A

There is a difference between two groups

51
Q

What is a p-value?

A

A p-value is the probability of obtaining the observed result, or something more extreme, if the null hypothesis is true. It indicates how likely it is that the observed difference between treatments occurred by chance.

52
Q

What does a p-value represent if the null hypothesis is true?

A

If the null hypothesis is true (i.e., treatments A and B are equally effective), the p-value represents the probability of getting a difference as large as the one observed purely by chance.

53
Q

What does a p-value less than 0.05 indicate?

A

A p-value less than 0.05 indicates strong evidence against the null hypothesis, suggesting that the observed difference is unlikely to have occurred by chance alone. This result is considered statistically significant.

54
Q

What does a p-value greater than 0.05 indicate?

A

A p-value greater than 0.05 indicates a lack of evidence against the null hypothesis, suggesting that the observed difference could have occurred by chance. This result is not considered statistically significant.

55
Q

What is the range of values for a probability?

A

Probability can range from 0 to 1, with higher values (closer to 1) indicating a more likely event.

56
Q

What does a p-value of 0.5 mean?

A

A p-value of 0.5 means that there is a 50% probability that the observed result occurred by chance if the null hypothesis is true. This is quite high, indicating no strong evidence against the null hypothesis.

57
Q

What does a p-value of 0.05 mean?

A

A p-value of 0.05 means there is a 5% probability that the observed result occurred by chance if the null hypothesis is true. This is relatively low, providing some evidence against the null hypothesis.

58
Q

When is a result considered statistically significant?

A

A result is considered statistically significant if the p-value is less than 0.05, indicating that the observed difference is unlikely to have occurred by chance alone.

59
Q

How does a smaller p-value affect the null hypothesis?

A

A smaller p-value provides stronger evidence to reject the null hypothesis, suggesting a true difference between treatments.

60
Q

What does a larger p-value indicate about the evidence against the null hypothesis?

A

A larger p-value indicates a lack of evidence to reject the null hypothesis, suggesting the observed result may have occurred by chance in populations with no difference between treatments.

61
Q

What is a confidence interval?

A

A confidence interval is a range within which the true population mean is expected to lie, based on sample data.

62
Q

What does a 95% confidence interval imply?

A

A 95% confidence interval implies that if we repeat the experiment 100 times, on 95 occasions, the true population estimate will lie within this interval.

63
Q

What does a narrow confidence interval indicate?

A

A narrow confidence interval indicates more precision in the estimate of the population mean.

64
Q

What does a wider confidence interval indicate?

A

A wider confidence interval indicates less precision in the estimate of the population mean.

65
Q

What factors influence the width of a confidence interval?

A

The width of a confidence interval is influenced by the variability of the data (standard deviation) and the sample size.

66
Q

Why do we use samples in statistics?

A

We use samples to gather data and infer something about the population because it is often impractical to investigate the entire population.

67
Q

Why might a sample not represent the underlying population well?

A

A sample might not represent the population well due to chance inclusion of outliers or bias in selection and measurement.

68
Q

How do confidence intervals help in statistical inference?

A

Confidence intervals construct a range of values around the sample mean within which we can be confident the true population mean will lie.

69
Q

How do we calculate the 95% confidence interval using sample data?

A

Using the sample data and a margin of error (based on sample size and variability), we calculate the 95% confidence interval, which tells us the range within which the true population mean is expected to lie.

70
Q

What does a 95% confidence interval tell us about the population mean?

A

A 95% confidence interval tells us that we are 95% confident that the population mean lies within this interval.

71
Q

How does sample size affect the width of confidence intervals?

A

Larger sample sizes usually result in narrower confidence intervals, making the estimate more precise.

72
Q

How does data variability affect the width of confidence intervals?

A

Higher variability in data (larger standard deviation) leads to wider confidence intervals, indicating less precision.

73
Q

What is the difference between confidence intervals and standard deviations?

A

Confidence intervals apply to the population parameter, indicating where the true mean lies, while standard deviations describe the spread of sample data values.

74
Q

What is a common misinterpretation of a 95% confidence interval?

A

A common misinterpretation is thinking that 95% of the sample values lie within the confidence interval, whereas it actually means we are 95% confident that the population parameter is within that range.

75
Q

What does it mean to correctly reject the null hypothesis?

A

It means our study shows a statistically significant result because such an effect truly exists in the population (true positive).

76
Q

What is the power of a study?

A

The power of a study is the probability of correctly rejecting the null hypothesis when it is false.

77
Q

What does it mean to correctly fail to reject the null hypothesis?

A

It means our study shows no difference or effect associated with an intervention because no effect truly exists (true negative).

78
Q

What is a Type 1 error in hypothesis testing?

A

A Type 1 error occurs when we incorrectly reject the null hypothesis even though it is true.

79
Q

What is the probability of making a Type 1 error?

A

The probability of making a Type 1 error is called alpha (α), which is equal to the p-value threshold set. For example, if we set a p-value of less than 0.05 as significant, the risk of incorrectly rejecting the null hypothesis is less than 5 in 100.

80
Q

What is a Type 2 error?

A

A Type 2 error occurs when our study shows no effect associated with an intervention, even though an effect truly exists in the population, leading us to incorrectly fail to reject the null hypothesis when it is false.

81
Q

What is the probability of making a Type 2 error?

A

The probability of making a Type 2 error is denoted by beta (β).

82
Q

What does the alpha level represent in hypothesis testing?

A

The alpha level represents the threshold for significance, the probability of rejecting the null hypothesis when it is true (Type 1 error). It is commonly set at 0.05.

83
Q

What does the beta level represent in hypothesis testing?

A

The beta level represents the probability of failing to reject the null hypothesis when it is false (Type 2 error).

84
Q

How is the alpha level related to the power of a study?

A

Lowering the alpha level reduces the probability of a Type 1 error but can also reduce the power of the study, making it harder to detect a true effect.

85
Q

How is the beta level related to the power of a study?

A

The power of a study is 1 - beta. Reducing the beta level increases the power of the study, improving the ability to detect a true effect.

86
Q

How does sample size affect the significance level and power of a study?

A

Larger sample sizes generally increase the power of a study and decrease the margin of error, making it easier to detect true effects and reduce the likelihood of Type 1 and Type 2 errors.

87
Q

What is the power of a study?

A

The power of a study is the probability of finding an effect in a sample if such an effect truly exists in the population.

88
Q

How do you critically appraise the power of a study?

A

To critically appraise the power of a study, assess if the study recruited enough participants to detect an effect, if one exists.

89
Q

What is the formula for calculating study power?

A

Power = 1 - β, where β is the probability of making a Type 2 error.

90
Q

How does study power relate to Type 2 error?

A

Lowering the probability of a Type 2 error (β) increases the power of the study

91
Q

How can study power be increased?

A

Study power can be increased by:

  • Increasing the sample size
  • Increasing the effect size
  • Reducing variability in the data
92
Q

How does sample size affect study power?

A

A larger sample size increases the study power by reducing the margin of error and making it easier to detect a true effect.

93
Q

How does effect size affect study power?

A

A larger effect size increases the study power by making it easier to detect a significant difference if one exists.

94
Q

How does variability affect study power?

A

Lower variability in the data increases the study power by making it easier to detect a true effect.

95
Q

Why is understanding study power important for research?

A

Understanding study power is important to ensure that a study is adequately designed to detect a true effect and avoid Type 2 errors.

96
Q

What is Intention-to-Treat (ITT) analysis?

A

ITT analysis includes all participants who were randomized, regardless of the treatment they actually received, and analyzes them according to their original group assignment.

97
Q

What are the advantages of ITT analysis?

A

ITT analysis preserves randomization, maintains sample size, eliminates bias, and provides information about the effectiveness of an intervention.

98
Q

Why is ITT analysis considered the gold standard?

A

ITT analysis is considered the gold standard because it maintains the benefits of randomization, avoids biases that can occur with other methods, and provides a realistic estimate of the effectiveness of the treatment.

99
Q

What is Per-Protocol (PP) analysis?

A

PP analysis includes only participants who completed or complied with the study protocol and analyzes them based on the treatment they actually received.

100
Q

What are the advantages of PP analysis?

A

PP analysis provides information about the efficacy of the intervention, focusing on those who adhered to the protocol.

101
Q

What are the disadvantages of PP analysis?

A

PP analysis can create selection bias, undermine randomization, and may overestimate the effect size by excluding non-compliant participants.

102
Q

How do ITT and PP analyses differ in terms of bias and randomization?

A

ITT analysis minimizes bias and maintains randomization by including all randomized participants, while PP analysis may introduce selection bias and undermine the benefits of randomization by only including compliant participants.

103
Q

What do ITT and PP analyses reveal about treatment?

A

ITT analysis provides insights into the effectiveness of an intervention in real-world conditions, while PP analysis offers information about the efficacy of an intervention under ideal conditions.

104
Q

What is generalisability in research?

A

Generalisability is the applicability of research findings and conclusions from the sample population to the larger population.

105
Q

How can you assess the generalisability of a study?

A

Assess generalisability by considering whether the study population is representative of the general population, examining how participants were selected, and checking for any potential biases in the selection process.

106
Q

What factors might affect the generalisability of a study’s findings?

A

Factors affecting generalisability include the selection criteria for participants, the characteristics of the sample compared to the broader population, and any biases introduced during the study.

107
Q

What is clinical significance?

A

Clinical significance refers to a change in a patient’s life or disease status that is considered important or meaningful in a clinical context.

108
Q

How does clinical significance differ from statistical significance?

A

Clinical significance focuses on the real-world importance of a treatment effect, while statistical significance refers to whether an effect is unlikely to have occurred by chance. An effect can be statistically significant but not clinically significant if it doesn’t lead to a meaningful change in patient outcomes.

109
Q

Can you provide examples of clinical significance?

A

Examples of clinical significance include a medication that significantly improves a patient’s quality of life, a treatment that reduces symptoms to a degree that changes daily functioning, or an intervention that has a meaningful impact on disease progression.

110
Q

How can you evaluate the clinical significance of study results?

A

Evaluate clinical significance by considering the magnitude of the effect, its impact on patient well-being, how it compares to existing treatments, and whether it leads to a meaningful improvement in health outcomes

111
Q

Why is generalisability important in clinical practice?

A

Generalisability is important because it determines whether study findings can be applied to broader patient populations and influences the relevance and applicability of research results to everyday clinical settings.