critical appraisal Flashcards
What does evidence-based practice involve?
- asking focussed questions
- finding the evidence
- critical appraisal
- making a decision
- evaluating performance
PICO - what must be included in a focussed research question?
Population
Intervention
Comparator
Outcome
What types of evidence are at the top of the hierarchy of evidence?
Hierarchy 1a (level A) Systematic reviews or meta analysis of randomised controlled trials *gold standard* Hierarchy 1b (level A) At least 1 randomised controlled trial Hierarchy 2a At least 1 controlled trial without randomisation Hierarchy 2b At least 1 other type of quasi-experimental study
What is the purpose of critical appraisal?
To assess and consider validity, reliability and applicability.
What are some quality markers of a good study?
Should:
- have random allocation of participants to interventions (reduces bias/confounding variables)
- have outcome measures for at least 80% participants
- show causation rather than association
what is validity in critical appraisal?
Validity is how close to the truth something is. I.e. is a study testing what it says it’s testing or are there
confounding variables which are in fact the reason for the results.
What is reliability in critical appraisal?
Reliability is how consistent results are. If the experiment was repeated again, would the same/similar results be seen?
What is applicability in critical appraisal?
Applicability is how relevant a study is to clinical medicine.
What are observational vs experimental/intervention studies?
Observational studies: can be descriptive, descriptive and analytical or analytical studies.
Intervention studies are generally randomised control trials.
Examples of descriptive observational studies
(2)
Uses/flaws?
- case reports/case series study individuals
- ecological studies use routinely collected data to show trends in data - useful for generating hypotheses, but shows prevalence/association not causation (e.g. John Snow water pump)
Example of an observational study design that is both descriptive and analytical.
Uses/flaws?
Cross sectional study/survey - divides population into those without the disease and those with the disease - data is collected on them once to find associations at a specific point in time.
Used to generate hypothesis but are prone to bias and have no time reference/follow up.
2 examples of observational studies that are analytical
- case-control studies
- cohort studies
Describe case-control studies:
- benefits
- downsides
Retrospective studies that take people with a disease and match them to people without for age/sex/habitat/class and study previous exposure to the agent in question.
Positives: quick, inexpensive
Negatives: retrospective nature means only shows an association, and data may not be reliable due to problems with patients memories
Describe cohort studies:
- benefits
- downsides
Start with a population without the disease in question and study them over time to see if they are exposed to the agent in question (e.g. stress, smoking, etc) and if they develop the disease in question or not.
advantages: possible to distinguish preceding causes from concurrent associated factors, lower chance of bias, absolute relative and attributable risks can be determined. Prospective meaning causation can be shown where retrospective studies cannot.
downsides: requires controls to establish causation
What is an:
Independent variable:
Dependent variable:
An independent variable is a variable that can be altered in a study.
A dependent variable is a variable that is dependent on the independent variables or one that cannot be altered.
What are some points of the Bradford-Hill criteria, used to evaluate the likelihood that an association is causal?
- consistency: results are replicated in studies in different settings
- strength of association
- dose-response relationship: does increased exposure increase risk?
- temporal: does the exposure always precede the outcome?
- biological plausibility
- coherence with existing theories
- specificity: weakest criteria, established only when a single cause produces a specific effect (usually not the cause - e.g. effects of smoking)
- condition can be altered by experimentation
when should reverse causality be considered?
where it is unclear which variable is dependent and which is independent
what is a systematic review?
A review of a clearly formulated question that uses symptomatic and explicit methods to identify, select and critically appraise relevant research and to collect and analyse data from the studies that are included in the review.
what is meta analysis?
- statistical methods are used to analyse and summarise the results of the included studies
- can be graphically represented as a forest plot
- review and analysis of a variety of existing randomised control trials
why is routine health data collected, collated and disseminated on a regular basis in the UK?
- to monitor the health of the population
- to generate hypotheses on causes of ill health
- to inform planning of services
- to evaluate and assess performance of policies and services
What types of health information are routinely studies in the UK?
- mortality
- morbidity
- use and quality of healthcare
- health status/quality of life
- individual lifestyle
- socio-economic, cultural and environmental conditions
What are some types of qualitative research?
- ethnography (immersing oneself in a particular lifestyle or group)
- interviews
- documentary analysis
what are the problems that can arise when using qualitative research as a source of information?
- Meaning imposition: not truly understanding what someone else is thinking
- Crisis of representation: research cannot capture lived experiences
- Reflexivity: personal interpretations of data
- Generalisation
Graphs used to represent continuous data:
- stem and leaf diagram
- histogram
- box and whisker
Graphs used to represent discrete, categorical data:
- bar charts
- pie charts
Define median.
advantages?
The central value when data is placed in order.
It is not affected by outliers, reflects what most people experience and is useful when data isn’t skewed.
Define mode
most frequent value
rarely used
Define mean
The sum of the values divided by the number of values.
Uses all the data, is the expected value.
Commonly used.