RESS Curriculum Flashcards
Define statistical significance
The likelihood that the results obtained in a study were not due to chance alone (p values and confidence intervals may be used to assess statistical significance).
Define a p value
The probability that the observed difference between two treatment groups might have occurred by chance.
What does a p value <0.05 indicate?
If the p value <0.05 then the observed difference between the groups is so unlikely to have occurred by chance that we reject the null hypothesis (that there is no difference) and accept the alternative hypothesis that there is a real difference between the treatment groups.
Define a heuristic
Any approach to problem solving that employs a practical method that is not guaranteed to be optimal, perfect, or rational, but is nevertheless sufficient for reaching an immediate, short-term goal or approximation
What is the hierarchy of evidence?
A heuristic used to rank the relative strength of results obtained from scientific research.
Down side of hierarchy of evidence?
this focuses exclusively on ‘effectiveness’ and rarely pays attention to the quality of the studies
What is the pyramid shape used to illustrate in the hierarchy of evidence?
Increasing risk of bias
What is a case control study?
Selects participants on the basis of their outcome and works back to their exposure
E.g. patients who have developed a disease are identified and their past aetiological factors is compared with that of controls who do not have the disease.
In a case control study, the controls are used to estimate the exposure distribution (i.e. the proportion having the exposure) in the population from which the cases arose.
How is the odds ratio then calculated?
The exposure distribution in cases is then compared to the exposure distribution in the controls in order to compute the odds ratio as a measure of association
Advantage of case control studies?
Cheap
Main disadvantage of case control studies?
Prone to selection bias
Why are case control studies prone to selection bias?
Selection bias occurs when subjects for the ‘control’ group are not truly representative of the population that produced the cases.
May occur when ‘cases or controls are included/excluded from a study because of some characteristic they exhibit which is related to exposure to the risk factor under evaluation.
When is selection bias in case control studies a particular problem?
Where cases and controls are recruited exclusively from hospital/clinics → hospital patients tend to have different characteristics than the population e.g. higher levels of alcohol/smoking
What is a cohort study
Longitudinal study; an exposure is assessed (common characteristic) and then participants are followed prospectively to observe whether they develop the outcome
- Selects participants before outcome
- No control over outcome
What type of study is one that looks at the potential long-term consequences of the use of oral contraceptives?
Cohort study
What is a prospective study
Studies are planned in advance and carried out over a future period of time
What is a retrospective study
study looks at data that already exists and try to identify risk factors for particular conditions
Which type of study is used to try and identify risk factors for particular conditions?
Retrospective studies
What is a randomised controlled trial?
A number of similar people are randomly assigned to 2 (or more) groups to treatment groups (e.g. drug).
- One group has the intervention being tested (the experimental group)
- The other has an alternative intervention (placebo) or no intervention at all (the control group)
- The groups are followed up to see how effective the experimental intervention was
What can RCTs control?
Used to control factors not under direct experimental control
Which study type is regarded as the gold standard trial for evaluating the effectiveness of interventions?
Randomised controlled trials → is the most scientifically rigorous method of hypothesis testing available
Disadvantage of RCTs?
Expensive
Why is the RCT considered to provide the most reliable evidence on the effectiveness of intervention?
Because the processes used during an RCT minimise the risk of confounding factors influencing the results
The findings are likely to be closer to the true effect than the findings generated by other research methods.
What is meta analysis?
A method often used in systematic reviews to combine results from several studies of the same test, treatment or other intervention to estimate the overall effect of the treatment (a formal study of existing evidence).
Define research
Generates new knowledge where there is no (or limited) research evidence available and which has to potential to be generalizable or transferable
Define an audit
A quality improvement process that seeks to improve patient care and outcomes
What is the aim of an audit?
Quality improvement (patient care and outcomes)
How does an audit seek to improve quality of care?
Systematic review of care against explicit criteria and the implementations of change → Existing practice is measured against evidence-based clinical standards (explicit criteria).
What is a service evaluation?
Evaluates a current service or proposed practice to assess how well a service is achieving its intended aims.
What is the sole purpose of a ervice evaluation?
sole purpose of defining or judging the current service
Audit vs service evaluation?
A clinical audit is designed to answer the question → ‘Does this service reach a certain standard?’
A service evaluation is designed to answer the question → ‘What standard does/might this service achieve?’
What is an audit-cum-service evaluation?
Many studies conduct both an audit (to establish the extent to which clinical practice is achieving a particular standard) as well as a service evaluation (to establish what factors might be associated with those contexts)
Example → NICE guidelines recommend swallowing therapy “at least three times a week for as long as they continue to make functional gains”
Study 1 AUDIT: What proportion of patients with dysphagia are given swallowing therapy at least 3 times a week? (the proportion of patients who receive the care that meets that recommended by the standard/guideline)
Study 2 SERVICE EVALUATION: How many times a week are patients given swallowing therapy? (primarily interested in variation in the characteristics of healthcare delivery)
Study 3 AUDIT-CUM-SERVICE EVALUATION: What proportion of patients with dysphagia are given swallowing therapy at least 3 times a week in Consultant-led and non-Consultant-led clinics? (interested in whether variation in patient characteristics or the characteristics of healthcare delivery might influence whether a patient receives standard/recommended care)
What axis is the exposure on?
Independent → x axis
What axis is the outcome on?
Dependent → y axis
If the confidence interval around the odds ratio does include 1, what does this mean?
If the confidence interval includes or crosses 1, then there is insufficient evidence to conclude that the groups are statistically significantly different → cannot be confident there is an effect
Ethics vs governance?
Ethics → what is morally correct
Governance → what has received permission
What does ethical research aim to ensure?
Ethical research aims to ensure that the potential benefits of any given study never take precedence over the wellbeing (most studies impose burdens and risks) and rights (most studies require informed consent) of study subjects/participants.