RESS Curriculum Flashcards

1
Q

Define statistical significance

A

The likelihood that the results obtained in a study were not due to chance alone (p values and confidence intervals may be used to assess statistical significance).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Define a p value

A

The probability that the observed difference between two treatment groups might have occurred by chance.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What does a p value <0.05 indicate?

A

If the p value <0.05 then the observed difference between the groups is so unlikely to have occurred by chance that we reject the null hypothesis (that there is no difference) and accept the alternative hypothesis that there is a real difference between the treatment groups.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Define a heuristic

A

Any approach to problem solving that employs a practical method that is not guaranteed to be optimal, perfect, or rational, but is nevertheless sufficient for reaching an immediate, short-term goal or approximation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is the hierarchy of evidence?

A

A heuristic used to rank the relative strength of results obtained from scientific research.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Down side of hierarchy of evidence?

A

this focuses exclusively on ‘effectiveness’ and rarely pays attention to the quality of the studies

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is the pyramid shape used to illustrate in the hierarchy of evidence?

A

Increasing risk of bias

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is a case control study?

A

Selects participants on the basis of their outcome and works back to their exposure

E.g. patients who have developed a disease are identified and their past aetiological factors is compared with that of controls who do not have the disease.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

In a case control study, the controls are used to estimate the exposure distribution (i.e. the proportion having the exposure) in the population from which the cases arose.

How is the odds ratio then calculated?

A

The exposure distribution in cases is then compared to the exposure distribution in the controls in order to compute the odds ratio as a measure of association

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Advantage of case control studies?

A

Cheap

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Main disadvantage of case control studies?

A

Prone to selection bias

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Why are case control studies prone to selection bias?

A

Selection bias occurs when subjects for the ‘control’ group are not truly representative of the population that produced the cases.

May occur when ‘cases or controls are included/excluded from a study because of some characteristic they exhibit which is related to exposure to the risk factor under evaluation.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

When is selection bias in case control studies a particular problem?

A

Where cases and controls are recruited exclusively from hospital/clinics → hospital patients tend to have different characteristics than the population e.g. higher levels of alcohol/smoking

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is a cohort study

A

Longitudinal study; an exposure is assessed (common characteristic) and then participants are followed prospectively to observe whether they develop the outcome

  • Selects participants before outcome
  • No control over outcome
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What type of study is one that looks at the potential long-term consequences of the use of oral contraceptives?

A

Cohort study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is a prospective study

A

Studies are planned in advance and carried out over a future period of time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What is a retrospective study

A

study looks at data that already exists and try to identify risk factors for particular conditions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Which type of study is used to try and identify risk factors for particular conditions?

A

Retrospective studies

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What is a randomised controlled trial?

A

A number of similar people are randomly assigned to 2 (or more) groups to treatment groups (e.g. drug).

  • One group has the intervention being tested (the experimental group)
  • The other has an alternative intervention (placebo) or no intervention at all (the control group)
  • The groups are followed up to see how effective the experimental intervention was
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What can RCTs control?

A

Used to control factors not under direct experimental control

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Which study type is regarded as the gold standard trial for evaluating the effectiveness of interventions?

A

Randomised controlled trials → is the most scientifically rigorous method of hypothesis testing available

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Disadvantage of RCTs?

A

Expensive

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Why is the RCT considered to provide the most reliable evidence on the effectiveness of intervention?

A

Because the processes used during an RCT minimise the risk of confounding factors influencing the results

The findings are likely to be closer to the true effect than the findings generated by other research methods.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

What is meta analysis?

A

A method often used in systematic reviews to combine results from several studies of the same test, treatment or other intervention to estimate the overall effect of the treatment (a formal study of existing evidence).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

Define research

A

Generates new knowledge where there is no (or limited) research evidence available and which has to potential to be generalizable or transferable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

Define an audit

A

A quality improvement process that seeks to improve patient care and outcomes

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

What is the aim of an audit?

A

Quality improvement (patient care and outcomes)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

How does an audit seek to improve quality of care?

A

Systematic review of care against explicit criteria and the implementations of change → Existing practice is measured against evidence-based clinical standards (explicit criteria).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

What is a service evaluation?

A

Evaluates a current service or proposed practice to assess how well a service is achieving its intended aims.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

What is the sole purpose of a ervice evaluation?

A

sole purpose of defining or judging the current service

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

Audit vs service evaluation?

A

A clinical audit is designed to answer the question → ‘Does this service reach a certain standard?’

A service evaluation is designed to answer the question → ‘What standard does/might this service achieve?’

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

What is an audit-cum-service evaluation?

A

Many studies conduct both an audit (to establish the extent to which clinical practice is achieving a particular standard) as well as a service evaluation (to establish what factors might be associated with those contexts)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

Example → NICE guidelines recommend swallowing therapy “at least three times a week for as long as they continue to make functional gains

A

Study 1 AUDIT: What proportion of patients with dysphagia are given swallowing therapy at least 3 times a week? (the proportion of patients who receive the care that meets that recommended by the standard/guideline)

Study 2 SERVICE EVALUATION: How many times a week are patients given swallowing therapy? (primarily interested in variation in the characteristics of healthcare delivery)

Study 3 AUDIT-CUM-SERVICE EVALUATION: What proportion of patients with dysphagia are given swallowing therapy at least 3 times a week in Consultant-led and non-Consultant-led clinics? (interested in whether variation in patient characteristics or the characteristics of healthcare delivery might influence whether a patient receives standard/recommended care)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

What axis is the exposure on?

A

Independent → x axis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

What axis is the outcome on?

A

Dependent → y axis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
36
Q

If the confidence interval around the odds ratio does include 1, what does this mean?

A

If the confidence interval includes or crosses 1, then there is insufficient evidence to conclude that the groups are statistically significantly different → cannot be confident there is an effect

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
37
Q

Ethics vs governance?

A

Ethics → what is morally correct

Governance → what has received permission

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
38
Q

What does ethical research aim to ensure?

A

Ethical research aims to ensure that the potential benefits of any given study never take precedence over the wellbeing (most studies impose burdens and risks) and rights (most studies require informed consent) of study subjects/participants.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
39
Q

What is he role of ethics & governance approval?

A

aim to ensure that no human (and many animal-based) studies take place without ensuring appropriate measures are in place

40
Q

When is ethics approval particularly important?

A

when the study’s participants are unable to consent e.g. dead; unconscious; unwell; lack capacity

41
Q

Give some examples where formal ethical approval and consent may NOT be needed

A

The changes are routine and not part of the study’s design and either:

a) all the data used has been collected during/as an established part of a routine practice OR;
b) the collection of any additional data does not impose excessive burdens or risks (though consent should be obtained)

42
Q

What can you change without seeking further approval (a so-called ‘amendment’) from the Research Ethics Committee?

a) Add an additional invasive measurement to the data you want to collect
b) Change the content of the participant information leaflet
c) Change your original hypothesis
d) Recruit additional participants

A

Change your original hypothesis

43
Q

What is a ‘conflict of interest’ in a study?

A

This refers to the situations in which financial or other personal considerations may compromise (or have the appearance of compromising) an investigator’s professional judgment in conducting or reporting research.

I.e. The responsibilities of a medical researcher may be at risk of being unduly influenced by a 2ary interest e.g. a financial gain or career advancement.

44
Q

Define a public partnership

A

An umbrella term for describing activities which involve members of the public.

45
Q

Define public engagement with research

A

Where information about research is provided and disseminated

  • Dissemination events
  • Social media
  • Newsletters
  • Websites & blogs
  • Creative methods
46
Q

Define public involvement with research

A

Where members of the public are actively engaged in shaping and developing research projects

47
Q

Define public participation with research

A

Where people take part in a research study

48
Q

Define ‘coproduction’ of a research project

A

Co-producing a research project is an approach in which researchers, practitioners and the public work together, sharing power and responsibility from the start to the end of the project:

  • Redressing power differentials
  • Knowledge of equal importance
  • Clear roles and real responsibilities
  • Accessibility e.g. language
49
Q

What is the role of NICE?

A

To improve outcomes for people using the NHS and other public health and social care services by:

  • Producing evidence-based guidance and advice for health, public health and social care practitioners
  • Developing quality standards and performance metrics for those providing and commissioning health, public health and social care services
  • Providing a range of information services for commissioners, practitioners and managers across health and social care
  • Reduce variation in the availability and quality of treatments and care
  • Help resolve uncertainty about which medicines and treatments work best and which represent best value for money for the NHS
50
Q

Clinical guidelines vs quality standards?

A

Clinical guidelines → evidence based

Quality standards → guideline based

51
Q

What is a clinical guideline?

A

A comprehensive set of recommendations for a particular disease or condition

52
Q

What is a quality standard?

A

A standard is a level of quality or attainment

53
Q

What is the GDG (guideline developing group)?

A

The GDG is established by the NCC or the Internal Clinical Guidelines Programme, and is responsible for developing the clinical guideline.

During development of the clinical guideline, the GDG: agrees the ‘review questions’ about treating and managing the condition that will guide the search for evidence.

54
Q

What is the key role of the GDG?

A

make judgements based on evidence

55
Q

Define a descriptive study

A

Classifies, describes, compares and measures data

56
Q

Describe an analytical study

A

Focuses on cause and effect

57
Q

Define a confounding variable

A

A confounder is a variable that influences both the dependent variable and independent variable, causing a spurious association

58
Q

Define a covariate

A

An independent variable that can influence the outcome of a given statistical trial but is not of direct interest

59
Q

What are the 5 different types of variable?

A
  1. Exposure
  2. Outcome
  3. Mediator
  4. Confounder
  5. Competing exposure
60
Q

Define a mediator

A

A variable that links the independent and dependent variable, whose existence explains the relationship between the two variables

61
Q

Define a confounder

A

A variable that influences both the independent variable (exposure) and the dependent variable (outcome)

62
Q

Define a competing exposure

A

An ancestor of the outcome that is not related with the exposure

63
Q

3 list approach to classify covariates:

A
64
Q

Define 1ary data collection

A

Data that has been generated by the researcher (e.g. surveys, interviews, experiments) and is specially designed for understanding and solving the research problem at hand

65
Q

Define 2ary data collection

A

Data that was formerly collected for other purposes than that of the current research study at hand (e.g. existing data generated by healthcare providers, government institutions such as medical electronic health records, disease registries)

66
Q

Define a prospective study

A

Record/measure variables during the study period, with the outcome subsequently measured e.g. cohort study

67
Q

Major pros of prospective studies?

A
  • Major strength of a prospective cohort study is the accuracy of data collection with regard to exposures, confounders, and outcomes and other covariates
  • Fewer sources of bias (e.g. recall or ascertainment)
  • Less chance of unmeasured confounding
68
Q

Major cons of prospective studies?

A
  • Time and resource intensive
  • Expensive
  • Tendency to collect data on more variables than you need or can use in your analyses (but not if you use a DAG)
  • Participants can drop out during a study (bias)
  • Usually infeasible for rare outcomes
69
Q

Define a retrospective study

A

Record/measure the outcome and then look back to record/measure the exposure and covariates e.g. case control studies and studies using existing patient records

70
Q

What is a DAG (directed acyclic graph)?

A

Displays assumptions about the relationship between variables

  • Directed → Graph has a direction (topological ordering)
  • Acyclic → A graph without cycles (a cycle is a complete circuit), so you will never visit the same node twice
71
Q

Pros of using newly collected data over existing data?

A

Helps ensure that you record all the variables you need, using the best techniques available, applied consistently

72
Q

Cons of using newly collected data over existing data?

A
  • More expensive & time consuming
  • Harden to recruit participants
  • Usually constitutes ‘research’ – therefore requires ethical approval
73
Q

Pros of using existing data over newly collected?

A

Less expensive & less time consuming

74
Q

Cons of using existing data over newly collected?

A
  • Limited choice as to which variables have been measured
  • Limited involvement in the (in)consistency of measurement
  • Limited involvement in the level of ‘missingness’ tolerated
75
Q

Define a registry

A

A collection of information about individuals, usually focused around a specific diagnosis or condition.

76
Q

Define a measurement error

A

The difference between the measured value of a variable and its true value.

77
Q

Define response bias

A

A general term for a wide range of tendencies for participants to respond inaccurately or falsely to questions (i.e. what interviewer wants/gets)

78
Q

Define prestige bias

A

A bias towards copying ‘prestigious’ individuals (i.e. what appears favourable)

79
Q

Define recall bias

A

Participants are systematically more or less likely to recall and relate information on exposure depending on their outcome (prospective/retrospective)

80
Q

Define a proxy

A

A variable that is not in itself directly relevant but serves in place of an unobservable or immeasurable variable. E.g. intended variable = true body fat percentage, proxy variable = BMI

81
Q

Define a latent variable

A

A variable that cannot be observed but can be detected by their effects on variables that are observable.

82
Q

Define a sample

A

A sample is a subset of your population by which you select to be participants in your study.

83
Q

Define sampling

A

The process of selecting a subset of a population which will be a representation of the whole population.

84
Q

Define a target population

A

The total, finite population of people/contexts (to whom we wish to apply our study’s results and from which any study sample is drawn).

85
Q

What should sampling ensure?

A

Sampling should ensure that the sample is a true representative of the population.

86
Q
A

Probability sampling is a sampling technique, in which the subjects of the population get an equal opportunity to be selected as a representative sample.

Non-probability sampling → the elements that make up the sample are selected by nonrandom methods

87
Q

What is sampling bias?

A

This involves problems in your sampling, which reveals that your sample is not representative of your population.

88
Q

Most important source of sampling bias?

A

Most important are those arising from your inclusion/exclusion criteria.

89
Q

What is a stratified random sample?

A
  • The whole population is divided into homogeneous strata or subgroups according to a demographic factor (e.g. gender, age group, religion, socio-economic level, education, or diagnosis etc.)
  • Randomly sample from the target population within strata (particularly to ensure equal numbers by exposure and confounder status)
  • Every member of the target population within each stratum has the same chance/probability of being sampled
  • The numbers in each stratum can be oversampled to strengthen analysis
90
Q

Pros of stratified random probability sampling?

A
  • Representative of population
  • Unequal sampling of strata improves power for rare strata
91
Q

How can you achieve a random/probability sample?

A

We use a systematic approach designed to ensure that every person/context in the ‘target population’ has an equal chance/probability of being included in the ‘study sample’

Methods:

  • Table random numbers
  • Computer generated list of random numbers
  • Lottery methods
92
Q

What is the purpose of a sample size calculation?

A

to ensure that your study is large enough to have a good chance of detecting any effect you hope to see

93
Q

What does it mean if the confidence interval around the odds radio does not include one?

A

confident that the effect is genuine

94
Q

How can you improve the chances that the confidence interval doesn’t include 1?

A

increase the sample size (a bigger sample to estimate from will make the estimate more accurate with less variability).

95
Q

In which evaluation study activities can it be helpful to consult clinical and non-clinical stakeholders?

A
  1. Design of the research
  2. Development of the grant application (pre-protocol work)
  3. Undertaking/management of the research
  4. Analysis of data
  5. Dissemination of research findings