Research methods Flashcards
Briefly describe the Tuskegee Syphilis study in 1932-1972
Looked at effects of syphilis on untreated African-American men
Participants didn’t know they were in a study, most didn’t know they had syphilis
No consent given
Treatment was withheld even when penicillin was available.
When was the Nuremberg code made?
1947
What are the 10 points of the Nuremberg code?
1) Voluntary, well-informed consent of human subject
2) Experiment should aim at positive results for society that can’t be obtained any other way
3) Should be based on previous knowledge that justifies the experiment
4) Experiment should be set up in a way which avoids unnecessary physical or mental suffering or injuries
5) Shouldn’t be conducted when there is any reason that it implies a risk of death or disabling injury
6) Risks should be in proportion to & not exceed the expected humanitarian benefit
7) Preparation and facilities must be provided to protect subjects against risk
8) Staff conducting experiments must be fully trained and scientifically qualified
9) Human subjects must be free to immediately quit the experiment at any point
10) Staff must stop the experiment at any point when they observe that continuation would be harmful
Describe the Willowbrook hepatitis experiments
Experiments on children living in residential care with mental health problems or learning disabilities.
Intentionally infected children with hepatitis and observed progression
When was the declaration of Helsinki made?
1964
What is the Helskini declaration?
Ethical principles for research involving human participants
What are the basic principles of the declaration of Helsinki?
Respect for the individual, their right to self determination and the right to make informed decisions
Participant’s welfare must take precedence over interests of science and society
Ethical considerations must take precedence over laws and regulations
What studies require ethical approval?
Studies involving human / animal participants
Gathering novel data or information
Creating knowledge that can be generalised beyond the patient sample or setting
What projects don’t require ethical approval?
Service evaluations
Clinical audits
What ethics committee do you need to apply for if using NHS staff, patients or site?
NHS health research authority
What points need to be included for ethical approval?
Scientific rational Rigorous methodology Informed consent Vulnerability of participant groups Data protection, confidentiality and records management Research safety and wellbeing
What information must be included in the rigorous methodology for ethical approval?
Adherence to established methodology
Methods must be appropriate for producing new knowledge
Methods must be appropriate and feasible for proposed setting and sample
Study materials or equipment should be valid and reliable
Show skills for robust data management and analysis within the team
What methods are there for participant recruitment>
Face to face in clinic
Posters
Social media
What participant groups are considered vulnerable?
Children Patients with dementia Patients with learning difficulties People with mental health problems People in care facilities Over-researched populations
What is the definition of research?
Study which is trying to generate new knowledge about patients or conditions or healthcare services that will be generally true across a wider population than it is actually studying.
What is the definition of a service evaluation?
Evaluate or assess some part of a local healthcare service. Aims to improve service based on evidence collected.
Results from this project will only feed back into this particular service
What is a clinical audit?
Quality improvement process that seeks to improve patient care and outcomes through systematic review of care against explicit criteria and implementation of change.
What are the 5 stages of the audit cycle?
Identify Method Analyse Change Monitor
What does the identify stage in the audit cycle include?
Guidelines Evidence Patient and public involvement Process design Agree standards
What methods can be used for data collection of service evaluations or audits?
Patient notes / record review Survey of staff - paper / online Survey of patients - paper / online Telephone interview Face to face interview Focus groups
What are the problems with using patients notes to gather research data?
Limited type of information available
Need to ensure there are no patient identifies
What points need to be considered when creating a questionnaire?
What do we want to achieve? What information do we need to know to help this? Who should we ask and how should we ask them? Types of questions Choosing categories - standardised - analyse by age or scale - demographic factors Question writing
What is the format of questionnaire questions determined by?
What we want to know
What types of data we want to generate
What types of analysis we want to do
What are the 3 types of questions for a questionnaire?
Closed questions with yes / no or categorical answer
Closed statements answered on a scale
Open-ended questions
What are Likert scales?
Respondents specify level of agreement or disagreement on a symmetric scale for a series of statements
What can Likert scales be used for?
Knowledge Beliefs Attitudes Symptoms Traits
What assumptions do Likert scales assume?
Bipolar scaling method
Assumes distance between each response is equal
What should be considered when writing questions for Likert scales?
Is the question / statement loaded with social desirability?
Does the question require knowledge or information the respondent might not have?
Is the statement based on 2 premises?
Why do likert scales require many items?
Unlikely to identify a single item which represents the whole issue being measured
Reduces error of random responses or misunderstandings
Can design questionnaires to reduce skew
How are Likert scales analysed?
Add up scores across similar questions to make a scale (total score)
Report mean total score and standard deviation
What is a RCT?
Study in which participants are allocated randomly between an intervention e.g. treatment and a control group e.g. no treatment or standard treatment
Why are RCTs conducted?
Safety
- ascertain safe dose
- demonstrate safety and tolerability of new compound
- monitor adverse events profile
Efficacy / effectiveness
- demonstrate efficacy of new drug
- show the treatment T is superior or equivalent to treatment X
- demonstrate effectiveness and cost effectiveness
What is a confounder?
Variable that influences both the dependent variable and independent variable causing a spurious association
What does equipoise provide?
Ethical basis for medical research that involves assigning patients to the different treatment arms of a clinical trial
What is internal validity in an RCT?
Is the independent variable causing the dependent variable in the study?
What is external validity in an RCT?
To what extent can these findings be generalised to other people, situations and times
What is bias?
Any departure of results from the truth
How does bias occur in an RCT?
When systematic error is introduced into sampling
Testing by selecting
Encouraging one outcome or answer over others
What is the definition of bias in statistics?
A tendency of an estimate to deviate in one direction from a true value
What is selection bias in an RCT?
Systematic differences between baseline characteristics of groups that are compared
Study sample doesn’t represent target population
What is performance bias in an RCT?
Systematic differences between groups in the care that is provided or in exposure to factors other than the interventions of interest
What is attrition bias?
Systematic differences between groups in withdrawals from a study
What is observer / detection bias?
Systematic differences between groups in how outcomes are determined
Outcome measures don’t adequately capture outcome of interest.
What types of trials can be blinded?
Drug trials
Surgery vs non surgical
Psychological interventions
What is a single blinded RCT?
Patients are blinded
What is a double blinded RCT?
Blinding of patients and treating physicians
What is a triple blinded RCT?
Blinding of patients, treating physicians and study investigators
What is a P-value?
Probability that the difference observed could have occurred by chance if the groups compared were really alike
What type of study causes a high p-value?
Few observations with high variability
What type of study causes a low p-value?
Many observations with low variability
What is the clinically important effect?
Smallest difference in outcome between treatment groups that would demonstrate a clear advantage of 1 treatment over another in terms of chosen outcome measures
Why is it important to calculate sample size?
Too few participants - if you get a null hypothesis you don’t know if you have evidence of no effect or no evidence of an effect
Too many participants is unethical and expensive
What are parametric tests?
Make assumptions about the data, particularly that its normally distributed
Describe a right skew
Skewed part is to the right
Most cases are to the left
There is more count in the tail than expected in a normal distribution
Positive skew