2: Methods and evidence Flashcards
What are the two main groups of social science methods?
Quantitative
Qualitative
Describe quantitative research
Collection of numerical data which begins as a hypothesis. Conclusions are drawn by deduction, about relationships between variables, sometimes causal.
What is quantitative research good at?
Reliable and repeatable. Good at - Describing - Measuring - Finding relationships - Allowing comparisons
What are some problems with quantitative research?
- May force people into inappropriate categories
- Don’t allow people to express things in the way they want
- May not access all important information
- May not be effective in establishing causality
List some features of quantitative research
- Numbers
- PoV of researcher
- Researcher distant
- Theory testing
- Static and structured
- Generalisation - factors out of context
Describe some quantitative research designs
- Experimental study designs: RCT, cohort, case control, cross sectional
- Secondary analysis from other sources such as official stats and national surverys
- Commonly uses QUESTIONNAIRES
Describe important features of quantitative questionnaires
- Valid - measure what they are supposed to
- Reliable - consistent measurement reflecting differences between participants
- Published - tested for validity and reliability. However this must be established in unpublished.
- Mainly closed Qs, may have some free test boxes but need to plan how to analyse
Describe qualitative research
Aims to make sense of phenomena in terms of the meaning people bring to them - listens to people’s perspectives.
Describe features of qualitative research
Words and artefacts, PoV of participants, researcher close, theory emergent, less structured, contextual understanding
What is qualitative research good at?
Understanding perspectives, accessing info not revealed quantitatively, explaining relationships between variables
What are some problems with qualitative research?
Small sample sizes and different approaches mean it is not good at finding consistent relationships, and generalisability to whole populations is poor
Describe some qualitative research designs
Ethnography: studying human behaviour in its natural context
Observation: removes biased, can be by participants or non-participants
Interviews: semi-structures, facilitative perspective giving
Focus groups: not useful for individual experience, may encourage participation, some topics too sensitive, deviant views inhibited
Document and media analysis: good for historical context
Describe qualitative analysis and appraisal
ANALYSIS: ongoing iterative process, inspect data, identify themes, produce specification for themes and assign data to themes.
APPRAISAL: tools for assessing quality - CASP. Transparency around sampling, methods and analysis - audit trail if good.
What is evidence based practice?
The integration of individual clinical expertise with the best available external clinical evidence form systematic research
What are advantages of EBM and systematic research use?
- Reviews and meta analyses communicate pre-existing evidence
- Address clinical uncertainty, highlight gaps or poor quality research
- Authoritative, generalisable, up to date conclusions
- Save clinicians having to locate and appraise themselves
- Reduce delay between discovery and implementation into practice
- Prevent biased decision making
Where can evidence for EBM be found?
- Peer reviewed medical journals
- EBM specific journals
- Cochrane collaboration
- NHS centre for reviews and dissemination
- NHS health technology assessment program
What are some practical criticisms of EBM?
- Impossible to maintain and create systematic reviews across all specialities
- Challenging and expensive to distribute and implement findings
- RCTs gold standard buyt hard to blind, and ethical issues
- Choice of outcomes very biomedical
- Good faith from pharm companies
- Organisational systems can not support innovation
What are some philosophical criticisms of EBM?
- Does not align with most doctors modes of reasoning - probabilistic vs deterministic causality
- Population level outcomes applied to individual
- Can be seen to legitimise rationing
- Unreflective rule followers
- Professional responsibility and autonomy
What are difficulties getting evidence into practice?
- Resources not available to implement change
- Evidence exists but doctors don’t know about it - no incentive to keep up to date
- Doctors know about evidence but don’t use it
- Organisational systems can’t support innovation
- Commissioning decisions reflect different priorities
