Week 1 Flashcards
Research is:
The ordered set of activities focused on the systematic collection of information using accepted methods of analysis as a basis for drawing conclusions and making recommendations
Research = finding evidence
Research process
The search for knowledge
A systematic investigation to establish facts
Relies on the application of the scientific method
Driven by curiosity
Produces data information intelligence (theories) to explain things The search for knowledge
A systematic investigation to establish facts
Relies on the application of the scientific method
Driven by curiosity
Produces data information intelligence (theories) to explain things
Process
Starts with curiosity Then find out what is already out there Identify the knowledge and gaps Form the research question Figure out the research design (methodology) Collect the data (data collection) Analyze the data (results) Convert the results into practical applications (discussion) Report the research (article)
Curiosity
What is your “information need?”
What exactly do you want to know or know about
What are you curious about?
Start by thinking about what it is you want to know from your initial ‘search’
What is happening here? What are the patient’s experiences? Why are things done this way? I wonder what would happen if …? What is the effect of …?
Then find out what is already out there
Comprehensive literature review
Lets you stand on the shoulders of others
Research can fix the world later, not with one study
Contributes to cumulative knowledge
Avoid accidental re-invention
(although conscious replication is tenable)
If you steal from one author, it’s plagiarism; if you steal from many, it’s research
Literature review
A literature review locates, examines & describes published materials
Common characteristics of a lit review
Reviews published literature, implying that included materials possess some degree of permanence
Possibly articles were subject to a peer-review process
Generallyinvolves some process for identifying materials for
Potential inclusion
Synthesizing them in textual, tabular or graphical form and
Making some analysis of their contribution or value
Lit review–>Gap Analysis
Gaps discovered through reviewing the literature
The research domain
Theories
Research techniques
The knowledge
Overview Review
A simple summary of the literature
Surveys the literature and describe its findings
Scoping review
Provides a preliminary assessment of the potential size and scope of available research literature
Aims to identify the nature and extent of research evidence
Critical review
Demonstrates that the writer has extensively researched the literature & critically evaluated its quality
Goes beyond mere description of identified articles and includes a degree of analysis and conceptual innovation
Presents, analyses and synthesizes material
Provides an opportunity to ‘take stock’ and evaluate what is of value from the existing body of work
Usually produces a hypothesis or a model, not an answer
Meta-analysis
Statistically combines the results of quantitative studies to provide a more precise effect of the results
Systematic review
Systematically searches for, appraises and synthesises research evidence, often adhering to the guidelines on the conduct of a review provided by the Cochrane Collaboration
Quantitative literature
Typically addresses broad questions and the result is a ‘best evidence’ statement
Qualitative systematic review / Meta-synthesis
Integrates or compares findings from qualitative studies
May lead to the development of a new theory, an overarching ‘narrative’, a wider generalization or an ‘interpretative translation’
Looks for ‘themes’ or ‘constructs’ across qualitative studies
Is not aggregative in the sense of ‘adding studies together’
Is interpretative in broadening understanding of a particular phenomenon’
What does it mean to be critical?
To question
To evaluate not only what is concluded, but also how the conclusions were reached
Active interpretation
Rational examination of what the thinking was, what was done
Objective uncovering of strengths and challenges/weaknesses
What is and why do critical Appraisal ?
Systematic assessment to judge quality, trustworthiness & relevence
Locates highest quality of evidence to support best patient care
Essential in age of information overload and potential for research misconduct
What is a critique?
Academic writing that summarizes and objectively evaluates a work
What is a critical (research) literature review?
A systematic, synthesized critique of the processes, results and conclusions of a selection of research articles that allows an identification and evaluation of the body of evidence
Why do a critical literature review ?
Develop knowledge of the current state of knowledge about this issue or topic
Recognize the strengths and weaknesses of what is known
Identify outstanding matters and debates related to the issue or topic
What problems can be identified in published literature ?
Problems with sampling and data collection because researchers lack conceptual underpinnings
Problems with sense-making because researchers not alert to what evidence is already available
Problems with claims-making because researchers lacks the knowledge to state its significance for theory, policy or practice
Knowledge of the literature can help:
Tighten questions
Support concept sensitivity
Provide a source for making comparisons
Stimulate thought
Tips on doing a critical literature review
Don’t just summarize the studies, evaluate them
Synthesize key themes and issues running through research reports
Take a holistic view of the literature to provide an overview of what it says
Summaries
Use information extraction techniques
Pulls together information to highlight important points
Iterates the information (no new thought)
Analyzes the article (study)
Addresses one article at a time
Presents a cursory overview
Syntheses
Use information extraction techniques
Pulls together information to highlight the important points, AND to draw new conclusions.
Combines and contrasts information from different articles
Reflects your knowledge about what the known evidence is AND creates something new out of two or more articles
Combines parts and elements from a variety of articles into one unified entity
Focuses on main ideas AND details
Achieves new insights
Common Location of information in qualitative research articles
1) identification of issue/topic
2) purpose/aim
3) background/lit review
4) research question(s)
5) deisgn
6) sample
7) ethical issues
8) data collection procedures
9) data analysis
10) discussion
11) conclusions/recommendations
1) title, INTRO
2) abstract, INTRO
3) INTRO, discussion
4) BACKGROUND
5) abstract, intro, METHODS/DESIGN
6) methods, subsection SAMPLE, SUBJECTS, PARTICIPANTS
7) SAMPLE, procedures
8) DATA COLLECTION, procedures
9) METHODS, data analysis, interpretation
10) DISCUSSION, implications
11) DISCUSSION, implications
Common Location of information in quantitative research articles
1) identification of issue/topic
2) purpose/aim
3) background/lit review
4) theoretical framework
5) hypothesis
6) research question(s)
7) design
8) sample
9) ethical issues
10) data collection procedures
11) data analysis
12) results
13) discussion
14) conclusions/recommendations
15) limitations
16) gaps
1) INTRO, background
2) abstract, BACKGROUND
3) BACKGROUND, discussion
4) BACKGROUND
5) intro, BACKGROUND
6) BACKGROUND
7) title, abstract, METHOD/METHODOLOGY
8) METHOD/METHODOLOGY, sample
9) METHOD/METHODOLOGY, sample
10) METHOD/METHODOLOGY, data collection
11) METHOD/METHODOLOGY, data analysis
12) RESULTS
13) DISCUSSION
14) CONCLUSIONS
15) CONCLUSIONS
16) CONCLUSIONS
Levels of Evidence
Melnyk & Fineout-Overhold (2005)
I) systematic lit review of RCTs II) RCT III) non random controlled trial (quasi-exp) IV) quantitative non-exp v) other systematic reviews VI) Qualitative study VII) Expert opinion
Samples: Reporting / critical appraisal guidelines
randomized control trials: CONSORT Observational studies: STROBE Systematic reviews and metat analysis: PRISMA Guidelines for research and evaluation: AGREE Case reports: CARE Quality improvement: SQUIRE Realist and meta narratives: RAMESES Economic evaluations: CHEERS Qualitative research COREQ
