Chapter 2 - Literature Search and Research Question Development Flashcards
Public Health Research Basics
What is a literature review?
A summary and synthesis of published information on a subject area. The main goal is to familiarize yourself with what is already known about a topic and to identify gaps that justify your study.
What is a research gap?
What exist in the literature also implicitly identifies what does not exist among studies on your topic. From searching the literature, you identified a gap and can narrow your research focus.
What is a systematic review?
A systematic review involves collecting and analyzing all evidence that answers a specific question. This includes a comprehensive and exhaustive search of the literature and critical analysis (not just a summary like in a basic review) of the search results.
The goal of the review is to provide an evidence-based answer to a very specific research question.
What guides exist for systematic reviews?
- Cochrane Review
2) PRISMA (Preferred Reporting Items for Systematic Review and Meta-Analyses)
What is a meta-analysis?
A meta-analyses combines the quantitative results of a number of different studies into one report to create a single, more precise, and robust estimate of effect.
Data from individual studies are combined to reach new statistical conclusions. These conclusions are statistically stronger than the individual studies because combining results also increases the number of diversity of the study population.
What is a scoping review?
A scoping review is a preliminary assessment of potential size and scope of available data. These reviews are most suited for a body of literature that is complex or heterogeneous and that would not be well suited for a systematic review.
Scoping reviews are useful for assessing emerging evidence when it is still unclear what other, more specific research questions con be posed.
Can be conducted prior to a systematic review.
What is a review of reviews?
This type of review combines relevant data from systematic reviews and meta-analyses to inform recommendations within a specific topic instead of synthesizing studies.
What is journal impact factor?
Because journals vary in quality, researchers look to a quality-rating score.
The impact factor is the average yearly number of citations of recent research from that journal within the past 2 years.
What is grey literature?
Grey literature is a term that describes documents produced for purposes other than commercial publication (i.e. academic journals).
Conference abstracts, government reports, or industry documents.
One reason searching grey literature is important is because it is one way to address publication bias.
What is publication bias?
Studies with positive, significant results are more likely to be published in academic journals compared with those having negative or no results.
What are some examples of Public Health Journals?
- The Lancet Public Health
- Annual Review in Public Health
- Tobacco Control
- International Journal of Behavioral Nutrition and Physical Activity
- American Journal of Preventive Medicine
- American Journal of Public Health
- Journal of Adolescent Health
What steps should you follow when conducting a literature review?
- Get a general overview of the topic
- Select search terms
- Select appropriate databases
- Apply search strategies - (boolean operators, truncation)
- Review your results
- Outline and write your review
What are some common literature databases used for public health research?
- PubMed
- CINAHL/EBSCO
- ERIC
- Academic Search Complete/EBSCO
- PsychINFO
What is truncation?
A database search strategy to find all words that come from the same stem word.
For example: SCHOOL* finds school, schools, schooled, schooling, and so on.
What should you include in your review summary table?
- Citation
- Research Question/ Study Aims
- Study design and sample
- Analysis
- Main Results
- Limitations
- Other Notes
What should you consider when developing a research question?
- The research purpose can affect how you write your question. If you are conducting an exploratory study your question would be very different from one used in an evaluation study.
- It is also important the RQ is not to broad.
- Develop a measurable research question. Make sure what you propose in your research question is feasible.
What should you consider when reading articles?
- What were the research aim?
- How was the aim achieved?
- What were the limitations to the study?
- What are the lessons learned from the study?
- What might you do differently?
- What do authors recommend for future study?
- How could you build on this work?
What is plagiarism?
Plagiarism refers to using the work of another without crediting the original source. It is a form of cheating that can result in negative consequences.
What is common knowledge?
Information most people know. You do not have to cite information any information considered common knowledge.
What style of references do many public health researchers use?
American Medical Association, sequential superscript numbers are used for in-text citation.
The American Journal of Public Health adheres to AMA style
What are some popular citation softwares?
- Endnote
- Mendeley
- Refworks
- Zotero
Why study research?
To make sure we have the best science to improve health
What’s wrong with research or what’s wrong with people’s interpretation of research: Major conceptual things
- The belief that one research design is always the best -all have good and bad points
- Over interpretation of your data (e.g. “proved” or “caused”
- The belief that more of the same is an improvement in knowledge gain
- Insignificant research questions -> best design in the world won’t help bad ideas
- No theoretical foundation
- Failing to consider cultural differences
What is the outline of the scientific paper?
IMRaD is a general outline, details will differ based on 1) discipline of research (ex epi vs psych), 2) journal 3) type of article (brief, review or regular or meta-analysis, regular article, commentary)
Abstracts: structured vs unstructured
1) Introduction 2) Methods 3) Results 4) Discussion
What is included in the Introduction?
Why is the study important
How does it improve and/or extend past work
End with objective/hypotheses
What is included in the methods?
Who were the participants, who was approached, who consented
Basic demographics
How were they consented? Was IRB approval obtained?
Eligibility vs exclusion criteria
How recruited
What analyses you used and why
What is included in the results?
Just the facts, interpretation should be left for the discussion
Appropriate use of tables/charts/graphs
Tables should be able to 1) stand alone 2) not repeat text results
What is included in the discussion?
Review the point of the paper and how the findings match or don’t match with the hypothesis
Compare to previous literature (How does it supplement, extend or contradict)
Discuss limitations and discount them
Provide some speculation about what the findings may mean
Discuss future directions
What are some tips for identifying a bad paper and/ or bad study
- The study did not address an important issue
- Study lacked originality
- Question posed was not actually tested
- In intervention studies, no control group
- Poor writing - bad grammar, too much jargon, too many abbreviations, too many footnotes, etc
- Conflict of interest with authors
- Limited details in provided in write-ups
- Bad methods
What are some bad methods ?
Wrong analyses Assumptions violated Sample size too small Recruiting technique poor Failure to discuss attrition for EACH follow-up in longitudinal samples Wrong study design
What should you consider when making the assumptions of causation?
Is there evidence from true experiments in humans?
Is the assertion strong - how can you tell?
Is the association consistent across studies
Is temporal relation correct
Is there a dose-response gradient
Does the association make epidemiological sense
Is the association specific
Is there a biologic basis
What are some of the ways some people manipulate results?
- Going on fishing expeditions both in terms of finding the test that works for you. Throwing variables in an analysis just because you have them available: theory is good!
- Ignore differences between study completers and non-completers
- Tossing out outliers, regardless of the reason
- Ignoring the value of confidence intervals if they make your results look bad
Why is it important to review papers?
- Service to profession
2. Will make you stronger as a writer
How do you write a review paper?
Reviews should be the three C’s
Concrete - where and how the paper went astray
Constructive, not destructive
Considerate - no belittling, regardless of how bad
Point out the strengths of the paper
Provide a summary of the paper - this way the author knows you got the point
Suggestions for improving tables or deleting tables
Rank your concerns (This is big vs these are minor)
Number your concerns and link to text
No need to point out editing/style things unless it impedes your reading of the work.
Discuss objective and not subjective issues
