Week 2 - Critiquing Research Articles Flashcards
Journal Articles
Typically refers to peer reviewed research articles reporting on the conduct and results of an original study (or replication of a study)
Journal Articles include what parts?
- Title and Abstract
- Introduction
- Methods
- Results
- Discussion
What is included in the introduction section
research question
theory
framework
ROL
It should tell us why we care and start broad and get more specific - sometimes called background or Review of literature
What should be able to be done using the methods section
reader should be able to reliably replicate the study based on this section
a “map” of the study
What is included in the results section
findings of data collected
statistical tests used for analysis
significance of findings - statistical
What is included in the Discussion section
interpretation of results
implications for future practice
limitations of study
references come back into place here again
What are the 2 angles to discuss research
- From the researchers POV dreaming things up
2. From the readers POV reading an article and critiquing it and evaluating how good the methods are
The title of an article can do what?
It can tell a lot about a study based on what is in it alone
ex: Bergstrom article reveals info on ulcer reduction, and randomized meaning quantitative and methods used
ex: JAN article tells you its a phenomenological study (qualitative)
Keywords
often found under the abstract
includes words to search for articles in a database
What is the purpose of research articles
Report for Peers
It should be clear and precise enough and detailed enough from just the article that the study could be replicated
Why are journal articles so hard to read
- Dry - they are written for an audience of peers so there are assumptions you know jargon
- Compactness - space is limited so it may seem choppy or a non-complete study
- Objectivity - avoid any hints of subjectivity by seeming impersonal
- Statistics - can be intimidating
Why may objectivity not be a problem for qualitative studies
because it is inherently subjective so it may come off as less dry
Why are open access articles a recent concern
because taxpayers are paying for the sciences but then the journals are paywalled - sometimes open access lets any article through, but you want to make sure to use peer reviewed information still
Impact Factor
how often the article is referenced or cited by others - if often then it is in high impact journals
What is the difference between Publishing House and Journal name
publishing house is who prints it and the journal contains all of the articles
Why critique journal articles
- Just because it is published does not mean its objectively free from flaws
- Just because the researchers provide implications and recommendations doesnt mean they have addressed them all
- Just because the authors make statements does not mean you will agree - be skeptical to discussion implications and conclusions
What are the types of research reports (Ways to report articles?)
- presentations at professional conferences
2. journal articles in peer reviewed journals
What is the benefit of research reports in presentations at professional conferences
It can decrease lag between conducting research and reporting results
There can be years of lag time, but this can mitigate the lag and peers can see what is occurring in practice a the conference
What are the 2 types of Presentations at Professional Conferences
Oral Presentations
Poster Sessions
Journal Article papers are often subjected to __ __
peer review
Peer reviews are often ___
blind (reviewers are not told names of authors and vice versa)
IMRAD Format
The content and layout of research journal articles
- title and abstract
Introduction
Method
Results
And Discussion
- References
When critiquing a research article always assume the posture of a ___
skeptic
With research articles, who is the onus of responsibility on ?
The authors - to provide evidence that methodological procedures are sound
it is not on the reader to try and justify an authors use or non-use of a theoretical framework - the author should defend and find info
What is the purpose of a quantitative research article
Inference (and Generalization)
Inference
Quantitative
Conclusion drawn from the study evidence using logical reasoning - we want to assume similar results occur with a different population at a different time or area
We want it to be true for larger and different populations
What does a Qualitative studies title include
central phenomenon and group under investigation (ex: phenomenological, grounded, ethnographic)
What does a Quantitative studies title include
title communicates key variables (IV and DV) and the population (PICO components)
Abstract
brief description of major features of a study at the beginning of a journal article
What does the position of first and second author usually say about those people in the research articles
They are usually the two positions that did the most work
First author is very important to the research themselves since titles will often be abbreviated and referred to as that authors article (ex: Bergstrom article)
What can last position author indicate?
they may also be in a position of power like the director of the lab - they can be put in even if they barely had much involvement
Why is it important to look at the credentials of the authors
What their credentials are can tell you a lot about them like if it says PHD compared to an indicate that they are a graduate student
What can asterisks point to when next to a name in an article
it may be indicating where the research practices and you can see whether this is applicable to the study
Author of Correspondence
the author of the article managing the publication of the article
can send questions to their professional address
also check that their address is a professional one rather than a personal one - shows professionalism
Where and what is the statement of disclosure
It is either on the first or last page and it tells if there is any financial interests in the outcome of the study like if they work for a company
Usually it is outside the text in a footnote or in the acknowledgement portion - want to check this even if it ends up saying there is nothing to disclose
Also called a Statement of Disclosure, conflict of interest, or financial disclosure
What are the components of the introduction
- Description of central phenomena, concepts or variables
- Study purpose –> research Q –> hypotheses (last piece in intro)
- ROL (What is seen already, what’s a problem, what you do different)
- theoretical/conceptual framework
- Study significance, need for study
Purpose Statement
It shows the objective, goal, purpose of the study and it determines the reason for the study
What are the ways to talk about problems in the intro for research in nursing
- Cost to the patient - health wise - morbidity, what it costs in regard to their health and function
- Financial costs and health costs
How may a qualitative studies introduction be different from a quantitative study
Its more difficult to start broad and get specific with abstract topics so we explain why to care right after the broad followed by a similar ending paragraph with a purpose statement based on the question
Basically, less funneled.
Gaps
Gaps in the literature mean that some people have tried a few things but no one has gotten to and tried this particular thing on this particular population
This will be mentioned in the intro in ROL on how other studies did their research and what was not done and how you plan to accomplish it
What is the thing that opens the door and justifies a specific research question, study, and article
Gaps in the literature
Parts of the Method Section
Research Design
Sampling Plan (who is included)
Methods of measuring variables and collecting data
Study procedures, including procedures to protect participants
Analytic methods and procedure (map out future replications)
How do Qualitative Methods Sections differ from Quantitative?
They both have similar components but the qualitative study includes different emphases
There is more information about the research setting and context in qualitative studies
There is a higher emphasis description of the researcher’s effort to enhance the integrity of the study as well in qualitative study
What does the findings section of quantitative studies look like
- Names of stat tests used
- Value of calculated statistics
- Statistical significance
- Level of statistical significance (index of how probable it is that the findings are reliable (p level and alpha))
Demographics of the sample are often also included with a breakdown
What does the findings section of qualitative studies look like
Findings often organized according to major themes, processes, or categories identified in the analysis
Almost always includes RAW DATA - quotes directly from study participants
It will describe whether it is grounded theory v phenomenological v ethnographic
When are tables and figures mentioned
twice
- in title of table or figure
- when referenced and presented
Table
information that is presented as a table of data laid out
Figure
some graphic representation like a histogram, pie chart, increase/decrease graph
What is the difference between n and N
n (little) = group in the sample
N (big) = whole sample overall
For groups, do we want to see a statistically significant difference between them with p values?
No we want them the same because if they are significant different it means something is different between the group and its not just variation among them
Discussion Section Parts
Interpretation of the results (AUTHORS NOT YOURS)
Clinical and research implications
Study limitations and ramifications for the believability of the results (ethical obligation to be transparent about limitations - when critiquing note other limitations they should have included)
Fidelity
implementation of same protocol the same way every time (consistent to trust results that we have) - no matter who or where protocol fidelity is needed
Tips for Reading Research Articles
Read regularly, get used to the style
Read copied articles - underline, highlight, write notes
Read slowly
Read ACTIVELY
Look up technical terms in glossary
Dont be intimidated by statistics - grasp the gist of story
Critical Appraisal
an objective assessment of a study’s strengths and limitations
Critiques
A technique used to inform EBP focus on whether evidence is accurate, believable, and most importantly - clinically relevant (will it make patient lives better)
Critiques of individual studies can be done for what reasons?
A variety of reasons like a student assignment, making decisions about whether or not to publish a manuscript, EBP purposes, etc
Both critiques and critical appraisals are what?
Careful and objective appraisals of the researchers major conceptual and methodological decisions, but they vary in scope and aim
What is the Key research challenges?
Designing studies to support INFERENCES that are:
- Reliable and Value (Quantitative)
- Trustworthy (Qualitative)
Inference
a conclusion drawn from the study evidence using logical reasoning and taking into account the methods used to generate that evidence
What are the criteria for evaluating quantitative research (scientific merit)
Reliability
Validity
Reliability
the accuracy and consistency of obtained information
ex: if we get on the scale each day it should not vary wildly - it will some and over time - but it should be close day by day
ex: Dartboard - all darts land near each other
It is easy to do with physiologic measures but harder with social and psychological measures
What needs to be established first reliability or validity
reliability must be established first
Validity
The soundness of the evidence - whether findings are convincing, are well grounded, and support the desired inferences
It has to do with how well we describe and establish content we talk about - how sound the evidence is
ex: If the dartboard all hits the bullseye thats validity
ex: After the person established reliability with a scale differentiation of anxiety from everyday stress or depression should be made for validity
Evaluative Criteria in Qualitative Studies
Trustworthiness (the goal with qual is not generalizability but transferability)
5 types of Trustworthiness
Credibility
Confirmability
Dependability
Transferability
Authenticity
(These all have a quantitative analog)
Credibility (Trustworthiness)
a key criterion
achieved to the extent that researchers can engender confidence in the truth of the data and their interpretations
Triangulation
A particularly salient way of establishing reliability and validity - it uses multiple sources of data or referents to draw conclusions about what constitutes the truth
It can also contribute to credibility
ex: If you want to measure anxiety, use multiple methods like a scale, physiologic measures, etc and then triangulate the data
Which type of study benefits from triangulation
it is a useful strategy in both qualitative and quantitative research
Bias
a distortion or influence that results in an error in inference
a systematic over or under representation of some factor
usually comes from the researcher - who they choose to be, tools used, methods used, etc - needs to be thought of and eliminated
Examples of Factors that create bias
Lack of participants candor
Faulty methods of data collection
Researchers preconceptions
Participants awareness of being in a special study
Faulty study Design
Social Desirability Bias
bias that is very frequently occurring where participants try telling you what they think you want to hear from them
Hawthorne Effect
when people act differently due to the knowledge of being in an experiment
Research Control
In quantitative studies, this involves HOLDING CONSTANT extraneous factors (confounding variables) that influence the dependent variable to better understand relationships between the IV and DV
Its a method of controlling and addressing bias
ex: we eliminate participants with confounding diseases or conditions
What is the easiest way to do research control
Have a control group so we know what a group looks like without intervention
Rnadomness (Bias Reduction)
allowing certain aspects of the study to be left to chance rather than to researcher or participant choice
(this is an important tool for achieving control over confounding variables and avoiding bias)
So for example, we randomly allocate people to different groups
Blinding/Masking (Bias Reduction)
Used in some quantitative studies to prevent biases stemming from people’s awareness of what group they are in or knowledge of what group participants are in
Blinding involves concealing information from participants, data collectors, or care providers to enhance objectivity
Can be single or double (However its not always possible to use)
Reflexivity
the process of reflecting critically on the self and of attending to personal values that could affect data collection and interpretations in the data
can help stop bias
ex: If yore a critical care nurse then you may be biased if the subject is critical care and you should be aware of that
How is reflexivity used in qualitative and quantitative studies
Qualitative: Researchers are trained to explore these issues, to be reflective about decisions made during the inquiry, and to record their thoughts in personal diaries and memos
Quantitative: Can be a useful tool giving self awareness (in both kinds of study) and introspection which allows for enhanced study quality
Generalizability
Quantitative goal
The criterion used in quantitative studies to assess the extent to which the findings can be applied to other groups and settings
taking results and applying to different populations and getting the same results
Transferability
Qualitative goal
The extent to which qualitative findings can be transferred to other settings
Will we ID or see similar types of themes regarding these experiences in other settings (maybe not the experience exactly though)
The goal of quantitative studies is ___ and the goal of qualitative studies is ___
Generalizability; Transferability
What is one way to enhance transferability?
The amount of richness in the descriptive information - the richer it is the more we can understand and transfer to other places
T/F: The ROL is typically found in the method section of the research report
False
ROL is found in the introduction
T/F: A researcher would describe the limitations of the study in the result section of the report
False
The study limitations are typically described in the discussion section of the report
T/F: Research critiques are done to evaluate the strengths and limitations of a study
True
Although there are a wide variety of reasons for critiquing research, research critiques provide careful and objective appraisals of the strengths and limitations of a study
What component is a key aspect of trustworthiness?
A) Triangulation
B) Reliability
C) Credibility
D) Validity
C) Credibility
Credibility is a key criterion for trustworthiness. Reliability and Validity are key for evaluating quantitative research. Triangulation is the use of mult. sources or referents to draw conclusions
T/F: Blinding is used in qualitative studies
False
Blinding is used in quantitative studies to reduce bias that results from awareness
