Research EXAM #4 Flashcards
Rating Systems for Grading levels of evidence
Level I (most credible/best form of evidence/full blown experiments)
– Multiple randomized controlled trials (RCTs) reported as meta-analysis, systematic review, or
meta-synthesis, with results that consistently support a specific intervention or treatment
– Randomized trials with large sample sizes and large effect sizes
Level II:
– Evidence from well-designed controlled studies, either randomized or nonrandomized, with
results that consistently support a specific intervention or treatment
Level III:
– Evidence from studies of intact groups
– Ex-post-facto and causal-comparative studies
– Case-control or cohort studies
– Evidence obtained from time series with and without an intervention Single experimental or
quasi-experimental studies with dramatic effect sizes
Level IV :
– Evidence from integrative reviews
– Systematic reviews of qualitative or descriptive studies
– Theory-based evidence and expert opinion Peer-reviewed professional organization standards
Characteristics of Level I Grading of Evidence
most credible/best form of evidence/full blown experiments
– Multiple randomized controlled trials (RCTs) reported as meta-analysis, systematic review, or
meta-synthesis, with results that consistently support a specific intervention or treatment
– Randomized trials with large sample sizes and large effect sizes
Systemic review
The person writing the review did the literature review
Which design is the gold standard for testing interventions?
Experimental design = Level 1
Gold standard for evidence-based practice
Experimental design
Randomized Controlled trials, clinical trials
Highly structured studies of cause and effect applied to determine the effectiveness of an intervention
Why is experimental design the gold standard for evidence-based practice
They provide convincing support for the value of a treatment
Uses of QUANtitative methods
Measure the probability of alternative explanations
for outcomes
● Isolate and evaluate the effect of an intervention
on an outcome
– e.g. patient is taking too many pills, how do you determine which one is actually working? Eliminate drug one at a time
● Answer questions about cause and effect
– Confounding or extraneous
When you think of QUANtitative, what does it mean?
– Cost and effect
– Influence and relationship
QUANtitative variables are measured by
– Independent variables (IV)
– Dependent variables (DV)
– Extraneous (confounding) variables
An independent variable (IV) is
■Controlled by the researcher
■Introduced into the experiment
■Manipulated by the researcher
Purpose of extraneous variables (confounding)
If it exists, you must:
■Identify, eliminate, control
Use of QUANtitative measurement
○ Direct or indirect
○ Prospective or retrospective
○ Primary or secondary sources
○ Reliability and validity of primary concern
Primary vs. secondary sources
Primary: gathering data from person directly; looking for the original author
– “I did this study. These are my outcomes.”
Secondary: data already collected
– e.g. going through medical records to go through BPs and blood sugars
– taking information and quoting me on MY study; got it from somebody else’s article
Difference b/w retrospective vs. prospective measured data in QUANtitative measurement
Retrospective = taking data from something that already happened (the data was there)
– e.g. were the patient in the last 3 months satisfied with their meals?
Prospective = collecting data now to use in the future (don’t know when/how/where)
– e.g. birth cohort study
Reliability vs. validity
Reliability: QUANtitatve study done over and over with different populations, AND the findings are “consistent”
Validity: when the instrument measures what it was designed to measure
– e.g. study to measure anxiety, and better not measure excitability –> study not valid, b/c instrument using is not being used the way it’s supposed to be measured
what do you do in study to check validity? instrument used
Reliability vs. Validity
Reliability = consistency
Validity = instruments you are using in QUANTitative study tests what it was designed to test
— instrument to test anxiety, but realized you’re testing excitement —> using the wrong instrument/design and therefore NO longer valid
A priori
The researcher has to lay out EVERYTHING in front before conducting the study (everything they’re doing, methodology, design, sample sizes, location of sample sizes, laid out) —> IRB and come back —> CANNOT change b/c jeopardize subject (even if they thought of something better that can impact the study)
Constructivist Research
— Discover the meaning and interpretations of events, phenomena, or experiences
— Study cases in their natural setting and analyze the interpretations
— People construct their own knowledge based on their experiences
Characteristics of a priori study
A priori selection of design
○The design is selected after the research
question is clarified
○No change applied once the design is
chosen
■Ensures credibility
■Reduces bias
Casual design/studies
● Randomized group assignment
● Highly controlled conditions
● Results are quantitatively analyzed
— inferential statistics: BPs
– to analyze the demographic, will be descriptive statistics: 35 males and 45 females
Quasi-Experimental design
● Similar to experimental
● Studies of cause and effect
● Subjects are not randomly assigned to groups
● Major difference
○ uses convenience sampling
○ Or existing groups
Cause and effect examples
●What is the effect of continuous, low-level
zinc ingestion on the occurrence of the
common cold among young adults?
●Does ATI practice questions improve NCLEX
results of nursing students?
Quasi-Experimental vs. Experimental
Quasi-experimental: will not be randomized assigned; use existing groups or convenience sampling
Experimental:
QUANtitative designs that focus on intact groups
● Ex post facto research (“after the fact”)
● Causal-comparative: comparing each group b/c receiving different type of intervention
– e.g. 3 stress relieving intervention: one gets massages, one exercises, one solely education packet
● Case/control
Time-series designs
● Type of quasi-experimental
● Measurement of a group over time
● IV manipulated at some point in time
● Group serves as its own control
● Enable the researcher to:
○ Determine effectiveness of intervention
○ Quantify timing of effects
– e.g. Does low carb diet decrease BG at 3 weeks, 3 months, 6months; check for trending?
How is QUANtitative research is used in practice?
– Assessment of procedures
– Dx of nursing problems
– Effectiveness of interventions
– Evaluating patient outcomes
Design used to answer this question:
How do patients with chronic pulmonary hypertension respond to a lung transplant?
Case research methods
Design used to answer this question:
How do nurses on a neonatal unit respond to a medication error causing a death?
Case research methods
Design used to answer this question:
How nurses are portrayed in the media?
Content analysis
Design used to answer this question:
What are the perceived barriers for ethnically diverse students in nursing programs?
Content analysis
Design used to answer question:
What is the nature of moral distress in nurses related to witnessing futile care in the critical care unit?
Phenomenology
Design used to answer question:
What are the long-term implications for intimacy of couples in which the husband has been treated for prostate cancer?
Phenomenology
Example of QUALitative design to answer question:
Which cultural issues emerge during a merger between a for-profit hospital and a not-for-profit hospital?
Ethnography
Example of QUALitative design to answer question:
What is the culture of the waiting room for the open-heart surgery unit?
Ethnography
Example of design to answer question:
Which relationships and interactions affect intimate-partner violence?
Why are CCRN unhappy?
Grounded theory (the root cause)
Example of design to answer question:
Which relationships and reactions lead to teen pregnancy?
Grounded theory
Define statistical significance + example
The intervention MADE A DIFFERENCE; the intervention caused the outcome; was not any extraneous variable; treatment caused the outcome based on that intervention
— e.g. people who exercise vs. who DO NOT exercise
Define clinical significance + provide example
In research, can be used in practice; can make a difference in a patient’s outcomes
Snowball sampling + example
— A nonprobability sampling method that relies on referrals from the initial subjects to recruit additional subjects.
— This method is best used for studies involving subjects who possess sensitive characteristics or who are difficult to find.
_____________________
E.g. members who belong to a club and encountered similar issues