Critical Inquiry and EBP Flashcards
On the hierarchy of evidence what is level 1 evidence? (highest level)
Evidence obtained from systematic reviews, high-quality diagnostic studies, prospective studies, or randomized controlled trials
On the hierarchy of evidence what is level 2 evidence? (second highest level)
Evidence obtained from lesser-quality diagnostic studies, systematic reviews, prospective studies, or randomized controlled trials (eg, weaker diagnostic criteria and reference standards, improper randomization, no blinding, less than 80% follow-up)
On the hierarchy of evidence what is level 3 evidence? (third highest level)
Case-control studies or retrospective studies
On the hierarchy of evidence what is level 4 evidence? (second lowest level)
Case series
On the hierarchy of evidence what is level 5 evidence? (lowest level)
Expert opinion
On CPGs, what justifies an A level for research?
A preponderance of level I and/or level II
studies support the recommendation. This
must include at least one level I study
On CPGs, what justifies a B level for research?
A single high-quality randomized controlled
trial or a preponderance of level II studies
support the recommendation
On CPGs, what justifies a C level for research?
A single level II study or a preponderance of
level III and IV studies, including statements
of consensus by content experts, support the recommendation
On CPGs, what justifies a D level for research?
Higher-quality studies conducted on this
topic disagree with respect to their conclusions. The recommendation is based on these conflicting studies
On CPGs, what justifies an E level for research?
A preponderance of evidence from animal or cadaver studies, from conceptual models/principles, or from basic science/bench research support this conclusion
On CPGs, what justifies an F level for research?
Best practice based on the clinical experience of the guidelines development team
What is the difference between a dependent and independent variable?
Dependent- what is being measured
Independent-What is being manipulated
If a study is trying to decide is manual therapy is better at decreasing pain levels in patients compared to ultrasound, what are the dependent variables and what are the independent variables?
Dependent-pain levels
Independent-Manual therapy and Ultrasound
What is a P-value?
What is an alpha value?
The chance that the results of a study are due to chance
alpha value is the pre-set P-value that the study puts forward to make if results are statistically significant
The P value has to be lower than the alpha value to be significant
If a study sets an alpha value at .05 and the P value they get after running their numbers comes back at .08 what should be the conclusion?
Results were not statistically significant
What is a type 1 error?
When a study decides that there IS a statistical difference when there is in fact not one (backing a loser)
What is a type 2 error?
What is the best way to avoid type 2 errors?
when a study says there IS NOT a difference when there actually is one (missing a winner)
Increasing the N (number of subjects)
What is an effect size?
What level constitutes a large effect?
Moderate?
Small?
Trivial?
how much better an independent variable is compared to another
Large=.8 or greater
Mod=.5-.7999
small=.2-.4999
trivial=smaller than .2
What would your conclusion be if, in a study, you found an effect size of IV-1 compared to IV-2 to be .456?
There is a small effect size, IV-1 is slightly better than IV-2
What would your conclusion be if, in a study, you found an effect size of IV-1 compared to IV-2 to be .98?
There is a large effect size, IV-1 is much better than IV-2
What would your conclusion be if, in a study, you found an effect size of IV-1 compared to IV-2 to be .03?
There is a trivial effect size, IV-1 may or may not be better than IV-2
What would your conclusion be if, in a study, you found an effect size of IV-1 compared to IV-2 to be .65?
There is a moderate effect size, IV-1 is better than IV-2
What is interrater reliability?
Intrarater reliability?
Inter=reliability between clinicians
Intra=reliability between one single clinician
What is Coen’s Kappa?
What levels equal excellent, good, fair, and poor?
A statistic that measures reliability where 0.0=no reliability and 1.0=perfect reliability
below .4=poor reliability
.4-.6=fair reliability
.6-.75=good reliability
above .75=excellent reliability