Interpretating Quantitative Findings and Evaluating Clinical Signficance Flashcards

1
Q

DO stat results of a study allow for use in the real world?

A

No the stat results of a study in and of itself do not convey much meaning but the statistical results must be interpreted to be of use to the clinician and other researchers for us int eh real world

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What are the 6 important considerations when itnerpreting statistical results

A

Credibility

Precision

Magnitude

Meaning

Generalizability

Implications

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

6 Considerations: Credibility

A

the credibility and accuracy of the results

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

6 Considerations: Precision

A

Precision of the estimate of effects

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

6 Considerations: Magnitude

A

magnitude of the effects and improtance of the results

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

6 Considerations: Generalizability

A

generalizability of the results t the greater population

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

6 Considerations: Implications

A

implications of the results for practice, theory, or further research

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Interpreting research involves making a …

A

a series of inferences

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Inference

A

involves drawing conclusions based on limited information, using logical reasoning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What do we infer from study results

A

“truths in the real world”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Statistical findings are what in regard to the true state of affairs in the real world

A

stand ins/ proxies

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Through inference, study results…

A

are inferred to be truths in the real world

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

EBP involves doing what to research evidence when making clinical decisions

A

integrating the evidence with your decision making

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Approach the task of interpretation with what kind of mindset

A

a critical - and even skeptical one

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

The onus of the responsibility for providing strong evidence that is credible is on who

A

the researcher - they should acknolwedge limitations adn discuss good choices

they should be the ones stating and showing that the null hypothesis has no merit

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Credibility of quantitative results relies on what

A

validity

biases

corroboration

proxies and the interpretation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Every part of a study acts as…

A

a proxy for a real life situation / a representation of reality

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Steps of using a sample as a proxy for the real world

A

Population Construct –Delineationg–> Target population –ID–> Accessible Population –Selection–> Recruited sample–refusal/attrition –> Actual sample

From all of this we infer

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What happens as we go from population construct of interest toward our actual sample in regard to inferring from research results

A

Each step reduces the possibility the same we end up with is truly representative but we want the best possible methods for true inference of population in question

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

CONSORT

A

Consolidated Standards of Reporting Trials

Reporting guidelines that have been developed so readers can better evaluate methodological decisions and outcomes

Includes a flowchart for documenting participant flow in a study - is included as a table in most studies nowadays

21
Q

CONSORT Table

A

Shows the flow of participants throughout a study

Will show who met inclusion requirements and then who was excluded and then who was left for enrollment into the groups

Randomize into groups and then follow the flow - look who left/attrition and can get attrition rates and see who was not participating in the research

22
Q

How are credibility and validity related

A

They link with inference

so it is linked to the amount you can actually infer from the results about the real world

Includes: external, internal, construct, and statistical conclusion validity

23
Q

Statistical Conclusion Validity

A

Power

Has to do with the methods and such like sample size and sampling

24
Q

Construct Validity

A

how accurately are you measuring the construct of interest

is it an accurate proxy for the thing you want to measure - like BP and stress

25
Q

External Validity

A

generalizability - will it replicate through time and space

26
Q

Hawthorne Effect

A

change in behavior if being watched - selection, hx, etc

We want to protect against these threats with a control group, baseline testing, randomization, etc

27
Q

What is the research’s job regarding credibility and bias

A
  1. Translate abstracts into appropriate proxies
  2. Eliminate, reduce, or control biases
  3. Look out for biases and factor them into assessment about the credibility of the results
28
Q

What is important to consider regarding biases

A

what types may be present and how extensive, sizeable, and systematic they are

29
Q

What is credibility in reference to corroboration

A

seeking evidence to disconfirm the “null hypothesis”

Do this by determining quality of the proxies that stand in for abstractions, ruling out biases, and seeking corroboration for the results via replication

30
Q

The best way to corroborate results is…

A

replication

It will check for type I and II error, rule out biases, corroborate results, and show how good researcher choices were

31
Q

Results from statistical hypothesis tests indicate whether…

A

a relationship or group difference is probably “real”

32
Q

How helpful is the p-value with looking how precise/precision of results

A

p-value in hypothesis testing offers information that is important (whether the null hypothesis is probably false) but it is incomplete

33
Q

What is the value to observe in order to determine precision of study results

A

Confidence Intervals (CIs)

they communicate information about how precise the study results are

34
Q

Results support the researcher’s hypothesis are described as _____, however…

A

significant; that does not meant they are clinically significant - they need evaluation on top of that on whether the effects are large and useable in a clinical setting

35
Q

Any interpretation of meaning of a credible and precise study result requires what

A

understanding not only the methodological issues but also theoretical and substantive ones

36
Q

Interpreting stat results are easiest when hypotheses are…

A

supported (when they are positive results)

37
Q

Meaning and Causality in Study Results

A

great caution is needed when drawing causal inferences - especially when the study is non-experimental (and cross sectional)

38
Q

The critical maxim is…

A

correlation does not prove causality

39
Q

What are the greatest challenges to interpreting the meaning of research results

A
  1. nonsignificant results
  2. serendipitous significant results
  3. results contrary to the hypotheses
40
Q

Because statistical procedures are designed to provide support for research hypotheses through the rejection of the null hypotheses, it is very hard to…

A

test a research hypothesis that is a null hypothesis

41
Q

Clinical Significance

A

The practical importance of research results in terms of whether they have genuine, palpable effects on the daily lives of patients or on the health care decisions made on their behalf

do the research results have meaning to use in the practice environment

42
Q

Practical Significance (Group Level Clinical Significance)

A

Typically involves using stat information other than p values to draw conclusions about the ufefulness of research findings

43
Q

What are the 3 most widely used statistics for group level clinical significance (as well as being unique to EBP)

A
  1. Effect Size (ES) indexes
  2. Confidence Intervals (CIs)
  3. Number needed to treat (NNT)
44
Q

Clinical significance at the individual level involves..

A

ESTABLISHING A BENCHMARK (or threshold) that designates the score value on a measure (or the value of a change score) taht would be considered clinically important

This is a situation where we look at scores over time rather than compare two groups - so we need conceptual definitions of clinical significance and operationalization of clinical significance establishing the MIC benchmark

45
Q

The focus of clinical significance at the individual level is on…

A

individual change scores (over time) rather than differences between groups

46
Q

T/F: Statistical results provide the most meaningful means of communication about a study’s results

A

False

Rationale: The stat results do not in and of themselves communicate much meaning- they must be interpreted to be of use to others

47
Q

T/F: A researcher supports inference that he or she wishes other to make, based on the research results, by ensuring study validity

A

True

Rationale: Inferences of the type the researcher wishes people to make are supported by rigorous methodological decisions, minimization of threats to study validity, good proxies or stand-ins for abstract constructs, elimination or reduction of bias, and efforts to find corroborating evidence.

48
Q

T/F: In a nonexperimental study, correlation and causation are the same

A

False

Rationale: In a nonexperimental study correlation does not prove causation