Research Appraisal and Classification

Question 1

Name the components that contribute to the quality of evidence.

Answer 1

o Study design
o Credibility
o Applicability

Question 2

How does the article’s research question contribute to its appraisal?

Answer 2

Determines optimal design

Design should be consistent with purpose

Question 3

T or F, a RCT is NOT the gold standard for all types of research questions

Answer 3

T

Question 4

How are quasi-experimental designs important contributors to practice-related knowledge?

Answer 4

o May be closer to real life

o Pre-test/post-test/follow up

Question 5

How are non-experimental designs important contributors to practice-related knowledge?

Answer 5

o Answer background questions

o Answer descriptive questions

Question 6

How are cohort studies useful?

Answer 6

§ More pragmatics than RCT
§ Helpful in decision making
§ **don’t have to have RCT if you have good strong cohort studies

Question 7

What are the threats to internal validity?

Answer 7

MRS. SMITH (Review this!)
Maturation, Regression to the mean, Selection of subjects, Selection by maturation interaction, Mortality, Instrumentation, Testing, History

Question 8

What does it mean to say that P < .05?

Answer 8

%5 chance that there were differences, one group did better and so it wasn’t true what you said

the more and more tests you do with the same data, the closer you get to that same chance

Question 9

type 1 error

Answer 9

– when you say there are differences and there are not

Question 10

What are CAPs?

Answer 10

o Short analysis of an individual study

o Critique and interpretation

Question 11

What are CATs?

Answer 11

Summaries of multiple studies on a topic

Question 12

How is a CAT different from a systematic review?

Answer 12

o In a CAT:
o Less rigor
o More concise than a systematic review/limited focus
o More limited focus
o Emphasis of practical application
o Sort of think of it as a mini-systematic review

Question 13

What are the advantages to CAPs?

Answer 13

o Advantages:
o Succinct appraisal of single research study
o Describe strengths and weaknesses
o Discuss implications for practice, education and research
o Include many types of evidence

Question 14

What are the disadvantages to CAPs?

Answer 14

o   Disadvantages:
o   Not all peer reviewed
o   Meant to be a guide
o   Someone else’s interpretation
o   Implications for practice may not apply to your particular case/client or practice setting

Question 15

What information will you use to develop clinical bottom lines of your CAT?

Answer 15

o   Results
o   What did all these studies say?
o   Validity
o   May be had one really strong study that found something different than another study with a weaker design
o   Common themes

Question 16

More specifically, how will you identify intervention themes for your CAT?

Answer 16

o   Mix of supportive/unsupportive studies?
o   Efficacy and/or effectiveness?
o   Comparative effectiveness?
o   Clinical significance?
o   Benefit/harm considerations?
o   Intervention fit with the setting?
o   Intervention fit with the client?

Question 17

More specifically, how will you identify descriptive themes for your CAT?

Answer 17

o Illuminate understanding?
o Explain how it is helping you to understand it
o Guide your thinking or approach?
o Increase awareness of issues to address?
o Findings informative for clients/caregivers?

Question 18

More specifically, how will you identify assessment themes for your CAT?

Answer 18

o What is it valid for?
o How can it be used?
o Is it sensitive and specific?
o Is it responsive? (will it show change over time?)

Question 19

o Since there is not a well-developed theory to describe a phenomenon, you decide to use a _______ study to explore relationships that could later be studied _________

Answer 19

qualitative

quantitatively.

Question 20

The researcher studied the culture of an inpatient psychiatric facility by working as an occupational therapist in the setting. What is the data collection method called?

Answer 20

Participant observation

Question 21

Data collection involved interviews of multiple participants, including a wide range of views and perspectives. What is this called?

Answer 21

Triangulation of sources

Question 22

The two researchers coded each transcript separately and then met to compare notes and discuss coding and category formation. What is this technique called?

Answer 22

Researcher triangulation for enhanced dependability

Question 23

During the interview of the participant, you pay close attention in order to remember everything the participant said and his or her reactions and nonverbal communication during the interview. Based on your memory of the interview you develop the themes and determine your findings. Why is this an inappropriate practice?

Answer 23

This does not allow for dependability of the study. Audio recording and taking field notes would make the study more reliable and allow for recording reflexivity.

Question 24

The researcher created focus groups by including a wide variety of dissimilar respondents. Why is this an inappropriate practice?

Answer 24

Having dissimilar respondents is an indication that individual interviews are needed.

Question 25

The researcher began data analysis by organizing the data into chunks. Why is this inappropriate practice?

Answer 25

The first step in qualitative data analysis is reading and rereading the data.

Question 26

You randomly select individuals who were in the military and administer a written survey with multiple choice and Likert-type items to identify themes related to transitioning from the military to postsecondary education. Why is the an inappropriate practice?

Answer 26

It is an objective approach rather than investigating subjective, individual lived experiences.

Question 27

o Participants were selected to provide a diverse and purposive sample with a broad range of experiences and perspectives. What is this type of sampling called?

Answer 27

Maximum variation sampling

Question 28

You interview three college students with disabilities who each discuss something similar about access to campus recreations facilities. Based on their statements, you decide to observe the students during activities at the recreations facility. What is this adaptation of data collection procedures called?

Answer 28

Evolving or emergent design

Question 29

The researchers ask the participants to react to the themes that were identified in the data. What is this technique called?

Answer 29

Member checking

Question 30

The researcher used a systematic process of self examination to uncover his own biases and assumptions. What is this called?

Answer 30

Reflexivity

Question 31

The researcher spent 2 years observing, audiotaping and videotaping a group of participants. What characteristic of qualitative data collection does this illustrate?

Answer 31

Prolonged engagement

Question 32

As a qualitative researcher, you reflect on your impact on the data collection and writing of the research. What is this called?

Answer 32

Reflexivity

Question 33

As a qualitative researcher, you use an ____ reasoning approach to identify themes from specific information in your narrative data.

Answer 33

inductive

Question 34

Your data collection methods are limited to interviews with three participants. Why is this an inappropriate practice?

Answer 34

Triangulation can enhance dependability, credibility, conformability and trustworthiness of the study.

Question 35

Before beginning qualitative data collection, you determine the number of participants to interview and observe. Why is this an inappropriate practice?

Answer 35

Qualitative research uses emergent evolving design and data is collected until saturation is reached

Question 36

You utilize an ethnographic design to develop a theory about the role of food activities among community-living older adults. Why is this an inappropriate practice?

Answer 36

Grounded theory is the design used to develop a theory.

Question 37

Your PICO question relates to the lived experience of people with schizophrenia who work full time. You reject studies with small samples since they are not as generalizable. Why is this inappropriate practice?

Answer 37

Qualitative research (or PICO questions) doesn’t rely on generalizability; transferability is an issue but it is not critical. It is more the job of the reader than the researcher.

Question 38

The researcher provide dense descriptions of the research methods in order to enhance credibility of the research? Why is this inappropriate?

Answer 38

Dense description enhances repeatability.

Question 39

You wait until all data is collected before beginning data analysis. Why is this an inappropriate practice?

Answer 39

In qualitative research, data analysis overlaps with data collection.

Question 40

o The researcher limited her filed notes to verbatim statements of the participants in their natural setting. Why is this an inappropriate practice?

Answer 40

Field notes also include thoughts, ideas, and insights of the observer, allowing reflexivity.

Question 41

The primary investigator included research participants as researcher to enhance the external validity of the study. Why is this inappropriate?

Answer 41

This enhances internal reliability; external validity is a quantitative term.

Question 42

Although no new perspective or ideas arise during the interviews and observations, you continue data collection in order to obtain a sample that is representative of the population. Why is this inappropriate practice?

Answer 42

In qualitative research, data is collected until saturation is reached and representation of the population is not a consideration.

Question 43

During the interview of the participant, you pay close attention in order to remember everything the participant said and his or her reactions and nonverbal communication during the interview. Based on your memory of the interview, you develop the themes and determine your findings. Why is this inappropriate practice?

Answer 43

This does not allow for dependability of the study. Audio recording and taking field notes would make the study more reliable and allow for recording reflexivity

Question 44

You use a deductive reasoning approach to test a hypothesis, analyzing numerical data to explore and describe the cultural characteristics of specific group. Why is this inappropriate?

Answer 44

Qualitative research used an inductive reasoning approach.

Question 45

You utilize a historical study design to represent the life story of an individual with a disability to reveal how occupation worked in his life and his expectations for the future. Why is this inappropriate practice?

Answer 45

Narrative design is used to represent an individual’s life story.

Question 46

Red card:

Answer 46

non-typical or non-normative situations are included to determine the average experience and identify whether outliers affected the analysis.

Question 47

o Since you believe that objective inquiry and analysis are possible, you attempt to eliminate bias and use objective measurement during qualitative data collection.

Answer 47

Yep

Question 48

o The researcher uses auditing to enhance the transferability of data analysis. Why is this inappropriate?

Answer 48

Auditing enhances dependability, confirmability, and credibility; thick descriptions enhance transferability.