Module 03 Flashcards

Evaluating Research

1
Q

What are the 5 criteria (issues of concern) for evaluating research?

A
Truth Value
Applicability
Consistency
Neutrality
Ethics
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Describe the criteria of truth value

A

Are the findings of the study believable? Are they legitimate given the research paradigm used?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Describe the criteria of applicability

A

Are you able to use results of the research in similar contexts with similar participants?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Describe the criteria of consistency

A

Can you follow the research steps of the study and come to similar conclusions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Describe the criteria of neutrality

A

Has the researcher discussed all potential sources of bias

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What are bias?

A

Refers to results being skewed in an unfair or inaccurate way. In quantitative research, it is defined as a “type of systematic (nonrandom) error in the design or conduct of study that can lead to erroneous results”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Describe the criteria of ethics

A

Was the study conducted in compliance with standards of research ethics?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What are the 3 core principles upheld by the Ethical Conduct for Research Involving Humans?

A

Justice
Concern for Welfare
Respect for Persons

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Qualitative vs Quantitative: truth value

A

Qualitative: Credibility
Quantitative: Internal validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Qualitative vs Quantitative:

Applicability

A

Qualitative: Transferability
Quantitative: External Validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Qualitative vs Quantitative:

Ontological Stance

A

Qualitative: Trustworthiness
Quantitative: Replicability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Qualitative vs Quantitative:

Consistency

A

Qualitative: Dependability
Quantitative: Reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Qualitative vs Quantitative:

Neutrality

A

Qualitative: Confirmability
Quantitative: Objectivity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What are the 4 issues of concern for quality research in quantitative research?

A

Internal Validity (Truth Value)
External Validity (Applicability)
Reliability (Consistency)
Objectivity (Neutrality)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is internal validity?

A

Issue of concern in quantitative research.
It is the extent to which the researcher can show that the information collected accurately answers the research question.
Threatened by; bias in selection of observations of participants, information collected, failure to control for extraneous factors

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is external validity?

A

Issue of concern in quantitative research
Also called generalizability, refers to the degree to which the results of the study are true for population other than the sample studied
Complex and Judgment-based, does not define usefulness of study

17
Q

What is reliability?

A

Issue of concern in quantitative Research

Refers to the consistency of a study’s results. If finding from research are replicated consistently they are reliable

18
Q

What is Objectivity?

A

Issue of concern in quantitative research
Relates to the researcher’s neutrality
Requires safeguarding against conflicts of interest, observing reality without contamination from his/her experience and values.
Achieved by standardizing protocols for data collection, coding analysis, and reporting

19
Q

What does the positivist paradigm emphasize?

A

replicability

20
Q

What does the constructivist paradigm emphasize?

A

Trustworthiness

21
Q

What are the 4 issues of concerns in qualitative research?

A

Credibility (Truth value)
Dependability (Consistency)
Confirmability (Neutrality) Transferability (Applicability)

22
Q

What is credibility?

A

Issues of Concern in Qualitative research
Refers to how believable the findings are
Based on an assessment of the design features adopted by the researcher to verify findings
Techniques such as triangulation and member checking enhance the credibility of qualitative study results

23
Q

What is triangulation?

A

Corroboration among findings from different data sources or methods to capture

24
Q

What is Member Checking?

A

Asking participants to confirm that their words as transcribed match what they intended to say and/or that the researcher’s emerging understanding reflects the study participants’ experiences or perceptions.

25
Q

What is Dependability ?

A

Issue of concern in qualitative research
Stability or consistency of the research processes throughout the course of the study.
Review of the activities of the researched by an independent person is needed to assess dependability (dependability audit) - only possible if researcher has clearly documented how the study was conceptualized and any changes that occurred in the setting
Akin to transparency

26
Q

What is Confirmability?

A

Issue of concern in qualitative research
Degree to which the results align with the observation and/or interview data. Documentation of decisions made through the study is key to enhancing confirmability.
Can be strengthened by having an independent reviewer determine it the interpretations are supported by the data and materials documenter

27
Q

What is transferability?

A

Issue of concern in qualitative research
Degree to which the results of qualitative research can inform understanding of other contexts or settings. It is a judgment made by the reader of the research who considers the specifics of the research context and compares them to determine the extent to which the results obtained suggest further question for study or direction for actions.

28
Q

Generalizability vs Transferability

A

Generalizability:
- Applied by researcher in an academic setting
- Extension of research findings and conclusion to the population at large
- Requires data on large sample population
- Quantitative research is the best foundation for producing generalizability
Transferability:
- Applied by the readers of research
- can apply to most types of research
- does not involve broad claims but invites readers to make connections between elements of a study and their own experience

29
Q

What is a critical appraisal?

A

Process of carefully and systematically examining research to judge its replicability and/or trustworthiness, and its value and relevance in a particular context

30
Q

What are the 6 components of the organization of a research article?

A
Abstract
Introduction
Methods
Results
Discussion
Conclusion
31
Q

What is an abstract of a research paper?

A

A paragraph summary of the entire document. You will find 1-2 sentences summaries of the introduction, methods, results, and discussion/conclusion

32
Q

What is an introduction of a research paper?

A

Sets the stage for the research question. Introduction outlines background information related to the question, identifies gaps in knowledge, and addresses why the study is important

33
Q

What is a methods section of a research paper?

A

Explanation of what exactly the researcher did to answer the research question. Detailed, step-by-step explanation of the study design. Written with enough detail and clarity that the reader may re-produce the study

34
Q

What is a results section of a research paper?

A

Reports the main findings of the study. Outlines everything the researcher observed and the data collected in the form of text figures, and/or tables

35
Q

What is a discussion section of a research paper?

A

Gives researcher an opportunity to comment on the key findings of the study by drawing conclusions and contextualizing the meaning of the findings in the broader research community

36
Q

What is a conclusion section of a research paper?

A

Brief and provides a clear take home message avoiding repetition of the elements raised in the discussion. Sometimes combined with discussion