Module 03 Flashcards
Evaluating Research
What are the 5 criteria (issues of concern) for evaluating research?
Truth Value Applicability Consistency Neutrality Ethics
Describe the criteria of truth value
Are the findings of the study believable? Are they legitimate given the research paradigm used?
Describe the criteria of applicability
Are you able to use results of the research in similar contexts with similar participants?
Describe the criteria of consistency
Can you follow the research steps of the study and come to similar conclusions
Describe the criteria of neutrality
Has the researcher discussed all potential sources of bias
What are bias?
Refers to results being skewed in an unfair or inaccurate way. In quantitative research, it is defined as a “type of systematic (nonrandom) error in the design or conduct of study that can lead to erroneous results”
Describe the criteria of ethics
Was the study conducted in compliance with standards of research ethics?
What are the 3 core principles upheld by the Ethical Conduct for Research Involving Humans?
Justice
Concern for Welfare
Respect for Persons
Qualitative vs Quantitative: truth value
Qualitative: Credibility
Quantitative: Internal validity
Qualitative vs Quantitative:
Applicability
Qualitative: Transferability
Quantitative: External Validity
Qualitative vs Quantitative:
Ontological Stance
Qualitative: Trustworthiness
Quantitative: Replicability
Qualitative vs Quantitative:
Consistency
Qualitative: Dependability
Quantitative: Reliability
Qualitative vs Quantitative:
Neutrality
Qualitative: Confirmability
Quantitative: Objectivity
What are the 4 issues of concern for quality research in quantitative research?
Internal Validity (Truth Value)
External Validity (Applicability)
Reliability (Consistency)
Objectivity (Neutrality)
What is internal validity?
Issue of concern in quantitative research.
It is the extent to which the researcher can show that the information collected accurately answers the research question.
Threatened by; bias in selection of observations of participants, information collected, failure to control for extraneous factors
What is external validity?
Issue of concern in quantitative research
Also called generalizability, refers to the degree to which the results of the study are true for population other than the sample studied
Complex and Judgment-based, does not define usefulness of study
What is reliability?
Issue of concern in quantitative Research
Refers to the consistency of a study’s results. If finding from research are replicated consistently they are reliable
What is Objectivity?
Issue of concern in quantitative research
Relates to the researcher’s neutrality
Requires safeguarding against conflicts of interest, observing reality without contamination from his/her experience and values.
Achieved by standardizing protocols for data collection, coding analysis, and reporting
What does the positivist paradigm emphasize?
replicability
What does the constructivist paradigm emphasize?
Trustworthiness
What are the 4 issues of concerns in qualitative research?
Credibility (Truth value)
Dependability (Consistency)
Confirmability (Neutrality) Transferability (Applicability)
What is credibility?
Issues of Concern in Qualitative research
Refers to how believable the findings are
Based on an assessment of the design features adopted by the researcher to verify findings
Techniques such as triangulation and member checking enhance the credibility of qualitative study results
What is triangulation?
Corroboration among findings from different data sources or methods to capture
What is Member Checking?
Asking participants to confirm that their words as transcribed match what they intended to say and/or that the researcher’s emerging understanding reflects the study participants’ experiences or perceptions.
What is Dependability ?
Issue of concern in qualitative research
Stability or consistency of the research processes throughout the course of the study.
Review of the activities of the researched by an independent person is needed to assess dependability (dependability audit) - only possible if researcher has clearly documented how the study was conceptualized and any changes that occurred in the setting
Akin to transparency
What is Confirmability?
Issue of concern in qualitative research
Degree to which the results align with the observation and/or interview data. Documentation of decisions made through the study is key to enhancing confirmability.
Can be strengthened by having an independent reviewer determine it the interpretations are supported by the data and materials documenter
What is transferability?
Issue of concern in qualitative research
Degree to which the results of qualitative research can inform understanding of other contexts or settings. It is a judgment made by the reader of the research who considers the specifics of the research context and compares them to determine the extent to which the results obtained suggest further question for study or direction for actions.
Generalizability vs Transferability
Generalizability:
- Applied by researcher in an academic setting
- Extension of research findings and conclusion to the population at large
- Requires data on large sample population
- Quantitative research is the best foundation for producing generalizability
Transferability:
- Applied by the readers of research
- can apply to most types of research
- does not involve broad claims but invites readers to make connections between elements of a study and their own experience
What is a critical appraisal?
Process of carefully and systematically examining research to judge its replicability and/or trustworthiness, and its value and relevance in a particular context
What are the 6 components of the organization of a research article?
Abstract Introduction Methods Results Discussion Conclusion
What is an abstract of a research paper?
A paragraph summary of the entire document. You will find 1-2 sentences summaries of the introduction, methods, results, and discussion/conclusion
What is an introduction of a research paper?
Sets the stage for the research question. Introduction outlines background information related to the question, identifies gaps in knowledge, and addresses why the study is important
What is a methods section of a research paper?
Explanation of what exactly the researcher did to answer the research question. Detailed, step-by-step explanation of the study design. Written with enough detail and clarity that the reader may re-produce the study
What is a results section of a research paper?
Reports the main findings of the study. Outlines everything the researcher observed and the data collected in the form of text figures, and/or tables
What is a discussion section of a research paper?
Gives researcher an opportunity to comment on the key findings of the study by drawing conclusions and contextualizing the meaning of the findings in the broader research community
What is a conclusion section of a research paper?
Brief and provides a clear take home message avoiding repetition of the elements raised in the discussion. Sometimes combined with discussion
