Merits of Qualitative Flashcards
Mastery
Qualitative Evaluation Approaches
what is it and important notes
The “Big Scandal” …. Context
* In 1996 a physics professor named Alan Sokal wrote a paper titled:
* “Transgressing the Boundaries: Towards a Transformative Hermeneutics of Quantum Gravity“
* It was published it in the “Social Text” a reputable journal. It was a Hoax… work of fiction
* In 2018 three scholars wrote 20 ridiculous papers and published 7 in what has been collectively termed “Sokal Squard”
* Used fashionable jargon to argue for ridiculous conclusions
Bad faith actors, every type of research is vulnerable to people who are acting in bad faith.
* They wanted to show “the emperor had no clothes”
with respect to many of the newer fields in humanities
* Dishonest and misrepresented themselves
* Everyone can be lied too, what is the surprize here?
* Quantitative research is also vulnerable to these types of hoaxes
* Manipulated data, falsified data trails, etc., etc.
TEST
Trustworthiness as a Starting Place for Evaluation
* Trustworthiness
oConvincing an audience tha…
oOne place to start when evaluating qualitative
research
- Some similarities between aspects of trustworthiness
and quantitative terminology
oE.g., truth value and controlling for threats to internal
validity - Other similar terms include rigour and validation
- Strategies can be used to support trustworthiness,
rigour, or validation of a qualitative study
Trustworthiness as a Starting Place for Evaluation
* Trustworthiness
oConvincing an audience that a study is worth
paying attention to and worth taking account
of
oOne place to start when evaluating qualitative
research
- Some similarities between aspects of trustworthiness
and quantitative terminology
oE.g., truth value and controlling for threats to internal
validity - Other similar terms include rigour and validation
- Strategies can be used to support trustworthiness,
rigour, or validation of a qualitative study
- Four aspects of trustworthiness
- Four aspects of trustworthiness
CANT
- Truth value,
oCredibility of a study
oConfidence in the “truth” of study findings for participants
oWhat would the impact be if the findings are true.. - applicability,
oTransferability of a study
oForming understandings that may be relevant to other
contexts or participants - consistency,
o Dependability of a study
o Seek to understand variability of study findings - neutrality
o Findings are based on participants’ meanings and
experiences
o Findings not a mere function of researchers’ biases,
interests, and perspectives
- Prolonged engagement
o - Purposeful sampling
o - Researcher reflexivity
o
o - Rich, thick descriptions
o
o - Triangulation
o
o
- Prolonged engagement
oSustained time spent with participants “in the field” - Purposeful sampling
oRecruiting information-rich participants who can best inform research question - Researcher reflexivity
oResearchers position themselves
oReflect on biases, experiences, and background to consider how these shape research - Rich, thick descriptions
oCollecting thorough descriptive data
oPresenting findings in a rich manner - Triangulation
oCrosscheck study findings and interpretations
oUse variety of data sources, perspectives, and methods
Strategies to Enhance Trustworthiness, Rigour, and Validation
- Audit trail
o
o - Member check
o
o - Peer debrief
o - Present negative or discrepant information
o
o
- Audit trail
oResearchers maintain detailed description of entire research process
oSomeone external to study examines various components of study - Member check
oStudy participants review data or study interpretations
oOpportunity to add, alter, delete - Peer debrief
oResearchers pushed by professional “peer” to critically
reflect on study - Present negative or discrepant information
oPresenting information that counters main study findings
oHighlights opposing views and unique experiences
- Certain number of strategies does not guarantee
oThere is no…
* Just as validity in quantitative studies is a matter of
degree, so too are … of qualitative research
* There is more to consider when evaluating qualitative
research
- Certain number of strategies does not guarantee
strong study
oThere is no magic formula
* Just as validity in quantitative studies is a matter of
degree, so too are merits of qualitative research
* There is more to consider when evaluating qualitative
research
- It is imperative to have a … research design
- Methodological coherence
oIntroduced by Janice Morse
oIndicator of … research
oRequires alignment within a …
oCoherence among philosophical assumptions, research questions, study design, data generation, data analysis, and interpretation - An armchair walkthrough is useful
oReflect on…
oConsider alternative …
oProvides a road map
- It is imperative to have a well-planned research design
- Methodological coherence
oIntroduced by Janice Morse
oIndicator of quality research
oRequires alignment within a research design
oCoherence among philosophical assumptions, research questions, study design, data generation, data analysis, and interpretation - An armchair walkthrough is useful
oReflect on all aspects of qualitative study (e.g., questions asked, data generation options)
oConsider alternative approaches (e.g., different questions that could be asked, other data generation techniques)
oProvides a road map
Consolidated Criteria for Reporting
Qualitative Research (COREQ)
- Comprehensive protocol to…
oThree domains/categories (i.e., )
oA total of 32 items
AFTER
- Some items are particularly relevant to certain forms
of qualitative research
o Interviews and focus groups - Multiple purposes:
o A guide to inform researchers of …
o Identifies a variety of details that qualitative research can be …
Consolidated Criteria for Reporting
Qualitative Research (COREQ)
- Comprehensive protocol to assess qualitative research
oThree domains/categories
RAS
research team and reflexivity,
study design,
analysis and findings)
oA total of 32 items
AFTER
- Some items are particularly relevant to certain forms
of qualitative research
oInterviews and focus groups - Multiple purposes:
oA guide to inform researchers of important aspects to
include in their research
oIdentifies a variety of details that qualitative research can be evaluated on
- Characterizing traits are criteria that may allude to
quality of research - What is deemed to be of high quality in one study may not be…
- … of study (i.e., time, occasion, purpose) is important
- They are fluid and dynamic
- Characterizing traits are criteria that may allude to
quality of research - What is deemed to be of high quality in one study may not be of high quality in another study
- Context of study (i.e., time, occasion, purpose) is important
- They are fluid and dynamic
- Ethically-minded researchers set foundation for a
strong study - Utilize ethical decision-making model and basic ethical
principles - Ethics are integral to the way researchers think about,
approach, and do their research - Ethics should be the foundation of
all research in kinesiology - Engaging in ethical research is of utmost
importance - Ethics is an ongoing process in research
- Researchers need to ensure respect for
peoples, concern for welfare, and equity
- Ethically-minded researchers set foundation for a
strong study - Utilize ethical decision-making model and basic ethical
principles - Ethics are integral to the way researchers think about,
approach, and do their research - Ethics should be the foundation of
all research in kinesiology - Engaging in ethical research is of utmost
importance - Ethics is an ongoing process in research
- Researchers need to ensure respect for
peoples, concern for welfare, and equity
