W3 - Evaluate quality in qualitative research

Question 1

Why is quality important & how can we evaluate the quality of qualitative research?

Answer 1

• Guide what researchers do & how research outputs are used
• Applying quality from quantitative analysis to qualitative research is problematic (bias always present)
• Evaluate how well a study meets goals instead

Question 2

Criteria to evaluate the quality of qualitative research?

Answer 2

S C T I -> (TICS TACS)

1. Sensitivity to context
2. Commitment & rigour
3. Transparency & coherence
4. Impact & importance

Question 3

Explain “Sensitivity to context” criteria?

Answer 3

Awareness of broader context

• Relevant literature & previous empirical work
• General concepts and assumptions
• Socio-cultural setting

Question 4

Explain “Commitment & rigour” criteria? (C-A-V)

Answer 4

Completeness of data collection & analysis, may combining methods of data collection & analytic approaches (triangulation analyses)

1. Data collection:
   - Purposive sampling (enough to address RQ)
   - Aim for data saturation
2. Data analysis - make sure themes:
   - Paraphrase data with analytic narrative
   - Are summaries from multiple participants
   - Are related, non-overlap, specific & consistent with data examples
   - Considering alternative interpretations
3. Validation - checking data interpretations via:
   - Peer verification
   - Respondent verification

Question 5

Explain “Transparency & Coherence” criteria? (ARC)

Answer 5

1. Auditability:
   - Detailed description of methods
   - Findings present textual data (evidence)
2. Reflexivity:
   - Discussion of experiences or motivations of researchers to conduct investigation
   - Including reflexive statements
3. Consistency:
   - link to existing knowledge
   - consistent with quotations present
   - good fit between RQ, philosophical perspective adopted & methods taken

Question 6

Explain “Impact & Importance” criteria?

Answer 6

• Including discussion & abstract explaining why the findings are important
• Potential impacts in:
  1. Theoretical (adapt current theory)
  2. Practical (application)
  3. Social-cultural (implications)
• Extra: discussing transferability - degrees to which results can be transferred to other contexts or settings with other respondents

Question 7

What is meant by mixed methods research?

Answer 7

• Systematic approach to data collection & analysis
• Integrates different sources of data and quant (confirmatory) & qual (exploratory) analytical procedures
• Engage in multiple perspectives -> full understanding of complex social phenomenon

Question 8

What are the different purposes of mixing methods?

Answer 8

1. Triangulation - examine same phenomenon to confirm results
2. Complementary - investigate different aspects of same phenomena to broaden interpretations
3. Development - results from one method used to develop the other method
4. Initiation - investigate insights to stimulate new RQ
5. Expansion - expanding range/scope of RQ

Question 9

What are the decision matrix for research design? (adapted from Morgan’s Priority Sequence Model)

Answer 9

Two types:
1. Concurrent/simultaneous: diff methods used at the same time
2. Sequential: one method is used first, follow by another one

• Different methods may have equal status, or one is dominant over the other
• Decision is led by RQ and existing knowledge on a topic