Final Exam (Week 8-10) Flashcards

1
Q

How is evaluating a qualitative study different from quantitative study?

A

Requires different approaches than criteria used to evaluate quantitative research
No measures or instruments to assess (researcher is the instrument)
No intervention or treatment to find threats to internal validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Qualitative evaluation approaches

A

Trustworthiness (can you trust the study?)
Methodological coherence (is the method coherent?)
Consolidated criteria for reporting qualitative research (is the criteria consistent?)
Relativistic approach to characterizing traits (are we being subjective?)
Ethics (ethical?)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is an ethics evaluation approach?

A

Consider merits of research in an ethical way
Foundation of all research
An ongoing process
Researchers need to ensure respect for peoples, concern for welfare, and equity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is a trustworthiness evaluation approach

A

Convincing an audience that a study is worth paying attention to and worth taking account of (you can trust this study)
Four aspects:
Neutrality = findings based on the participants’ meaning and experiences (researcher isn’t adding in their own)
Truth value = how true are the findings?
Consistency = dependability of a study (it’s not a one-off)
Applicability = extent to which we can transfer the findings to other contexts (is it useful)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is similar to trustworthiness in a quantitative study?

A

Controlling for threats to internal validity
It’s a starting place to evaluate qualitative research
Other similar terms include rigour and validation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Strategies to evaluate trustworthiness

A
  • Researcher reflexivity (researcher positions themselves)
  • Triangulation (using a variety of sources, perspectives, and methods)
  • Purposeful sampling (info-rich participants who can best inform the question)
  • Prolonged engagement (lots of time with participants in the field, building relationships)
  • Member check (participants review data or study interpretations and can add/alter/delete so we ensure accuracy of records)
  • Rich, thick descriptions (generating thorough, descriptive data and presenting them in a rich manner)
  • Peer debrief (professional ‘peer’ pushes researcher to critically reflect on study)
  • Audit trail (researchers maintain detailed description of entire process, record EVERYTHING, someone external to the study examines various components of the study)
  • Presents negative/discrepant info that counters main study findings (both sides of the story)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is methodological coherence?

A

Coherence among philosophical assumptions, research questions, study design, data generation, data analysis, and interpretation
Indicator of quality research
Imperative to have a well-planned research design

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is COREQ

A

Consolidated criteria for reporting qualitative research
Three domains: research team + reflexivity, study design, analysis + findings
total of 32 items
Purpose is to be a guide to inform researchers of important aspects to include in their research (bc qual can be open-ended), identifies variety of details where qual research can be evaluated

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is a relativist approach

A

Basically it is up to researchers (and audience) to evaluate and determine merits of a study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Characterizing traits that may allude to quality of research are dependant on

A

Context of study (time, occasion, purpose)
Fluid and dynamic
We avoid fixed terms and checklists, criteria to deem qual research as “good” is relative

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Flow chart ‘spiral’ of qualitative data analysis

A

Collect data -> organize data -> read data -> code data ->generate themes -> describe and interpret -> represent findings

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Types of interviews

A

One-on-one or group interviews

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Types of one-on-one data generation

A
  • Complete participant (engaging as a participant)
  • Participant as observer (engaging as researcher and participant, more noticeable)
    Written docs PUBLIC, visual and audio sources can be art objects, photographs
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Types of observations in group data generation

A
  • Observer as participant (researcher first, less engaged as a participant)
  • Complete observer (no interaction, not seen or noticed)
    Written docs PRIVATE, visual and audio sources can be music, videos/film
    Includes focus groups, sharing circles, talking circles
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is the most common method of data generation in qual studies? Why?

A

Interviews, because of its relational nature
Important to build rapport
Lets researchers understand participant’s views and meanings they attach

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Three phases of interviews

A

Intro - builds rapport, intro to each other, what the topic will be, any ethical things that they need to know
Questioning - Interview guide can be structured, semi-structured, or unstructured (conversational)
Closing - End on a positive note, see if they have questions/comments, communicate next steps, thank them

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What is observation and what does it look like

A

Researchers go into natural setting to better understand topic (external validity), use of senses (sight, touch, hearing)
Field notes are often used to record interviews

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What should goals of data analysis align with?

A

It should align with research question/purpose
- What do we want to do, define a construct, describe participants’ experiences, develop a theory?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Inductive vs Deductive data analysis

A

Inductive: Researchers identify themes/theory from data
Deductive: Making inference based on an existing framework or starting list of categories
It is possible to have a combo!! Ex. start with a framework but allow data to form emergent categories

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What do we mean when saying qualitative data analysis is immediate?

A

Analysis begins at the beginning of the research process
Begins the moment the investigator starts thinking about the research (since he/she is the tool), need to reflect on their role as part of the analyzing process
It’s meaning-making at the onset of investigation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What do we mean when saying qualitative data analysis is ongoing?

A

Researchers engage in analysis throughout the process, not just at one moment
New info may challenge previous interpretations
Researcher reflexivity is continuous

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What do we mean when saying qualitative data analysis is spiral?

A

Data analysis isn’t a fixed linear approach, researchers flow through the process in analytic circles, often returning to earlier steps as new insights and reflections emerge
Without embracing the spiral nature, much insight can be missed
The fluidity of this process is the heart of qual research

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

What is the 6 step approach to qualitative data analysis?

A
  1. Organize and prepare the data
  2. Read or look at all the data
  3. Start coding all the data
  4. Generate descriptions or themes
  5. Decide how the findings will be represented
  6. Interpret the findings
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Organizing and preparing the data includes

A

Transcribing interviews (many challenges, like intonation and things that are unique to human speech)
Type field notes
Scan images
Create files
Potential for LOTS of data

25
Q

Reading/looking at all the data includes

A

Read and re-read, requires a lot of patience but still important
- Immersion in entire database (overall sense of info before breaking it into parts)
Make margin notes, so general thoughts, ideas, key concepts

26
Q

Reading/looking at all the data includes

A

Read and re-read, requires a lot of patience but still important
- Immersion in entire database (overall sense of info before breaking it into parts)
Make margin notes, so general thoughts, ideas, key concepts

27
Q

Coding all the data includes

A

Systematically organize and reduce data into meaningful chunks
Assign names for chunks
Various methods (ex. sticky notes, highlighters, comments on a doc, spreadsheets, etc.)

28
Q

Generating descriptions or themes includes

A

Combining codes (chunks) from step 3 into broader categories, provide brief descriptions of each theme
Need to tell the story that best represents data
Usually 5-7 themes generated

29
Q

Deciding how the findings will be represented includes

A

Basically how to best SHARE the findings
Journal articles (can be limiting! page limits, may miss intended audience)
Conference presentations
Reports
Policy briefs

30
Q

Interpreting the findings includes

A

Making sense of data and going beyond themes to a larger meaning (ex. what is the bigger story, the essence, how do the themes relate?)

31
Q

Data analysis tips

A

Slow down
Look at commonalities and differences
Remember that we only have a piece, not a whole
Be aware of challenges (multiple researchers, dominant voices, different assumptions or perspectives)
Need to rely on brains and not just specific techniques to analyze (even though there are systematic ways)

32
Q

What is qualitative data

A

Used when researchers generate non-numerical data

33
Q

What is the correct data analysis method?

A

There isn’t any one correct one, but the 6-step method is very commonly used

34
Q

2 ways theory can be used

A

Theoretical lens: theory shapes the question(s), participants, data generation, and analysis
Interpretive framework: Use theory to interpret findings

35
Q

Data collection vs generation

A

Collection: picking berries, it exists outside of research, researcher’s job is to use the best methods to pick them
Generation: berry pie, creating knowledge is an active process of research, and is co-constructed by us and participants

36
Q

Challenges with interviews

A

Co-operation is crucial
Participants may be unwilling or unable to share everything the researcher wants to explore
Participants might have good reasons to lie
Researcher might not understand local language/customs

37
Q

Characteristics of a structured interview

A

Specific SET and ORDER of questions, no flexibility and often has closed-ended questions (researcher-administered survey with options)
Interviewer plays a neutral role, rapport and interested listening
Responses often recorded onto a coding scheme

38
Q

Characteristics of a semi-structured interview

A

Interview guide with room to discuss other topics not on the guide
Not intended to standardize every interview
More flexibility (can follow any interesting avenues that emerge)

39
Q

Characteristics of an unstructured interview

A

Conversation with a purpose
NO interview guide, just guiding topic for conversation
Common in narrative research

40
Q

Open-ended questions should be:

A

Open-ended, use exploratory verbs (WWWWW), non-directional, and have a single focus (no “and”)
Probe and follow-up questions are important

41
Q

What does an open-ended question do?

A

Doesn’t assume a bias for any angle for the interviewee

42
Q

Types of questions we should have

A

Main guiding questions
Probe questions (ex. share an example of…)
Follow-up questions

43
Q

What tone should we set for the interview?

A

A kind and interested discussion

44
Q

What questions should we ask first?

A

General questions to break the ice, then ask more specific ones
Ask questions to confirm previous statements

45
Q

Difference between private and public written documents

A

Public: policies, newspaper articles, historical archives
Private/written documents from participants: logbooks (ex. exercise log), personal diaries or letters, performance reports

46
Q

What is visual data and why is it useful?

A

Photographs, drawings, mapping, diagrams, or videos can provide valuable insight into a phenomenon
Cool because not all participants are comfortable expressing themselves through words

47
Q

What is researcher reflexivity?

A

The researcher understanding what the see and what they don’t
Considering and embracing how their assumptions can impact the study
Keeping a research journal can help

48
Q

What things could change depending on strategy of inquiry?

A

Sampling, data generation, and data analysis

49
Q

Strategies of inquiry examples

A

Narrative (story, represents broad experiences, unstructured interviews, observation and journaling)
Ethnography (focus on culture, immerse into culture, observation interviews, and docs like poetry and art)
Phenomenology (examining a phenomenon, lived experiences, many in-depth interviews, observations, field notes, diaries)
Case study (complexity and distinctiveness of a specific case, specific to time and place, extensive methods like interviews, visual methods, docs, observations)
- Can be instrumental case study (issue of interest), intrinsic case study (complexity of case), or collective case study (multiple cases)
Grounded theory (generates theory from data)
Qualitative description (comprehensive description and summary of a phenomenon, less interpretation, describes phenomenon in everyday language, can take on hues/tones of other designs, many one-on-one interviews, data saturation so no new information will surface)

50
Q

Nonprobability sampling techniques

A

Convenience sampling
Quota sampling (create sample that has similar proportions to population
Purposive sampling (want info-rich participants who can inform our understanding)
Snowball sampling

51
Q

Types of purposive sampling

A

Extreme case: getting participants who are unusual or represent extremes (ex. best and worst profs)
Maximum variation: Getting diverse perspectives, location-wise, racial, etc.
Snowball

52
Q

Do we want a big sample size?

A

The point is not to generalize to a broad range of people, it’s to get an in-depth understanding of the topic
DEPTH not breadth

53
Q

Saturation and sample size will depend on

A

Scope of study
Nature of topic
Quality of data
# interviews/participant
Study design

54
Q

Guidelines for sample sizes based on strategy of inquiry

A

JUST GUIDELINES
Narrative: 1 - 2 participants
* Phenomenology: 5 – 8 participants
* Grounded theory: 30 – 50 participants
* Ethnography: typically a single group
* Case study: a single case OR 4-5 cases (collective case study)

55
Q

How do we gain access to participants?

A

Usually through relationships, qual research is relational
Known sponsor approach is when we know a person with a solid relationship with the interest group

56
Q

What is a theory?

A

A general explanation of an event, process, action, or phenomenon

57
Q

Key defining features of constructivism:

A

Understanding of the world
Multiple participant meanings: Meanings of experience are subjective + socially constructed
* Social and historical construction: Meanings are formed through interactions and historical/cultural norms
* Theory generation: Inductive development of a theory or pattern of meaning

58
Q

Purpose statement for qualitative

A

Focus is on central phenomenon
Begin with words that identify what the study is doing (describe/discover/understand/explore)
Identify the central phenomenon
Identify PW
Identify participants targeted
Mention strategy of inquiry
Identify where the research took place, any other important descriptors