Lecture 28: Critical thinking about Quantative vs Qualitative research Flashcards

1
Q
A

oke

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

actively open minded thinking =

A

Search & Inference
* Possibilities (e.g. Hypotheses,explanations)
* Evidence (e.g. Research findings)
* Goals/criteria (e.g. fit, parsimony)

Sufficiency, fairness & confidence
* Were all worthwhile possibilities considered?
* Was the evidence considered in light of all hypotheses?
* Were the relevant criteria applied (see Ct:theory lecture)
* Is the degree of confidence expressed in line with the above?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

wat doe je met AOT bij kritiek kijken naar papers

A

kijken of de auteurs al die stappen duidelijk maken.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Qualitative research does not teach us how people experience something., but….

A

but only what they say about it: “What some people say about what they think they think”

It is problematic to call upon personal testimonies: we do not look at phenomenological data, but at unreliable descriptions of them by participants

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

dus wat hebben we al geleerd

A
  • Emphasis on experimental control
  • Emphasis on comparing groups
  • Emphasis on optimizing test characteristics
  • Emphasis on testing hypotheses
  • Emphasis on inferential statistics
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

“Social reality has a meaning and
relevance for the people living in
it” (Schutz, 1962).

A
  • Does our emphasis on generating (sometimes purely statistical) explanations contribute to a better understanding of people?
  • Does the generalizability of results and the
    standardisation of research material improve our impair our ability to understand people?

we kijken alleen maar naar group membership, en top-down explanations.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

wat zou je in plaats hiervan kunnen doen

A

kijken naar bv een specifieke groep van personen, en kijken naar ‘hun experience’ -> niet kijken naar een random sample, en je maakt de RQ meer subjective

How does a socially vulnerable person experience the use of online social media?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

qualitative research =

A

Qualitative research involves collecting and analyzing non-numerical data (e.g., text, video, or audio) to understand concepts, opinions, or experiences.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

dus wat is het overkoepelende verschil tussen quantitative en qualitative

A

bij quantitative: kijken of er een significant verschil zit tussen de groepen

qualitative: kijken wat de themas etc zijn binnen een groep

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

wat is nog een speciaal ding aan qualitative research

A

no statistics

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

4 kenmerken qualitative

A
  • Interest in people’s experiences, which cannot be seen in isolation from a particular
    context
  • Conversation topics derived from the
    literature, less tightly defined plan
  • No statistics: coding and interpreting
    statements
  • Conclusions on the shared themes in this
    group and differences within this group
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

4 kenmerken quantitative research

A
  • Interest in general relations
  • Hypotheses derived from theory (equity
    theory) that are tested
  • Emphasis on validated questionnaires with
    scalable answers -> inferential statistical analysis
  • Conclusions on differences between
    groups
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

dus wat is qualitative research? nog meer karaktereigenschappen

A
  • Research based on words instead of numbers
  • Individual experience vs. differences between
    groups
  • Rich description of some cases vs superficial
    description of large groups of people
  • Unstructured & flexible
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Answer driven vs method driven:

A
  • The value of the answer is more important than the steps followed to produce the answer
  • Set of principles: focus on: understanding and meaning making, the context of understanding, conceptual themes underlying understanding clear description and communication
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Same concepts, different meaning:

A
  • Data: Textual or visual information
  • Sample: Targeted selection of participants (‘purposive’ or ‘theoretical’ sampling)
  • Theory: General description of what the participants experience in this situation
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

wanneer moet je qualitative doen

A
  • Conducting research into situations or persons that are special and that can
    contribute to the development of theories
  • Conducting research into situations in which little research has been carried out: E.g. New or one-off events
  • Not only doing research, but also immediately changing things in the context of the research: Combating radicalisation with intervention
  • Conducting research into situations in which ethical and practical considerations play a major role: E.g. Experience of parents with a child that has cancer
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

welke 3 dingen doe je bij qualitative research

A
  1. To conduct a semi-structured interview: Broad guideline, no fixed questions & order
  2. To do a focus group: Group interview, with a focus on interaction between the group members
  3. To perform a (qualitative) content analysis: Making the content of communication transparent
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

welke 3 methodes zijn er?

EXAM

A
  1. Interpretative Phenomenological Analysis (IPA): How does a person experience this in this context?
  2. Grounded theory: How do (social) processes impact participants?
  3. Discursive analysis: How are experiences constructed?
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

wat is belangrijk om te onthouden bij die 3 methoden

A

The approaches are not mutually exclusive, but provide answers to different types of questions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

IPA =

A

focus is on what it is like to be this person, first person experience, their perspective

How does a person experience this in this context?
and: how are you as a researcher interpreting this relationship,

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

wat voor groep heb je bij iPA

A

je wil een comparable groep, mensen die wel een beetje op elkaar lijken.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

wat is cruciaal bij IPA

A

the role of the researcher: how does the researcher make sense of the participant making sense of the world

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

4 stappen bij IPA

A
  1. Targeted collection of a homogeneous and small sample
  2. Interview based on global guideline
  3. Transcription, annotation & clustering of themes
  4. Reporting on overarching themes
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

In IPA, the goal is to get a detailed picture of ..

A

how an individual gives meaning to events

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

wat moet een researcher doen bij IPA

A

Researcher must show reflexivity in qualitative research in order to increase the transparency of the research process

26
Q

dus wat is crucial bij IPA

A

Crucial here is the role of the researcher: how does the researcher make sense of the participant making sense of the world

27
Q
  • How does a woman’s sense of identity change during the transition
    to motherhood? (Smith, 1999)
  • How do young psychotic people experience and interpret romantic
    relationships? (Redmont et al., 2010)
  • What is it like to be addicted to alcohol and how does it influence
    this self-image? (Shinebourne & Smith, 2009)

waar hoort dit bij?

28
Q

on the basis of the notes during iPA, we would move to….

A

common themes of grote patronen die de mensen laten zien.

29
Q

waar staat de researcher tijdens IPA

A
  • The researcher is trying to make sense of the participant trying to make sense of an experience
  • Researcher must show reflexivity in qualitative research in order to increase the transparency of the research process (see p20).
30
Q

when should you use grounded theory

A
  • If you know little about the subject
  • If existing theories are not sufficient
  • When developing new theory
  • When interested in perception of the world of participants

dus echt vooral als er nog geen theorie is, geen grote processen waar je het aan kan attributeren

31
Q
  • How do the next of kin decide whether they want to donate organs of the deceased? (Sque & Payne, 1996)
  • How do out-of-home students deal with the fact that a family member is being treated for cancer? (Basinger et al 2015)
  • How do practitioners of children with chronic fatigue disorder view the disorder (Marks et al., 2015)?

waar hoort dit bij?

A

grounded theory

32
Q

4 stappen grounded theory

A
  1. Collecting & transcribing data (semi-structured interviews, focus groups, existing visual material)
  2. Coding & Categories: Identify and label meaningful units of text until saturation occurs
  3. Testing categories, further development &
    interrelations
  4. Developing theory (and overarching categories), testing against the data
33
Q

wat doe je steeds bij grounded theory

A

het is niet top-down, niet theory -> data. maar je gaat steeds heen en terug van data naar theory om te kijken of het overeenkomt.

is dus cyclical, en bottom up!

34
Q

discourse/discursive analysis =

A

Research into how people talk about their thoughts, feelings and experiences (regardless of whether this is how
they ‘really‘ feel).

dit verschilt namelijk per tijd! slavery, mental illnesses, immigration etc

35
Q

wat was het voorbeeld van physical aggression bij siblings

36
Q

wat is de methode van discourse analysis

A

No single method
* What are the discursive constructions?
* What is the role of the speaker in these constructions?
* What are the benefits?

37
Q

dus waar gaat discourse analysis over

A

niet perse over hoe mensen zich voelen, maar meer hoe ze praten over bepaalde dingen

38
Q

wat was het voorbeeld van food therapy

A

grounded theory

39
Q

How do people talk about immigration and immigrants and cultural diversity, and
what are the implications for power relations?

A

waar is dit een voorbeeld van?

40
Q

hoe ga je van realism naar relativism

A

realism
critical realism
relativism

41
Q

realism =

A

a reality exists independent of the observer and we can access this through research

42
Q

critical realism =

A

a reality exists independent of the observer but we cannot know that reality with certainty

43
Q

relativism=

A

reality is dependent on the ways we come to know it

44
Q

wat is bottom up en wat is top down

A

bottom up = qualitative
top down = quantitative

45
Q

wat is lastig aan qualitative research

A

it is suggestable: je kan nooit weten wat iemand anders voelt. het gaat om wat jij denkt dat zij zeggen dat ze denken. dus is dit genoeg bewijs?

46
Q

welke research practices horen bij realism

A

if a researcher has applied their research approach rigorously, they can be confident that their findings map on to the reality they were exploring

47
Q

welke research practices horen bij critical realism

A

a researcher should take care in moving beyond the realities of the participants and making claims about a reality that exists independently

48
Q

dus wat voor approach heb je bij qualitative

A

experience, qualia, phenomena -> observed stuff -> constructs

maar dit kunnen we nooit echt observeren, dus het is een aanname.

49
Q

welke research practices horen bij relativism

A

a researcher should ask how we come to build up versions of reality and should treat findings as versions of reality rather than as revealing realities independent of how we know them

50
Q

maar wat is een nadeel aan quantitative research

A

een groot deel hiervan is ook qualitative. we interpreteren dit op bepaalde dingen, categoriseren het en nemen aan dat dit voor iedereen hetzelfde betekent. maar dat is niet zo!

51
Q

Does the focus on a more ideographic
approach provide information that we can’t
do much with beyond the sample used?

“There are very few ways to evaluate
usefulness in research other than in terms
of whether the knowledge generated is
found to be applicable outside the study
from which it arose”(Hughes, 2016, p176)

wat zeggen ze hiermee

A

nou, als je zegt van ‘deze resultaten zijn alleen maar goed voor deze sample op dit punt in tijd’: is het onderzoek niet meer generaliseerbaar, en dus niet falsificeerbaar!!!

52
Q

relativism in qualitative research

A
  • Does a relativistic point of view imply that it’s impossible to be wrong?
  • That is why we carry out quantitative research: we can check whether we are wrong and to what extend we are wrong.
  • “The term quantitative refers to something that has a magnitude or an extent, which in effect
    means that it refers to a construct that is
    externally verifiable: it is possible to observe its
    status and, if necessary, for this observation to be
    independently corroborated.” (Hughes, 2016,
    p175)
53
Q

qualitative research

A
  • generalisability
  • falsifiability
    etc
54
Q

WEIRD=

A

white
educated
industrialised
rich
democratic

55
Q

Doesn’t the central role of subjectivity imply that the influence of the researcher’s bias is even greater?

3 soorten bias die hierdoor kunnen ontstaan

A
  • Confirmation bias
  • Perserverence bias
  • Representativeness heuristic
56
Q
  • Does a relativistic point of view imply that it’s
    impossible to be wrong?
  • That is why we carry out quantitative research:
    we can check whether we are wrong and to what
    extend we are wrong.
  • “The term quantitative refers to something that
    has a magnitude or an extent, which in effect
    means that it refers to a construct that is
    externally verifiable: it is possible to observe its
    status and, if necessary, for this observation to be
    independently corroborated.” (Hughes, 2016,
    p175)
57
Q

reflexivity in quantitative research:

A

It is impossible to be completely objective, but it is possible to be as clear as possible about this subjectivity:
* What are you trying to achieve with this research?
* What interests do you have in the outcome?
* E.g. interests in replication research

58
Q
  • The distinction between qualitative an quantitative is less clear in practice
  • Many practical problems require a mixed methods approach
  • Certain parts of what we are already teaching you are in fact qualitative, but maybe we don’t recognize this enough.
  • What are general criteria that we can take from
    qualitative approaches?
  • Importance of context
  • Importance of reflexivity
  • Importance of exploratory research
  • Importance of answer-driven research over method-driven
    research
59
Q
  • There is no universal method of scientific inference but, rather, a toolbox of useful methods. In the absence of a universal method, its followers worship surrogate idols, such as significant p values.
60
Q
  • If the proclaimed “Bayesian revolution” were to take place, the danger is that the idol of a universal method might survive in a new guise, proclaiming that all uncertainty can be reduced to subjective probabilities.
  • Can priors be reliably estimated (Bayes)?
  • Do we need to make sequential decisions for quality control? (Neyman Pearson)
  • Are we unabe to specify a precise alternative hypothesis? (Fisher)
61
Q

SSR take home

A
  • Transparency
  • Consistency
  • Coherence
  • Supporting decisions with reasons
62
Q

degree of corroboration =

A

the extend to which your test is exposed to falsification