RD2 Flashcards

1
Q

According to Dahl (1998), for a polyarchy to exist the following five criteria must all be present: effective participation, voting equality, enlightened understanding, control of agenda, inclusion of adults. This concept structure resembles, what Goertz (2020) calls the Logical OR.

A

False

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Please select whether the following research question is indicative of
A) a covariational, B) a causal process tracing, or C) a congruence analysis type of case study.
- Which configurations of causal conditions led to social revolutions (Skocpol 1979)?

A

Causal Process Tracing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Please select whether the following research question is indicative of
A) a covariational, B) a causal process tracing, or C) a congruence analysis type of case study.

Does “high reliability organization theory“ or „normal accident theory“ provide a better framework for understanding and explaining risk management in complex organizations (Sagan 1993)?

A

Congruence Analysis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Please select whether the following research question is indicative of
A) a covariational, B) a causal process tracing, or C) a congruence analysis type of case study.

Does a country‘s political opportunity structure affect the strategy and the impact of anti-nuclear movements (Kitschelt 1986)?

A

Covariational

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

According to Lijphart there are three fundamental strategies of research/methods (the experimental, statistical & comparative method)

How does each method resolve the problem of control?

  • Experimental method
A

variance through comparison with control groups
establishes control through well-considered randomisation of treatment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

According to Lijphart there are three fundamental strategies of research/methods (the experimental, statistical & comparative method)

How does each method resolve the problem of control?

  • Statistical method
A

observing correlations
control through statistical manipulation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

According to Lijphart there are three fundamental strategies of research/methods (the experimental, statistical & comparative method)

How does each method resolve the problem of control?

  • Comparative method
A

observing covariation in limited set of cases
control through careful case selection
“The comparative method resembles the statistical method in all respects except
one. The crucial difference is that the number of cases it deals with is too small to permit systematic control by means of partial correlations“ (ibid., 684).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Experimental method

A

Experimental Method “in its simplest form, uses two equivalent groups, one of which (the experimental group) is exposed to a stimulus while the other (the control group) is not. […] Equivalence – that is, the condition that the cetera are indeed paria – can be achieved by a process of deliberate randomization” (Lijphart, 1971, p. 683) variance through comparison with control groups; establishes control through well-considered randomisation of treatment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Comparative method

A

Comparative Method as the “method of testing hypothesized empirical relationships among variables on the basis of the same logic that guides the statistical method, but in which the cases are selected in such a way as to maximize the variance of the independent variables and to minimize the variance of the control variables.“(Lijphart, 1975, p. 684)
observing covariation in limited set of cases; control through careful case selection
Formulate a set of questions that should be asked before or when engaging in In groups of four, formulate a set of questions case selection!

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Statistical method

A

Statistical Method “ entails the conceptual (mathematical) manipulation of empirically observed data – which cannot be manipulated situationally as in experimental design – in order to discover controlled relationships among variables. It handles the problem of control by means of partial correlations.” (Lijphart, 1971, p. 684)observing correlations; control through statistical manipulation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is the main difference between the two sentences:
a, Social revolution is possible only if the state is
in crisis.
b, State crisis leads to social revolution.

A

a) State crisis = necessary condition
b) State crisis = sufficient condition

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

According to Eckstein, a case study is N=1.

A

True

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Dual choice question: Transitivity means that ‘when x causes y, y does
not cause x’

A

False

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Regularity Theories of Causation.

A

The core idea of regularity theories of causation is that causes are regularly followed by their effects. A genuine cause and its effect stand in a pattern of invariable succession: whenever the cause occurs, so does its effect.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Probability theory

A

some event is more probable than another without specifying. the exact numerical probabilities of the events in question.

The probability of political sophistication given compulsory voting is higher than the probability of political sophistication without compulsory voting. It’s more likely to achieve political sophistication with compulsory voting.

X causes Y if and only if the conditional probability of Y given X is higher than the conditional probability of Y when X is not given ( p(Y|X) > p(Y|not-X) ). The type-level claim that “granting territorial autonomy causes secessionism” can then be true even if there are some minorities who received autonomy and did not increase their secessionism as long as the conditional probability of secessionism given autonomy is higher than the probability of secessionism without territorial autonomy.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Bayesian probability

A

is an interpretation of the concept of probability, in which, instead of frequency or propensity of some phenomenon, probability is interpreted as reasonable expectation[1] representing a state of knowledge[2] or as quantification of a personal belief

  • Focus is on the conditional likelihood of making an observation, given that
    different theories were true
  • How likely would I make this observation if my hypothesis were true?
    (= the degree of certainty)
  • How likely would I make this observation if the rival hypothesis were
    true? (= the degree of uniqueness)
  • Different pieces of evidence can have different inferential value
  • Even single pieces of evidence can be the basis for inference, if they
    discriminate well between competing explanations
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Frequentist probability

A

is a type of statistical inference based in frequentist probability, which treats “probability” in equivalent terms to “frequency” and draws conclusions from sample-data by means of emphasizing the frequency or proportion of findings in the data

  • Focus is on the frequency of observations – the more, the higher our
    confidence when rejecting or confirming a hypotheses
  • Can be challenging in small-N research
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

The Bayesian logic can be applied without reference to the Frequentist logic.

A

False

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Is the following situation an example of an interstitial contact (Mosley 2013): You approach people randomly on the train station to interview them.

A

No

According to Mosley, an interstitial contact requires an interviewee to select the researcher not the other way around.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

When I go to an archive I collect data. I don’t generate it.

A

True

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Sampling units:

A

“units that are distinguished for selective inclusion in an analysis”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Recording units:

A

“units that are distinguished for separate description, transcription, recording, or coding”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Context units:

A

“units of textual matter that set limits on the information to be considered in the description of recording units”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

“I have analysed a certain number of newspapers.” According to Krippendorf, what is this person talking about?

A

Sampling units

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

According do Krippendorf, recording units can exceed sampling units.

A

False
p.104:”recording units are typically contained in sampling units, at most coinciding with them, but never exceeding them.”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

Large-N strenghts

A
  • Assess how often social/political phenomena occur on average
  • Assess external validity of theoretical arguments (if cross-nationally comparative)
  • Estimate existence and size of ‘causal effects’ of individual variables
  • Estimate uncertainties
  • Can serve as basis for selecting case
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

Small-N Strengths:

A
  • Serves to reconstruct causal mechanisms
  • Enhance internal validity (meaning of concepts and theories in context)
  • Identify possible causes/variables that should be taken up by large-N research / can help detect omitted variables
  • Understand how actors make sense of their environment, and how and why they take decisions
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

Guidelines by Goertz

A
  1. Explicitly analyze the negative pole.
  2. Theorize the underlying continuum between the negative and positive poles.
  3. Theorize the gray zone; then determine whether or not the concept should be considered continuous or dichotomous.
  4. Do not let the empirical distribution of cases influence decisions. Usually, the empirical distribution of cases should be explained, not presumed in the concepts.
  5. Do not just list dimensions of the concept.
  6. Be explicit about the necessary conditions, if any.
  7. Give sufficiency criteria (holds for N & S conditions and FR).
  8. Do not force the reader to guess at structure from discussion of examples or the mathematics of a quantitative measure. 31
  9. Explicitly ask the weighting question.
  10. Justify the weighting scheme used.
  11. Be explicit about the formal relationships between secondary or indicator-level dimensions. The three canonical possibilities are 1) minimum/AND, 2) mean, and 3) maximum/OR.
  12. What is the theoretical relationship that links the indicator/data level to the secondary level? (e.g. causal relationship as in disease-symptom; direction?)
  13. What is the theoretical relationship that links the secondary level to the basic level?
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

Logical OR (Goertz)

A

could include both things, but doesn’t have to. “A chair can have 1 OR 4 legs”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

Logical AND (Goertz)

A

(necessary and jointly sufficient): has to include both things to be true. “Humans need oxygen AND water to survive”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

Marks Rules

A
  1. The smaller the volume of information for any set of cases, the greater the benefit of increasing it (square-root law).
  2. The more imprecise an observation, the greater the benefit of an additional observation, even if it is no less imprecise.
  3. The more biased a dataset, the greater the benefit of an additional dataset having a different bias, even if the additional dataset is no less inaccurate.
  4. The greater the diversity of systematic error among datasets, the greater the benefits of triangulation.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

How to conduct Lijpharts methods on: Effect of income a person’s on education.

Expermental

A

Draw random sample from the population, split sample into treatment and control group * Treatment=financial support measure whether this impacts education

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

How to conduct Lijpharts methods on: Effect of income a person’s on education.

Statistical

A

Collect data for a sample on income and education

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

How to conduct Lijpharts methods on: Effect of income a person’s on education.

Comparative

A

Intentionally pick a few individuals from the population (with different incomes) See whether they have different levels of education

variance of the control variables.“ (Lijphart 1975: 164)
* “The comparative method should be resorted to when the number of
order to establish credible controls is not feasable. There is, consequently,
no clear dividing line between the statistical and comparative methods; the difference depends entirely on the number of cases.“ (Lijphart 1971:
684)
* “[…] if at all possible one should generally use the statistical (or perhaps
even the experimental) method instead of the weaker comparative
method.“ (Lijphart 1971: 685)
* Comparative method as the “method of testing hypothesized empirical to maximize the variance of the independent variables and to minimize the relationships among variables on the basis of the same logic that guides the statistical method, but in which the cases are selected in such a way as
cases available for analysis is so small that cross‐tabulating them further in

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

How to generate external validity

A
  • Craft arguments with general variables or mechanisms / eliminate (reduce) proper
    names (cf. Przeworski & Teune 1970)
  • Capture representative variation (e.g. base case
    selection on typologie; cf. Collier, LaPorte & Seawright 2012)
  • Select cases that maximize control over
    existing rival hypotheses (cf. Slater & Ziblatt 2013: 1313)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
36
Q

Configurative-ideographic study

A

aim to describe a case very well, but not to contribute to a theory.

  • Individualzing, interpretative (≠ nomothetic)
  • Logic of understanding (verstehen ‐> W.
    35
  • Drawback: „do not easily add up“ (S. Verba)
  • Uniqueness of case
    Dilthey)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
37
Q

Disciplined Configurative study

A

aim to use established theories to explain a specific case

  • Applications of general laws or statements of
    probability to particular cases
  • Linking comparatively tested theory and case
  • Feedback on theory interpretation
  • ≈ congruence analysis
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
38
Q

Hypothesis-generating (or heuristic) case studies

A

studies aim to inductively identify new variables, hypotheses, causal mechanisms, and causal paths.

  • Potentially generalizable relations deliberately
  • Serving to find out
    sought out (cf. also grounded theory as a method of * Can be used in building block technique ‘discovery of theory from data’)
  • Track record of case studies as stimulants of theoretical imagination (intensive analysis)
  • But: which case should one choose?
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
39
Q

Theory testing case studies

A

aim to assess the validity and scope conditions of existing theories

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
40
Q

Plausibility probes,

A

aim to assess the plausibility of new hypotheses and theories.

lower costs than rigorous
* Pilot studies (e.g. in combination with game
* Probing plausibility of candidate theories testing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
41
Q

Building block studies of types or subtypes

A

aim to identify common patterns across cases.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
42
Q

Why talk to people rather than just sitting at your desk?

A

Desk = you have your own thoughts on what fits your “concept” or the kind of person you want to interview. You have notions of what data to use. You believe you can get all the info you need from afar.

Talking to people at the spot = Realize that the concepts and data you thought were relevant were based on your knowledge and your environment, which doesn’t necessarily mean that it is the same for the people you’re researching.

You get more in-depth (and accurate) information when you do your research in the place you’re researching.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
43
Q

What is qualitative research?

A

Numbers (quan.) vs. words (qual.) (Charles Ragin)
Predetermined variables and their relations (quan.) vs. relations
between categories that are themselves subject to change in the
research process (qual.) (Aspers & Corte 2019)
About interpretation, “Verstehen“ and actors‘ meaning
Iterative processes and improved novel understandings (Aspers &
Corte 2019)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
44
Q

Ontology

A

Knowledge of how the world works

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
45
Q

Methodology

A

How to put “world” knowledge into practice.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
46
Q

Concept

A

Main building blocks of theories
If I have a theory I need to disaggregate it to its parts, aka concepts

When we use a concept we have a general idea of what that is. Example: a shirt.
An abstraction (of the concept) helps us sort things.
Concepts are a universe of possibilities. Example: there are many different shirts.
Concepts are hypothetical, the concept when thinking of it is not real, but there is a real version of it.
(Most) concepts are learned (and created), we learn them as we go, they’re not “natural”.
Concepts are socially shared. Concepts are shared via interaction with other people, you learn concepts and tech concepts as you go. Concepts can be contested, your concept of something doesn’t have to be another person.
Concepts are reality oriented, concepts relate to the real world.
Concepts are selective constructions, the same thing can be conceptualized differently depending on the purpose.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
47
Q

Intension

A

connotation

the intension of a word is the collection of properties which determine the things to which the word applies

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
48
Q

extension

A

denotation

the extension of a word is the class of things to which the word applies

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
49
Q

CRITERIA FOR GOOD MEASUREMENT

A

Objectivity
Reliability (Precision)
Validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
50
Q

Objectivity

A

Are measurements independent of the researcher?
Reliability (Precision)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
51
Q

Reliability

A

Extent to which an observation is consistent in repeated trials (Marks 2007: 4).

Refers to level of stochastic (random) error, or noise, encountered in the attempt to operationalize a concept (inverse of the variance across measurements) (Gerring 2012).

Does applying the same procedure in the same way always produce the same measure?

52
Q

Validity

A

Correspondence between a concept‘s definition (its attributes) and the chosen indicators. Validity refers to systematic measurement error (bias) (Gerring 2012).

Extent to which an observation approximates the actual value of the case on the dimension one wishes to measure (Marks 2007: 4).

Do the observations meaningfully capture the ideas contained in the concepts?

53
Q

Triangulation

A

*Triangulation involves data collected at different places, sources, times, levels of analysis, or perspectives, data that might be quantitative, or might involve intensive interviews or thick historical description. The best method should be chosen for each data source. But more data are better. Triangulation, then, is another word for refering to the practice of increasing the amount of information to bear on a theory or hypothesis. (King, Keohane & Verba 1995: 479f.)

Combining dissimilar sources of information to enhance validity of measurement. […] a strategy to minimize inaccuracy due to systematic error. (Marks 2007: 3)

54
Q

Systematic error

A

Is a consistent or proportional difference between the observed and true values of something (e.g., a miscalibrated scale consistently registers weights as higher than they actually are)

is consistent, repeatable error associated with faulty equipment or a flawed experiment design.

Systematic bias in results, same mistake made all the time (dart lands on the same place every time)

55
Q

Random (non-systematic) error

A

Is a chance difference between the observed and true values of something (e.g., a researcher misreading a weighing scale records an incorrect measurement).

has no pattern. One minute your readings might be too small. The next they might be too large. You can’t predict random error and these errors are usually unavoidable.

random mistakes (dart lands all over)

56
Q

Crucial Case studies

A
  • Need for independent testing of theoretical
    curves
  • Crucial case study similar to a well‐
    constructed, decisive experiment (that
    simulates as closely as possible the specified
    conditions under which a law must hold)
  • Fit of theory and case is decisive
57
Q

Internal validity

A

Internal validity refers to the correctness of a hypothesis with respect to the sample (the
cases actually studied by the researcher)

58
Q

External valdidity

A

External validity refers to the correctness of a hypothesis with respect to the population of an inference (cases not studied). The key
element of external validity thus rests upon

59
Q

SELECTION BIAS

A

attributes the properties of the scrutinized cases Selection bias is a faulty inference that wrongly to a larger universe of cases.

Ex, wants to study revolutions and therefore chooses known revolutions. Problem is we are only selecting positive cases, we know the outcome is 1. We chose based on the dependent variable.
General rule: Don’t select based on the dependent variable.
Exception to general rule: Want to understand the mechanism. Y-centered (outcome-centered) research. Also if we want to research necessary conditions.

60
Q

PURIST ADVICE

A

[…] the best intentional design selects observations to ensure variation in the explanatory variable (and any control variables) without regard to the values of the dependent

61
Q

Ask before case selection

A

Which mode of comparison?
Cases should be as similar as possible except for the explanatory variable if we want to see the causal inference.

What is the research question? Case selection should be relevant to research questions.
Specify time and space.
Function of case study? Is it causal, descriptive or diagnostic?
Data availability.
State of literature, is it worth doing this?
What theory are we using?

If we only had two questions to ask:
How do the selected cases relate to the universe of cases?
How do the selected cases relate to the theory?

62
Q

Types of case studies

A

Descriptive case studies.
Explanatory case studies.
Exploratory case reports.
Intrinsic case studies.
Instrumental case studies.
Collective case reports.

63
Q

Gerrings Most-similar design

A

Method of Difference

Compared cases are different on outcome (Y) but are share background factors (Z), (X) is different <- should be the cause of different (Y)

Causal Inference and the method of difference

64
Q

Gerrings Most-different design

A

Method of Agreement

Compared cases share the same outcome (Y) but are different on background factors (Z), but have a similar (X) <- should be the cause of same (Y)
Causal Inference and the method of agreement

65
Q

Type-level evidence

A

abstract generalizatons

more general

Ex, A lae

66
Q

Token-level evidence

A

concrete, occur at one particular point/interval in time, one partcular place in space)

Ex, Specifically Lake Constance

Small-N research produces token-level evidence

67
Q

Transitivity

A

If (X) causes (Z) and (Z) causes (Y), then (X) also causes (Y)

Transitivity means that when x causes y, y does not cause x = false

Example transitivity: GDP (X) -> Education (Z) -> Democracy (Y). So we can say that high GDP (X) leads to democracy (Y).

68
Q

Asymmetry

A

reverse causation
(X) causes (Y), (Y) does not cause (X)

Example asymmetry: smoking (X) cause lung cancer (Y), but lung cancer (Y) does not cause smoking (X)

69
Q

Regularity theory

A

Compulsory voting always leads to political sophistication. If there’s X there will always be Y.

These criteria apply to the type level because we can only require recurring sequences of X and Y when we look at classes of events. To introduce our running example, the claim that “granting territorial autonomy to minorities (X) causes secessionism (Y)” is true for the regularity theorist if and only if each and every time a minority somewhere in the world is granted territorial autonomy, secessionism grows.

70
Q

Interventionist theory

A

If X changes then Y will change as well.

71
Q

Mechanism

A

Someone/something does something which causes X to Y.

Mechanism should not give rise to additional why questions:
disciplinary and field-specifik stopping -rules

X > Entity engaged in activity > Entity engaged in activity > Entity engaged in activity > Y

72
Q

Ingredients

A

entities, their properties and activities

73
Q

Entities

A

individual or collective actors (not structures)
underlying behavioral theory needed

74
Q

Hedström and Ylikoski
mechanism in concrete case (token)

A

concrete actors and activities in concrete space and time

75
Q

Hedström and Ylikoski
mechanism scheme in theory (type)

A

abstracting away from particular time and place

76
Q

Modeling causal mechanisms: example

PR electoral system > ???? > >Climate policy stringency

A

PR electoral system > politie elites experience higher electoral safety > government does not fear to impose short term costs on voters > government adopts stringent climate policy > climate policy stringency

77
Q

What is process tracing?

A

A method to study causal mechanism empirically
A method that uses within-case evidence
A method that predominantly uses (causal) process observations (CPOs) (as opposed to data-set observation)

78
Q

spatial bound

A

Where? Space

79
Q

temporal bound

A

When? Time

80
Q

substantive bound

A

What? Subject

tip: think of the opposite: non-radical expansion of welfare- state; substantive bound includes welfare-state politics, this means that it would not make sense to include e.g. foreign policy in your analysis

81
Q

Types of process tracing
Case-centric pt

A
  • outcome-explaining
  • motivation tends to be a case with a puzzling
82
Q

Types of process tracing
Theory-centric pt

A
  • theory-testing (deductive)
  • theory-modifying (semi-deductive-inductive)
  • theory-building (inductive)
83
Q

Good process tracing: Waldner’s completeness standard

A

(1) Start from causal graph whose nodes are connected in such a way that they are jointly sufficient for the outcome;
(2) Use event-history map that establishes valid correspondence between events in case and nodes in causal graph;
(3) theoretical statements about causal mechanisms link nodes in causal graph to their descendants, the empirics allow us to infer that events were in actuality generated by relevant mechanisms;
(4) eliminate rival explanations (by direct hypothesis testing or by demonstrating that they cannot satisfy the first three criteria listed above)
“A causal account […] requires bringing together the underlying causal model, its invariant causal mechanisms, and understanding the concrete instantiation of the causal model in the specific circumstances” (Waldner 2015: 243)

84
Q

Frequentist and Bayesian: Friends or foes?

A

Friends!
Frequentist logic can be applied without reference to Bayesian logic Bayesian logic contains elements of the Frequentist logic
→ Bayesian logic goes beyond Frequentist logic

85
Q

The importance of reflexivity
A researcher‘s identity and her theoretical priors shape type and quality of data that can be collected!
RESEARCHER BIAS

A
  1. Personal characteristics
    * Your gender, race, age, sexual orientation, social status, etc.
    * Your values, ethics, politics
    * Your family background / upbringing / current social sphere
  2. Institution
    * Your discipline, department and its identity, research paradigm
  3. Research project
    * Your theoretical priors
    * Project limitations (budget, timeline etc.)
    We try to detach, but we all view the world from somewhere! So do our informants!
86
Q

Differet methods of qualitative data collection and generation

A
  1. Fieldwork
  2. Participant observation
  3. Focus groups
  4. Qualitative interviews
87
Q

What is, and when to use fieldwork.

A

New data and refined measurements

  • Interviews; Participant observation; Archival work (incl. hard-to-access quan data); Field experiments; etc.
    Innovative ideas and perspectives – the unexpected and the underexplored
  • data generation and analysis – continuous re-assessment of theories and concepts
88
Q

Six principles (Kapiszewski et al., p. 8-9) of fieldwork.

A
  1. engagement with context, 2. flexible discipline, 3. triangulation, 4. critical reflection, 5. ethical commitment, 6. transparency
89
Q

Challenges of fieldwork

A
  • Emotionally/psychologically/ethically often more demanding than staying at your desk
  • Loss of objectivity – insider bias
  • Observer effects
90
Q

What is, and when to use participant observation

A

“Observation carried out when the researcher is playing an established participant role in the scene studied” (Garcés Mascarenas, 2013).

Real behavior by real people in real context
Deep understanding of motivations and reasoning through identification Differences between rules/official discourse and practice
Closed organisations, marginalised groups, grey zones

91
Q

Challenges of participant observation

A
  • resource-intensive (long periods of time, full immersion)
  • Subjective by design
  • Excessive identification – seizing to be an observer
  • Covert often unethical, but overt PO changes the natural setting
92
Q

What is, and when to use focus groups

A

Group discussions organized by the researcher to explore a specific set of issues, focused through a collective activity/stimulus in which research data is generated by group interaction (Kitzinger 1994).

Puzzles - find new explanations that lead to theory modification/building Interest in group interaction, social relations
Shared meaning
Preparation of standardized survey: conceptualization and validity of measurement

93
Q

Challenges with focus groups

A
  • resource-intensive
  • active intervention of researcher/moderator requires skill and training –
    moderator bias
  • Individual/socially stigmatised views unlikely to be voiced
  • Dominant and passive participants
94
Q

What is, and when to use qualitative interviews.

A

Puzzles - find new explanations that lead to theory modification/building Meaning of concepts for people involved / their understanding of interest Deep/hidden information in particular on causal processes
Sensitive topics where trust is needed to get information
Prelim. analysis / entry point to get access to a field / hard-to-access data

95
Q

Challenges with qualitative Interviews

A
  • Social interaction– researcher part of data generating process
  • Maintaining the right balance of control and openness
    à„think jiu-jitsu rather than the blunt force of sumo wrestling“ (Delaney 2007)
96
Q

Sampling options for interviews (Lynch 2013):

A
  • Random (stratified or non-str.) + and - ?
  • Non-random + and -?
  • Purposive
  • Convenience
  • Snowball
  • Interstitial contacts
97
Q

Random (stratified or non-str.) sampling

A

A simple random sample is used to represent the entire data population and randomly selects individuals from the population without any other consideration.

A stratified random sample, on the other hand, first divides the population into smaller groups, or strata, based on shared characteristics. Therefore, a stratified sampling strategy will ensure that members from each subgroup are included in the data analysis.

98
Q

Non-random sampling

A

Non-probability sampling is a method of selecting units from a population using a subjective (i.e. non-random) method. Since non-probability sampling does not require a complete survey frame, it is a fast, easy and inexpensive way of obtaining data.

99
Q

Purposive sampling

A

Purposive sampling, also known as judgmental, selective, or subjective sampling, is a form of non-probability sampling in which researchers rely on their own judgment when choosing members of the population to participate in their surveys.

100
Q

Convenience sampling

A

Convenience sampling is a non-probability sampling method where units are selected for inclusion in the sample because they are the easiest for the researcher to access. This can be due to geographical proximity, availability at a given time, or willingness to participate in the research.

101
Q

Snowball sampling

A

Snowball sampling is a recruitment technique in which research participants are asked to assist researchers in identifying other potential subjects.

102
Q

Interstitial contacts sampling

A

Someone approaches the researcher, researcher do not choose subject at all

103
Q

When to use interviews?

A
  1. In preliminary research
    − Before the actual research project
    − Not the main data source
    − 34:”identify fruitful (and fruitless) avenues of research”
    − e.g. identify/refine concepts and measurement
  2. In the main study
    − 36:”test central descriptive and causal hypotheses in political science research”
    − Overt vs latent content
  3. In multi-method research
    − In combination with other methods
    − For the purpose of Triangulation
104
Q

Archival research: Is document authentic?

A

Beach, Pedersen (2019, 137)
1. Has the document been produced at the time and place when an event occurred, or has it been produced later and/or away from where the events took place?
2. Is the document what it claims to be?
3. Where and under what circumstances was it produced?
4. Why was the document created?
5. What would a document like this be expected to tell us?
→ If document authentic, it might have some inferential value for our research project

105
Q

Qualitative content analysis

A

is a method for systematically describing the meaning of qualitative material. It is done by classifying material as instances of the categories of a coding frame.“ (Schreier p. 1)
Rich data that requires interpretation (Schreier, p. 3) Not just text - visual material also possible

106
Q

Systematic, rule-bound procedure
Coding
Goal

A
  • Coding = interpreting meaning, yet following clear guidelines
  • Goal: Intersubjective agreement on meaning
107
Q

Individual steps of coding QCA

A
  1. Define the sampling unit
  2. Define the context unit
  3. Define the coding unit
  4. Define the categories and the rules for their application
    (= the “coding frame”, incl. revision to improve validity)
  5. Apply the categories to the corpus (incl. tests for intra- or inter-coder reliability)
  6. Draw inferences on the basis of the coding results CAQDAS software can support you in step 5 and 6 frequencies of categories, network of categories, co-occurrence of categories
108
Q

Transparency of research

A

Sharing data and full transparency a specific challenge in qualitative research …
* alongside systematically collected data, also variety of valuable less systematic data
* privacy concerns and responsibility towards informants – confidentiality and trust
* getting consent for sharing might change the interaction and data collected
* data often generated through social interaction allowing for openness: influence of
interpretative frames of original researcher – different epistemological perspectives
* mostly primary language data
* rich textual data – > even if not generated, but collected: copyright concerns?
Benefits of sharing? (Diana Kapiszewski)
* Allows data to accumulate and be used for secondary analysis
* Facilitates collaboration
* Encourages rigor, and allows for evaluation of research products
* Optimizes use of publicly funded data/research
* Benefits scholars without resources to conduct research
* For research findings with deep social value, unethical not to share your data.

109
Q

Trancperancy 1

A
  1. Data access
    * Where is the data you used?
    * Who can access it and how?
    * If your own and you restrict access, re-think. If you stick to it, justify why
  2. Production transparency
    * How were the data collected / generated?
    * Where not your own, give insight into how authors of data proceeded
  3. Analytic transparency
    * How was the data analysed? What were the rules you applied in the process?
    * How did you connect evidence and claims?
    * Link each inference directly to the evidence backing it up
    * Consider using „annotation for transparent inquiry“ (ATI) and the Qualitative Data
110
Q

Reusability & replicability

A

Documentation and data management tips:
* think of someone else and your future self!
* start early and design a data management plan (https://managing-qualitative-
data.org/modules/1/b/)
* review regularly
* de-identify to ensure privacy
* ease access to publicly available, but hard to collect primary data (e.g. archives)
* safe content of data collected online, links won’t work in the future
Written appendix, minimum:
* complete list of documents/transcripts used for the research, where they can be accessed how they were produced (for interviews: publish guideline plus eventual adaptations)
* coding frame (detailed rules guiding how material was content-analysed)
Always bare confidentiality in mind, de-identify where needed and re-ensure and continue to re-ensure consent!

111
Q

Ethical issues in qualitative research

A
  • Research interest: social background/motives of men engaging in “Tearoom Trades” (1960s)
  • Humphreys acts as “lookout”
  • He builds up contacts with men→interviews
    some of them
  • In a second step, he writes down license plates
    of men to interview them a year later as a
    “health service interviewer”
  • →gets information on marital status,
    occupation, income etc.
    Until today Humphrey’s study is taken as an example for unethical research in social science → Men don’t know their “lookout” is a researcher, no
    consent
    → Information from license plates as a “market
    researcher”
    → Interviews with subjects as “health care interviewer”
112
Q

Repository

A

Diana Kapiszewski‘s rule: If you cannot share the data itself, share as much information about the data as you can and explain what you cannot share and justify why!

113
Q

Congruence analysis

A

A congruence analysis approach (CON) is a small-N research design in. which the researcher uses case studies to provide empirical evidence. for the explanatory relevance or relative strength of one theoretical. approach in comparison to other theoretical approaches.

114
Q

Covariational analysis

A

A co-variational analysis can provide first evidence for the claim that X made a difference in the case of interest by showing that a differ- ent value of X in other cases is co-existing with a different value of the dependent variable Y

115
Q

co-variational analysis

A

A co-variational analysis can provide first evidence for the claim that X made a difference in the case of interest by showing that a differ- ent value of X in other cases is co-existing with a different value of the dependent variable Y

116
Q

Gerrings case selection table
Type of cases

A

Descriptive or Causal

117
Q

Descriptive cases

A

Typical = mean or median cases
Diverse = typical sub-types

118
Q

Causal cases

A

Exploratory = to identify H
Estimating = to estimate H
Diagnostic = to asses H

119
Q

Exploratory cases

A

Extreme = maximize variation in X and Y
Most different
Most similar
Index = first instance of change in Y
Deviant = poorly explained by Z (does not fit the theory or other similar cases)
Diverse = all possible configurations of Z

120
Q

Estimating cases

A

Longitudinal = X changes, Z constant or biased against HX
Most-similar = Similar on Z, different on X

121
Q

Diagnostic cases

A

Influental = Greatest impact on P(HX)
Pathway = X ! Y strong, Z constant or biased against HX
Most-similar = Similar on Z, different on X

122
Q

OMNIBUS

A

Intrinsic importance = Theoretical or practical significance
Case independence = X and Y unaffected by values for other cases
Within-case evidence = Suitability of case-based evidence
Logistics = Accessibility of evidence for a case Representativeness = Generalizability

123
Q

Single case

A

Type-level, only one case but it’s applicable in different times and spaces

124
Q

Singular case

A

Token-level, only one case, only applicable in specific times and spaces

125
Q

Counterfactual dependence and possible worlds

A

The basic and intuitive counterfactual definition of a cause is: a singular event x causes a singular event y if and only if had x not occurred, y would not have occurred. For our running example, we now have to replace the type-level claim with a token-level claim, e.g. “granting a new autonomy statute to the Catalans in 2006 (x) caused increased support for secessionist Catalan elites in the elections to the Catalan parliament in 2010 (y)”. This claim is true if we can establish that had the Catalans not received a new autonomy statute in 2006, support for secessionist elites would not have risen in 2010.

126
Q

Counterfactual dependence and interventions

A

He states that the type- level claim “X causes Y” is true if there is an intervention on the variable X that will change the values of the variable Y (Woodward 2003:55): “A necessary and sufficient condition for X to be a direct cause of Y with respect to a variable set V is that there be a possible intervention on X that will change Y (or the probability distribution of Y) when all other variables in V besides X and Y
are held fixed at some value by interventions.”

127
Q

Process theories

A

Process theories dispense with the idea that causation requires difference- making and see causation as production instead. Under the process account, causation requires a
spatiotemporally continuous process transmitting some physical structure from a token cause to its token effect. Process theories are located at the token level because this is where the processes unfold. Whether a type of process is causal then depends on generalization over the singular causal processes