3 SRM (OPERATIONALIZATION) Flashcards

1
Q

Research and methods

A

Research – the process of discovering answers to
questions using systematic procedures.
❖ Methods – systematic procedures for performing a
task and/or achieving a goal.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

QUALITATIVE and QUANTITATIVE methods.

A

➢Quantitative – collecting data with predetermined
instruments and analyzing statistically.
➢Qualitative – collecting emergent data and
focusing on words and meanings.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

❖Quantitative research

A

➢ Deductive
➢ Studies variables and their
relationships
➢ Based on meanings derived
from numbers
➢ Collects numerical and
standardised data
➢ Structured inquiry
➢ Samples are larger and
probabilistic
➢ Macro-level
➢ Easier to replicate
➢ Results more “objective” and
generalizable
➢ Uses statistics for analysis
and inference
➢ Detached researcher
➢ Difficulty with complex
causality

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

❖Qualitative research

A

➢ Inductive
➢ Studies cases
➢ Based on meaning
expressed in words
➢ Smaller samples, guided by
theory, purposive (non-
probability)
➢ Micro-level
➢ Flexible inquiry
➢ Sensitive to context, process
and complexity
➢ Seeks in-depth
understanding
➢ Focused on authenticity
➢ Less replicable
➢ Involved researcher
➢ Limited by researcher’s
characteristics

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Factors to consider when choosing approach - qualitative vs quantitative

A

❖Research question
❖What exactly are we trying to find out?
➢Make standardized, systematized comparisons,
sketch contours and dimensions, account for
variance? – Quantitative.
➢Study this phenomenon in detail, holistically, in
its context, find out its meaning for the people
involved, figure out the process? – Qualitative.

❖Knowledge payoff
❖Which approach will give more useful
information?
➢Relatively superficial and rational responses –
quantitative.
➢Below the surface, emotional responses – qualitative.
❖Which approach fits our population?
➢Sparse description of a large number of cases –
quantitative.
➢Rich, detailed description of a smaller number of cases
– qualitative.

✓Practical considerations
❖Time.
❖Money.
➢Qualitative – relatively high cost per respondent and
relatively low cost per project.
➢Quantitative – relatively low cost per respondent and
relatively high cost per project.
❖Availability of samples.
❖Availability of data.
❖Access to situations.
➢Physical-geographical.
➢Cognitive.
❖Participants’ cooperation.

✓Literature
❖What have others used to research this topic?
❖Do I want to go along with the literature or offer
alternatives?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

✓Why combine quantitative and qualitative approaches?

A

❖Triangulation – check findings against
each other → enhance validity.

❖If the study is mostly qualitative,
quantitative research can:
➢help in the choice of subjects;
➢help strengthen otherwise ungeneralizable
findings;

❖If the study is mostly quantitative,
qualitative research can:
➢provide background information;
➢be a source of hypotheses;
➢help create scales and typologies;
➢help explain relationships between variables
and interpret findings.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

✓Qualitative research

A

❖Fieldwork
❖Interview
➢ From semi-structured to
unstructured
➢ From semi-standardized to
unstandardized
❖Focus groups
➢ Guided group discussions –
quite popular in political
campaign & marketing research
❖Ethnography
➢ Observing a group in its natural
environment for a prolonged
period of time
➢ Primarily non/participant
observational and interview data
❖Grounded theory
➢ Start with observations and
continuously refine their
categorization and explanation
until you have a theory
❖Discourse analysis
❖Process tracing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

✓Quantitative research

A

❖Survey
➢Sampling is key
Representative
Probabilistic
➢Structured interviewing
➢Standardised questionnaires

❖Content analysis
➢Counting keywords/key
phrases in a text

❖Secondary statistical analysis

✓Experiments
Most scientific
Quasi-experiments/ Field experiments
✓Action/participant research
✓Case study
❖Multiple sources/ types of data
collection methods

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

❖Variable

A

❖Variable – an empirical characteristic/
quality that can take 2 or more different
values in different situations.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

❖To establish a causal connection between IV & DV:

A

➢IV and DV must co-vary
➢IV should precede DV in a time sequence
➢No other factor can be a possible cause of the change in
DV – control for effects of other variables
➢A logical explanation – theory – why the IV affects DV

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Other variables could affect the relationship between the DV
and IV:

A

❖Control – variables that are held constant/ neutralized/ eliminated
to not have a biasing effect.
❖Extraneous/ nuisance/ confounding – variables in the research
environment that are not controlled. Dangerous for validity, must
be taken into account when interpreting findings.
❖Intervening – link the IV and DV but are not directly observable,
must be inferred. More complex causality. IV for DV and DV for IV.
❖Mediating – surfaces after IV started and before the effect is
observed, helps model the process.
❖Moderating – modifies the relationship between IV and DV by
moderating the strength of the effect of intervening variables, can
be measured and taken into account. The relationship between IV
and DV would be different in degree without it.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

❖Measurement

A

❖Measurement – assignment of numbers or other
symbols to characteristics/attributes of objects
according to a pre-specified set of rules.
❖Your choices in measurement are inseparable
from whether this is a quantitative or a qualitative
study.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

❖Operationalization

A

❖Operationalization – reducing the abstract
notions to observable behaviour and/or
characteristics that can be measured in tangible
ways. NOT describing correlates!

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

❖Process of operationalization:

A

➢Define the construct you want to measure:
❖Dimensions
❖Elements
➢Think about the content of the measure –
items/questions that will actually measure the
concept that you want to measure.
➢Create the instrument, such as a questionnaire
with a response format that will be measured on a
scale.
➢Assess reliability and validity of the measure.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

❖Nominal – classification

A

✓Mutually exclusive and exhaustive.
✓No intrinsic value or comparability, just grouping of
differences. Even if coded in numbers, those are just labels
and cannot be used arithmetically.
✓Few statistics apply to nominal variables (mode, frequency,
some measures of association).
✓If independent variables, may be converted into dummy
variables in statistical analysis.
✓Used for non-ranking data (gender, religion, race,
hometown, political affiliation, candidate preference, study
programme).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

❖Ordinal – ranking in an order in a meaningful way

A

✓more/less, first/last, bigger/smaller, higher/lower, preferred/hated.
✓Numbers are rank values, not actual quantities – it is not clear how the
magnitude of differences between 1 vs. 2 and 3 vs. 4 compares.
✓The “> or <” relation is ireflexive (it is not true that a>a); asymmetrical
(if a>b, then b<a); transitive (if a>b and b>c, then a>c).
✓Allows for more statistics (median (not mean!), range, gamma, tau-b, chi square test), but only nonparametric.
✓Used for ranking preferences, unequal groupings (e.g. age: <18, 18-29, 30-45, 46-60, >60), education (secondary, undergraduate,
postgraduate), social class (lower, middle, upper), place in a race
(finished first/second/third), response options (agree, neutral,
disagree), approval of a candidate (approve, disapprove), top
management attitude (supportive, neutral, opposing))

17
Q

❖Interval – the “>” relationship + known constant
distances between observations.

A

✓Real numbers, equal distances.
✓Common, precise and constant unit of measurement
($, time).
✓Few exist in social science.
✓Could be arbitrary (e.g. some argue that the scale of
“5=strongly agree, 4=agree, 3=neither agree nor disagree,
2=disagree, 1=strongly disagree” is interval, but
statistical tests show more ordinal properties).
✓All descriptive and inferential statistics apply
(median, mean, standard deviation, range, variance,

18
Q

❖Ratio

A

✓Encompasses all previous levels (equivalence + greater than
+ known distances) + has a true zero point (variables that
can measured at the ratio level can also be measured at
interval, ordinal and nominal levels, but ratio is better).
✓Allows for meaningful comparisons – both “how much
lower/ higher” and “how many times lower/ higher”.
✓All descriptive and inferential statistics apply (median, mean,
standard deviation, range, variance, t-test, regression
analysis, etc.).
✓Seldom available (number of former workplaces, age, level
of income, size of household, number of children,
percentage of supportive top managers) 2023-09-26 dr. Eglė Verseckaitė-Grzeskowiak

19
Q

❖Scale

A

❖Rating scales – has several response
categories, is used to elicit responses with
regard to the object, event or person studied.
Most popular.

❖Ranking scales
➢Ordinal – weaker.
➢Harder for respondents: forced to choose, cannot
handle more than 5-6.

✓Paired comparison scale – most
widely used:
➢asks respondents to choose among two objects
at a time.
➢to establish consistency of preferences.

20
Q

❖Nominal scales

A

❖Dichotomous scale – to elicit a Yes or No answer
➢ e.g. Do you plan to vote in the EP elections? Y/N).
❖Category scale – uses multiple items to elicit a
single response
➢ e.g. Which party did you vote for in the last parliamentary
elections?

21
Q

Ordinal - 1❖Fixed or constant sum scale – asks the
respondent to distribute a given number of
points among various items.

A

❖Fixed or constant sum scale – asks the
respondent to distribute a given number of
points among various items.

22
Q

Ordinal - 2 ❖Graphic rating/pictorial scale – a
respondent is asked to place a mark at a point on
the line to indicate their answer

A

➢e.g. On a scale from 1 to 10, how would you rate the
president of your country? 1_________________10.
➢Not very popular – untrustworthy.
➢NB! This is not an interval scale, because the
distances are not necessarily equal.

23
Q

Ordinal - 3 (rating scale) ➢Guttman scale

A

➢Options are ranked in order from high to low.
➢Choosing a higher level option implies agreeing with all
the lower ones.
➢Sometimes the respondent is not supposed to realize
all those items are related – requires strong theoretical
justification and covering important items by including
irrelevant stuff.

24
Q

Ordinal - 4 ➢Semantic differential scale

A

➢Several opposite attributes (liberal-conservative, strong-
weak, old-modern) are indicated on the extreme poles of the

scale and the respondents are asked to indicate their
attitudes in that semantic space.
➢Helps assess their attitudes towards a particular object,
individual, event.

25
Q

Ordinal - 5 Itemized rating scale

A

➢ Possible to use different anchors for the
extremes (extremely low to extremely high, very
likely to very unlikely, etc.) and different
numbers (5 is optimal).
➢ Very popular in attitudinal research.
➢ Balanced if a neutral point is provided (odd # is
better), unbalanced

26
Q

Ordinal - 6 Summated rating scale

A

➢Contains 2 or more items that measure the
quantitative variance in the same underlying
construct (higher-lower) that is a question of attitude,
not knowledge.
➢Uses the same anchors for the extremes (e.g.
extremely low to extremely high or very likely to very
unlikely, etc.) and the same numbers (5 is optimal).
➢Allows to calculate the total score

27
Q

Ordinal - 7 Likert scale

A

➢ Designed of Likert items to examine how strongly
subjects dis/agree on a 5 point scale (1-strongly
disagree, 2-disagree, 3-neither agree nor disagree, 4-
agree, 5-strongly agree).
➢ Also known as summated scale (but not all
summated scales are Likert scales) due to the
possibility to calculate a total score for the
respondent across items.
➢Treated as interval

28
Q

Ordinal - 8 Stapel scale

A

➢A single-pole scale to measure both the direction
(positive/negative) and the intensity of the
attitude towards items of study.
➢e.g. How would you rate your MP’s performance
in terms of attendance, proposing bills, etc. (from
+3 to -3)).

29
Q

❖Constructing scales – your decisions to make:

A

✓Number of scale categories:
➢ 5 is optimal, less than 4 is inadequate, more than 7 is ineffective.
➢ If telephone survey, fewer categories due to short memory.
✓Types of poles/endpoints/anchors – two-pole (high-low) or
single-pole (Stapel).
➢ Single-pole is easier to construct but harder to interpret.
✓Strength of the anchors – intensity of the adjective (extremely
high/ very high/ high).
➢ The stronger the pole adjectives, the less likely they will be chosen
by respondents.

✓Labeling of the categories – the more labels on the interim
categories, the less ambiguity.
➢ Using terms like “very” or “somewhat” markedly influences

30
Q

❖Validity – external, Validity - internal, Reliability

A

❖Validity – external – how generalizable are your
findings?
❖Validity – internal – am I measuring what I
intend to measure?
❖Reliability – the extent to which the measuring
instrument yields consistent results from one
observation to another & has low vulnerability
to changes in the situation over time.
➢Reliability as consistency (same construct – same
results).
➢Reliability as stability (same people – same results).