Module 2: Methods and Bias Flashcards

1
Q

cross-cultural validation studies

A

the valididty (= accuracy) and reliablility (= consistency) of a scale, test, or measure originally developed in one culture examined across different cultures
- aim is to check whether the measure is equivalent across cultures

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

indigenous cultural studies

A

these allow for in-depth analyses into a single culture
- the insights from these studies can then be compared across cultures

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

cross-cultural comparison studies

A

psychological constructs are compared between participants from 2 or more cultures

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

exploratory vs hypothesis testing

A

exploratory studies examine whether cultural differences or similarities exist
- hypothesis testing studies examine why cultural differences exist

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

presence vs absence of contextual factors

A

contextual factors are variables that can explain cross-cultural differences

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

structure vs level oriented

A

structure-oriented studies compare constructs, measures, or relationships with other constructs across cultures
- level-oriented studies compare differences between average scores across cultures

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

individual vs ecological (cultural) measurement level

A

in individual-level studies, the unit of analysis is data from individuals
- in ecological-level studies, the unit of analysis is date from countries or cultures

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

cannot assume isomorphism

A

we cannot assume that a relationship or association between variables is the same at every level

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Simpsons Paradox

A

where there is a relationship in one life that does not exist in another

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

avoid ecological fallacy

A

occurs when country-level data are used to make statements about individuals of that country

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

avoid dichotomies

A

a division or contrast between 2 things that are, or are being presented as being opposed or entirely different
- individualist OR collectivist
- independent OR interdependent

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

avoid cultural essentialism

A

culture is believed to be a central aspect of someone’s personality that defines who they are

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

linkage studies

A

studies that attempt to discover a linkage between psychological and cultural variables
- unpacking studies
- experiments

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

unpacking studies

A

aim to explore and identify the specific cultural factors or mechanisms (like values, norms, or practices) that explain cultural differences in behavior, rather than simply noting that differences exist
- also called context variables (operationalize cultural constructs)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Poorting (2016, 2022)

A

compared unpacking studies to peeling an onion
- we cannot explain behavior by culture alone, but must ‘peel’ it layer by layer
- sees culture as a place holder for that which we do not know yet

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

experiments

A

research in which one variable is manipulated to observe its effect on the other variable
- 2 types: priming and behavioral

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

priming experiments

A

manipulating the participant’s train of thought to observe behavioral change

18
Q

behavioral experiments

A

manipulating the environment to observe behavioral change

19
Q

bias

A

a systematic error that endangers the comparability of data across cultures and groups

20
Q

construct bias

A

the measured construct is not identical across cultures/groups

21
Q

model bias

A

does the theoretical framework of whatever it is we are measuring translate in the same way across cultures?

22
Q

sample bias

A

cross-cultural variation in sample characteristics, such as differences in gender, education, SES, or urbanization

23
Q

instrument bias

A

the measurement instrument might be biased

24
Q

stimulus familiarity

A

the extent to which participants are familiar with the stimuli, can have an enormous impact

25
response styles
systematic tendency to use certain categories of response
26
administration bias
administration conditions, ambiguous instructions, the interaction between administrator and respondent, or communication problems
27
interpretational bias
interpreting data based on one's own culture, without considering that of another - creates misinterpretation
28
Poortinga's 4 ways to deal with interpretation non-equivalence
- ignoring - stopping the comparison - interpreting the non-equivalence - reducing the non-equivalence
29
linguistic/item bias
cross-cultural research is done in many countries, speaking many languages, therefore it is a concern whether or not terms in a language have the same meaning when translated into other languages
30
back translation
helps reduce linguistic bias by translating a piece of text from language 1 to language 2, then translating it back to language 1
31
equivalence
the level of comparability across cultures and groups - related to the measurement level at which scores obtained in different cultures can be compared - e.g. kilometers vs miles can be converted into one another
32
construct equivalence
no construct bias is present - we are measuring the same thing across cultures
33
measurement unit equivalence
with conversion, we can obtain equivalent scores
34
full score equivalence
no bias present - this is the goal, but not always obtainable
35
minimization of bias
- design - implementation - analysis
36
design
- "how can i make my study culturally appropriate?" - choice of instruments is important - instruments can be adopted, adapted to the context, or assembled
37
implementation
"how can i conduct my study in a culturally appropriate way?" - pilot studies, standard protocols, and clear instructions are important
38
analysis
"do my items behave differently?" - exploratory/confirmatory factor analysis and differential item functioning analysis can be used
39
qualitative research
done in a natural setting or in the field - help to gather information about a culture we are dealing with for the first time, build theoretical models, and generate hypotheses - depends on interpretation, and it is difficult to formalize procedures - a lot of room for bias
40
quantitative research
independent and dependent variables are used - useful for hypothesis testing - often difficult to control for the variables - post hoc cultural interpretations are very susceptible to bias