Trying not to fail Flashcards

1
Q

What type of RQs are there?

A

Exploratory
Explanatory
Descriptive

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What are exploratory RQs for, and what type of RD is often used for them?

A

Pave way for further questions, understand what happens (often flexible RD)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What are descriptive RQs for, and what type of research are they often used in?

A

Portray accurate profile of people or situations; comparison
NOT: testing relationships or predicting outcomes
Quantitative study/ after qualitative study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are explanatory RQs for, and what type of RD is often used for them?

A

Explain situation, problem, pattern; find relationships between phenomena
Looking for causality

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What type of study fits with a fixed research design?

A

Experiments, quasi-experiments, non-experimental studies

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What type of study fits with a flexible research design?

A

Case studies, ethnographic research, grounded theory

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What RD and type of study are usually used for descriptive RQs?

A

Fixed, non-experimental

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What RD and type of study are usually used for explanatory RQs?

A

Fixed, (non)experimental

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What RD and type of study are usually used for exploratory RQs?

A

Flexible, whatever

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What are limitations of experimental designs?

A

IV manipulation not always possible/ ethical
Random assignment ≠ equivalent groups (tho the more the better)
Sometimes other designs work better

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What are internal validity threats? (9)

A

Maturation
History
Test effects
Instrumentation
Regression to the mean
Selection
Mortality & attrition
Interactions with selection (e.g., history)
Uncertainty over causal influences (A -> B vs. B -> A?)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What are statistical validity threats? (5)

A

Low power
Fishing
Unreliable measurement instruments
Unstandardised procedure
Coincidental differences between groups/ in experimental situation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What are construct validity threats? (7)

A

Construct underrepresentation
Surplus construct irrelevancies
Mono method bias
Demoralised control group
Fear of evaluation
Research expectations
Hypothesis guessing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What are external validity threats?

A

Specificity to:
group
context
historical influences
constructs within group

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What are the four types of validity mentioned in the course?

A

Statistical + internal + external + construct

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What types of IV manipulations are there?

A

Stimulus (e.g., training vs. no training)
Instructional (e.g., cooperate vs. compete)
Contextual (e.g., cluttered vs. clean room)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

In what ways can the DV be measured?

A

Subjective (report)
Cognitive (do task)
Behavioural
Neurobiological (fMRI)
Physiological (heart rate)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What are the three necessary conditions to establish a causal relationship?

A
  1. Relationship condition (A and B related)
  2. Temporal antecedence condition (A prior to B)
  3. Lack of alternative explanations condition (no alternative explanation C)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

How can you increase external validity?

A

Random sampling
Deliberate sampling for heterogeneity or maximum differences
Generalising to modal instance (purposely sampling for particular instance like age)
Replication (to check external validity)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What are ways to measure variables?

A

Tests
Questionnaires
Observations
Interviews
Objective data (e.g., salary)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What is common method variance?

A

Variance attributable to measurement method > construct

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What are problems with observation as a measurement method?

A

Reactivity of participants to being observed
Observational biases: selective attention, selective encoding, memory, interpersonal factors

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

What are problems with questionnaires as a measurement method?

A

Subjective
Are participants honest/ serious? Do understand questions?
Common method variance
Non-response bias

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

What are the seven steps to choosing a questionnaire?

A
  1. Theoretical framework
  2. Concept analysis/ specification
  3. General item attributes (abstract -> behaviour, cognition; determine sub scales)
  4. Generate items
  5. Evaluate items
  6. Create questionnaire
  7. Evaluate questionnaire
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

What is important when generating questionnaire items?

A

Simple language (clarity, brevity)
Clear timeframe (bounded recall, restricted recall)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

What should be avoided when generating questionnaire items?

A

Open-ended questions
Negative questions
Frequency references
Leading questions
Double-barred questions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

What is the Socrates effect?

A

Filling in one item influences how you fill in later items

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

What are shared biases by participants for the same method?

A

Social desirability
Negative affect
Acquiescence
Illusory correlations
Halo bias (e.g., rating someone similarly for different performance aspects)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

How can you see common method variance?

A

Multi-trait multi-method matrix

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

What types of validity can you see in a MTMM matrix?

A

Convergent validity (similar constructs should be related)
Discriminant validity (dissimilar constructs should be unrelated)

31
Q

How can common method variance be reduced?

A

Using different sources to measure IV and DV
Separate measurement of IV and DV (temporally, proximally, psychologically)
Statistically control for bias

32
Q

What are the 6 research steps?

A
  1. RQ
  2. Measurement method
  3. Sampling strategy
  4. Measurement strategy
    [data collection]
  5. Analyse data
  6. Evaluate results
33
Q

How can you deal with extraneous variables in experiments?

A

Control by randomisation
Control by matching or holding constant
Sampling

34
Q

When does an extraneous variable become a confound?

A

When it systematically varies both the IV and the DV

35
Q

What kind of true experimental designs are there?

A

Matched design
Repeated-measures design
Two-group designs
- Post-test only RCT
- Post-test only two treatment comparison
- Pre-test post-test two treatment comparison
- Pre-test post-test RCT
3+ group simple designs
Factorial design
Parametric design

36
Q

What kind of quasi experimental designs are there?

A

Pre-experimental
- Single-group post-test only (-)
- Post-test only non-equivalent groups (-)
- Pre-test post-test single group design (-)
- Pre-test post-test non-equivalent group
Interrupted time series (repeated measures pre and post intervention)
Regression-discontinuity (below/ above set criterion value into different groups)

37
Q

What are types of single-case experiments?

A

[A = baseline phase; B = intervention phase]
A-B designs (similar to interrupted time series)
A-B-A designs
A-B-A-B designs
Multiple baseline designs
- Across settings
- Across behaviours
- Across participants

38
Q

Why do non-experimental fixed designs exist?

A

Some things cannot be modified (e.g., age), should not be modified (e.g., smoking), are not feasible to modify (e.g., placement in school)

39
Q

What are types of non-experimental fixed designs?

A

Descriptive
Explanatory
Predictive

40
Q

What are the three types of time-dimensions?

A

Cross-sectional (1 point)
Longitudinal (2+ points)
- Panel designs (same participants)
- Trend designs (different participants)
Retrospective (simulate longitudinal)

41
Q

What are three common design problems that lead to rejection from AMJ?

A

Mismatch between research question and design (e.g., cross-sectional design for causal RQ, wrong sampling)
Measurement and operationalisation (wrong adaptation of pre-existing measures, common method variance)
Incomplete model (proper use of control variables, mediators operationalised)

42
Q

What are the three conditions control variables should meet for being included in a study?

A
  1. Strong expectation that it’s correlated with DV
  2. Strong expectation that it’s related with IV
  3. Logical reason why it’s not a more central variable
43
Q

What do Spencer et al. thinking about measurement-of-mediation designs?

44
Q

When should one use a measurement-of-mediation design?

A

Mediator hard to manipulate but easy to measure

45
Q

When should one use a moderation-of-process design?

A

Mediator easy to manipulate but hard to measure

46
Q

When should one use a experimental-causal-chain design?

A

Mediator easy to manipulate and easy to measure

47
Q

What is a census?

A

When u survey a whole entire population

48
Q

What types of probability sampling are there? (5)

A

Simple random sampling (e.g., lottery)
Systematic sampling (e.g., every 5th name)
Stratified random sampling (e.g., from subgroups) - can be (dis)proportionate
Cluster sampling (when population dispersed and large)
Multi-stage sampling (cluster sampling, can be stratified; e.g., school - class - child sample)

49
Q

What kind of non-probability samples are there? (10)

A

Quota sampling (from various population elements)
Dimensional sampling (kinda quota sample; include important survey dimension in sampling)
Convenience sampling (near & convenient participants)
Purposive sampling (specific sample; used in grounded theory)
Snowball sampling (participants find new ones)
Time sampling (across time; use specific space at specific time)
Heterogeneous sampling (wide varying on value)
Homogeneous sampling (little varying on value)
Extreme case sampling (extreme values)
Rare element sampling (low frequency in population)

50
Q

What is a sociometric scale?

A

Describes relationship between individuals in a group

51
Q

How can a time frame be provided in questionnaire questions? (5)

A

Bounded recall (since last…)
Restricted recall period (in last 3 months)
Average (how many on average)
Marks (since beginning of school year)
Cues (when u won…)

52
Q

What are the three main observational method types?

A

Participant observation (flexible, qualitative)
Structured observation (fixed, quantitative)
Unobtrusive observation (non-participatory role; can be (un)structured)

53
Q

What are four advantages of observation?

A

Directness
Triangulation (help complement other info)
No social desirability effect
Lack of artificiality -> ecological validity

54
Q

What are three disadvantages of observation?

A

Reactivity (if observer affects situation)
Logical problem (behaviour measured or not?)
Time consuming (less if structured)

55
Q

What’s the dichotomy of observation as a method?

A

Formal observations (structured, direction; pre-specified elements) -> reliability, validity
Informal observations (more freedom) -> complete, complex data

56
Q

For which situations is participant observation suited?

A

Small groups
Short events
Frequent events
Accessible events
Enough time
U wanna find out what’s going on

57
Q

What does participant observation entail?

A

Becoming member of observed group to share “symbolic” world, habits, norms, etc.

58
Q

What are participant observation roles?

A

Complete participant (observer doesn’t share observer status)
Participant-as-observer (participating & observing)
Marginal participant (less participation; e.g., bus passenger)
Observer-as-participant (no participating but consensual observing)

59
Q

What are the five main steps of analytic induction?

A
  1. Rough definition
  2. Initial hypothesis
  3. Study situation in context of hypotheses
  4. Edit hypotheses or definition
  5. Repeat
60
Q

What observational biases come with participant observation?

A

Selective attention (even out attention)
Selective encoding (subconscious)
Selective memory (write shit up)
Interpersonal factors (biases)

61
Q

What are two truths regarding mono method bias Spector names?

A

Measurement affects data
Same method and same bias -> correlation inflated

62
Q

What are five sources thought to be central to mono method bias?

A

Social desirability
Negative affectivity
Acquiescence
Illusory correlations
Halo bias

63
Q

How can u deal with mono method bias?

A

Rethink - is it actually there?
Different sources to measure IV and DV
Separate IV and DV measurement (temporally, psychologically w cover story, proximally in different conditions)

64
Q

What two viewpoints are there about real-world research?

A

Evaluation viewpoint (understand, communicate)
Change viewpoint (suggest how to change shit)

65
Q

What are the three types of gap spotting?

A

Confusion spotting (competing explanations)
Neglect spotting (under-researched)
Application spotting (extending existing literature)

66
Q

What are the three key ideas of abduction?

A
  1. Explaining patterns of data, build hypothesis
  2. Entertaining multiple hypotheses (comparative theory evaluation)
  3. Inference to best explanation (similar to grounded theory) - best explanation given evidence
67
Q

What are criteria for theory evaluation? (5)

A

Fruitfulness, parsimony, scope, progressiveness, consistency

68
Q

What are three famous flexible design research strategies?

A

Case study
Ethnographic study
Grounded theory study

69
Q

What components of a study should be decided on before and after RQ?

A

Before: Purpose, conceptual framework
After: methods, sampling

70
Q

What’s the ecological fallacy?

A

Making inferences about individuals from aggregate data

71
Q

Validity =

72
Q

Reliability =

A

consistency

73
Q

What are the two ways in which lab experiments may lack realism?

A

Experimental realism - situation not: realistic, involves & impacts participants
Mundane realism - situation not realistic in real world

74
Q

What are two general types of bias specific to experiments?

A

Demand characteristics (do what u think u should)
Expectancy effects (experimenters see what they wanna)