Sampling Flashcards

1
Q
A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Which has higher INTERNAL validity: randomized or non-randomized designs

A

Randomized - participants are randomly assigned to levels of the IV

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Which has higher EXTERNAL and CONSTRUCT validity: randomized or non-randomized designs?

A

Non-randomized

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Variance BETWEEN participants

A

Different groups have different conditions and the groups are compared to each other (use random assignment to assign participants to groups)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Variance WITHIN participants

A

Each participant experiences different conditions - participants as own comparison

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Selection (threat to internal validity)

A

Pre-existing differences between participants in different experimental conditions. Occurs when there is no random assignment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Maturation (threat to internal validity)

A

Participants/things measured change over time (boredom, decay, growth, development, etc.) (e.g. measuring concentration in children, but older children concentrate better)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

History (threat to internal validity)

A

Interruption from an unwanted source affects DV (e.g. room getting warmer during a concentration test, which affects concentration)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Test effects (threat to internal validity)

A

The observation changes what it observes (e.g. due to repetition, subjects learn to do a concentration test faster (i.e., memory is measured instead of concentration))

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Instrumentation (threat to internal validity)

A

The observation is not done consistently - changes in measurement procedures/devices (e.g. measuring concentration and using a new concentration test on day two of experiment)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Mortality (threat to internal validity)

A

Drop out (e.g. participants do not return for the post-(treatment) test)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Selection by maturation (threat to internal validity)

A

Different groups mature differently (e.g. examining groups of adolescents according to birth-assigned sex; testing effect of protein intake on development of strength)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Simple random (probability sampling)

A

Every element has an equal and independent chance of selection

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Probability sampling

A

Every element of a population has a known chance of being included in the sample

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Stratified random sampling (probability sampling)

A

Population is divided into distinct strata based on specific criteria, then samples are drawn from each stratum separately and combined

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Cluster sampling (probability sampling)

A

Used for large population or geographically dispersed ones - create a list of clusters and select using simple/stratified random sampling

17
Q

Systematic sampling

A

A random sample, with a fixed periodic interval, is selected from a larger population (e.g. every 5th, 10th, 15th element is selected)

18
Q

Convenience sampling / Haphazard sampling (non-probability sampling)

A
  • Select elements because they are at hand/easiest to access
  • Prone to bias
19
Q

Quota sampling (non-prob sampling)

A
  • Selection of elements based on certain characteristics in the population (e.g. equal amounts of men and women)
  • Bias through personal selections for convenience
20
Q

Purposive sampling (non-prob sampling)

A
  • Handpick cases believed to be representative on a population
  • Compromises generalizability of findings
21
Q

Snowball sampling (non-prob sampling)

A
  • Multistage sampling technique - initially small and it expands as participants recruit others
  • Start with a stratified random sample
22
Q

Why use non-probability sampling?

A
  • More economical
  • Increased internal validity (but decreased external)
  • Used for insight and ideas, not generalizability (useful in psychology)
23
Q

Repeated measures design (randomized)

A
  • exposes same participants participants to multiple treatments, allowing for variation to appear within the same individual
  • randomly assigned to different conditions
  • efficient and requires less participants (detects more individual fluctuations and biases)
24
Q

Limitations and drawbacks of randomized experiments

A
  • Experimental artifacts -> unintended effects on DV caused by experimental setting and not the IV
  • Increased internal validity but decreased external -> findings are difficult to generalise
  • “college sophomore” problem -> many experiments are conducted with college students so findings are not representative of the broader population
25
Q

What is the aim of survey research?

A

To describe the distribution of attitudes, behaviours, and other characteristics within groups and examining their relationships
- NON EXPERIMENTAL (describes relationships, doesn’t establish causality)

26
Q

Sources of error in survey research

A
  • Coverage (some of the population is not in the sample - bias)
  • Sampling (random differences between people)
  • Measurement (bias from the way constructs are assessed)
  • Non response (bias from low response rates - sample isn’t representative)
27
Q

Survey designs (2 of them)

A
  • Cross-sectional surveys –> data collected in a single point in time to estimate the prevalence of characteristics in a population
  • Panel survey –> data collected from the same participant at multiple points in time to assess the stability or change (more costly but increases internal validity)
28
Q

Modes of data collection in surveys

A

Questionnaires, face-to-face interviews, telephone interviews

29
Q

Pros and cons of questionnaires

A

PROS:
- Cost effective
- Flexible for respondents
CONS:
- Interviewer bias and low response rates
- Anonymity of internet surveys leads to low accuracy
- Lack of control over answers

30
Q

Pros and cons of face-to-face interviews

A

PROS:
- Ideal for open-ended responses and lengthy interviews
- High response rates
- Suitable for specific needs e.g. no internet/visual aids etc.
CONS:
- High cost and presence of interviewer = bias
- Difficult to access gated communities

31
Q

Pros and cons of telephone interviews

A

PROS:
- Cost effective
- Efficient
- Reduced interviewer bias
CONS:
- Declining response rates
- Limited rapport with interviewee
- No visual aid
- Some questions may be too complex to do over the phone

32
Q

Key ideas in non-experimental research

A
  • No planned manipulation or intervention
  • Sometimes can turn into quasi-experimental
  • Useful when an event has already occurred
    0 It can complement experimental research by exploring unplanned events
  • Opportunistic and flexible
  • Includes surveys, questionnaires, observational, and archival research
33
Q

Main idea surrounding naturalness in research

A

observational and archival methods to offer unobtrusive ways to study behaviour (participants are unaware of certain parts)

34
Q

What are the 3 dimensions of naturalness in research?

A
  1. Behaviour: occurs independently of researchers influence
  2. Setting: Context not created for research purposes i.e. public spaces –> makes participants act more naturally
  3. Event: Incidents that happen without research intervention
35
Q

What are collateral reports (indirect method of measurement)

A

Someone other than the participant provides information about the participant
- detects biases in self-reports
- Sometimes third-party reports disagree and require more research
- Increases the cost of study and has longer recruitment

36
Q

What is observation (indirect method of measurement)

A
  • Does not rely on participants = unbiased judges
  • Take note of subtle, nonverbal cues
  • Requires unobtrusive observation
37
Q

What are psychological measures (as an indirect method of measurement)

A
  • interplay of physiological systems (endocrine/cardiovascular)
  • despite knowing, the participants cannot control the outcome
  • Real time measurement
  • Overwhelming information, numerous control variables, lots of expertise needed
  • Expensive and sensitive equipment
38
Q

Criteria to create good questions for surveys

A
  • TERMINOLOGY –> avoid jargon and ambiguity
  • AVOID DOUBLE DENIAL –> no denial at all is best
  • KISS –> Keep It Short and Simple but specific
  • Avoid multi-dimensional questions
  • Use OBJECTIVE and non-suggestive language