Chapter 7: Survey Research & Sampling* Flashcards

1
Q

Panel study or longitudinal design

A

administering survey questions to the same people at 2 or more points in time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Response set/bias

A

a pattern or tendency of responding to questions in a certain way rather than providing answers directly related to the questions e.g. social desirability, yea-saying, nay-saying, fence-sitting

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Social desirability or “faking good”

A

an individual answers in the most socially acceptable way or the way he/she thinks most people would respond

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

3 general types of content measured by survey questions

A

attitudes and beliefs, facts and demographics, behaviors

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What are some problems that can arise when writing questions?

A

unnecessary complexity, negative wording, double-barreled questions, loaded questions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Double-barreled questions

A

questions that ask two things at once, making any one answer ambiguous and hard to interpret

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Loaded questions

A

written in such a way as to try to bias people’s response toward a particular answer

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

“Yea-saying” (acquiescence) or “nay-saying” response sets

A

tendency for some survey respondents to agree (yea) or disagree (nay) with the vast majority of questions being asked regardless of question content

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Inattentive responding

A

responding to survey questions without reading the item content, providing answers that are not thoughtful

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What are the 2 main types of questions?

A

closed-ended and open-ended questions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Closed-ended questions

A

questions that offer respondents a limited number of response options e.g. multiple choice, T/F, Likert scale

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Open-ended questions

A

questions that allow respondents to answer in any way they like with no restrictions e.g. short/long essay

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Pros and cons of open-ended questions

A

Pros: freedom for participants to respond how they like, good ecological validity; Cons: tough to quantify and code

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Pros and cons of closed-ended questions

A

Pros: easy to implement, do stats on, compare results with other similar surveys, and restricts participant responses; Cons: restricts participant responses, designing questions can be tricky

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Rating scale

A

closed-ended response question that asks participants about degrees of judgement for a dimension e.g. amount of agreement, liking, or confidence

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Graphic rating scale

A

two words appear on either side of a solid line and participants place a mark on the line indicating their relative preference for one or the other word, which is measured in term of distance from one end

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Semantic differential scale

A

two words appear on either side of a series of dashed lines and participants place a mark on the dash indicating their relative preference for one or the other word

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

3 basic dimensions concepts are rated in using semantic differential scales

A

evaluation (e.g. good-bad), activity (e.g. slow-fast), potency (e.g. weak-strong)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Non-verbal scale

A

response options are in the form of images instead of words or numbers

20
Q

What are some solutions to response set/bias?

A

use reverse-worded questions, get rid of neutral alternatives

21
Q

What can you do about question order effects?

A

insert filler questions, counterbalance the questions

22
Q

What are the 2 main ways to administer surveys?

A

questionnaires and interviews

23
Q

Interviewer bias

A

intentional or unintentional influence on a respondent by an interviewer to encourage responses consistent with the interviewer’s expectations

24
Q

Focus group

A

qualitative method of data collection where 6 to 10 people are interviewed together about a particular topic

25
Population
group of people of interest to the researchers, from which a sample is typically drawn
26
Sample
subset of the population
27
Confidence interval
serves as a range of plausible values that are likely to be observed if the study were to be repeated; a quantification of our uncertainty around our estimates (wider CI = greater uncertainty)
28
Sampling error
the degree to which the estimate based on a sample deviates from the true population value
29
External validity
the degree to which study results based on a sample may be generalized to the population from which the sample was drawn or other populations
30
Sampling frame
the individuals or clusters of individuals in a population who may actually be selected for inclusion in the sample
31
Response rate
the percentage of people selected for a sample who actually complete a survey
32
What are the 2 basic techniques for sampling?
probability sampling and non-probability sampling
33
Probability sampling
participants are randomly drawn and each member of the population has a known and specific probability of being chosen; likely representative of population and high generalizability
34
Non-probability sampling
participants are not drawn at random and one cannot specify the probability that any member of a population will be included; easy and convenient but low generalizability
35
What are the types of probability sampling?
simple random sampling, stratified random sampling, and cluster sampling
36
Simple random sampling
each member of the population has an equal probability of being included in the sample
37
When is simple random sampling used?
when you have access to your entire population and have more or less equal representation of all groups contained in your population
38
Stratified random sampling
the population is divided into strata or subgroups followed by random sampling from each stratum to reflect their proportions in the population
39
When is stratified random sampling used?
when you have access to your entire population and you have unequal representation of all groups contained in your population
40
Cluster sampling
clusters of individuals are identified, sampled, then all individuals in each cluster are included in the sample
41
When is cluster sampling used?
when you don't have access to your entire population
42
What are the types of non-probability sampling/
convenience sampling, purposive sampling, quota sampling, snowball sampling
43
Convenience or haphazard sampling
recruiting participants whenever and wherever you can on the basis of availability and without regard for the representativeness of the sample
44
Purposive sampling
a type of convenience sampling procedure conducted to obtain only a sample of people who meet a predetermined criteria
44
Purposive sampling
a type of convenience sampling procedure conducted to obtain only a sample of people who meet a predetermined criteria
45
Quota sampling
the sample is chosen using convenience sampling to reflect the numerical composition of various subgroups in the population
46
Snowball sampling
asking participants to recommend others to participate and help researchers accumulate participants