Chapter 12

Question 1

Earliest use of surveys

Answer 1

Survey research may have its roots in English and American “social surveys” conducted around the turn of the 20th century by researchers and reformers who wanted to document the extent of social problems such as poverty (Converse, 1987)[1].

Question 2

Cognitive Model of responding to a survey:

Answer 2

Respondents must interpret the question, retrieve relevant information from memory, form a tentative judgment, convert the tentative judgment into one of the response options provided (e.g., a rating on a 1-to-7 scale), and finally edit their response as necessary.

Question 3

Context Effects:

Answer 3

Unintended influences on respondents’ answers because they are not related to the content of the item but to the context in which the item appears.

Question 4

Item-Order effect

Answer 4

For example, there is an item-order effect when the order in which the items are presented affects people’s responses. One item can change how participants interpret a later item or change the information that they retrieve to respond to later items.

Question 5

How to fight order effects:

Answer 5

To mitigate against order effects, rotate questions and response items when there is no natural order. Counterbalancing or randomizing the order of presentation of the questions in online surveys are good practices for survey questions and can reduce response order effects that show that among undecided voters, the first candidate listed in a ballot receives a 2.5% boost simply by virtue of being listed first[6]!

Question 6

Open-Ended questionnaire items:

Answer 6

Open-ended items simply ask a question and allow participants to answer in whatever way they choose.

Open-ended items are relatively easy to write because there are no response options to worry about. However, they take more time and effort on the part of participants, and they are more difficult for the researcher to analyze because the answers must be transcribed, coded, and submitted to some form of qualitative analysis, such as content analysis. Another disadvantage is that respondents are more likely to skip open-ended items because they take longer to answer. It is best to use open-ended questions when the answer is unsure or for quantities which can easily be converted to categories later in the analysis.

Question 7

Closed-ended questionnaire items

Answer 7

Closed-ended items ask a question and provide a set of response options for participants to choose from.

Question 8

What is a rating scale?

Answer 8

A rating scale is an ordered set of responses that participants must choose from.

Question 9

Likert Scale

Answer 9

In reading about psychological research, you are likely to encounter the term Likert scale. Although this term is sometimes used to refer to almost any rating scale (e.g., a 0-to-10 life satisfaction scale), it has a much more precise meaning.

In the 1930s, researcher Rensis Likert (pronounced LICK-ert) created a new approach for measuring people’s attitudes (Likert, 1932)[8]

Question 10

BRUSO

Answer 10

An acronym that stands for “brief,” “relevant,” “unambiguous,” “specific,” and “objective,” which is used to create effective questionnaire items that are brief and to the point.

Question 11

Double-barrelled questions

Answer 11

A common problem here is closed-ended items that are “double barrelled.” They ask about two conceptually separate issues but allow only one response. For example, “Please rate the extent to which you have been feeling anxious and depressed.” This item should probably be split into two separate items—one about anxiety and one about depression.

Question 12

How many response options should you allow?

Answer 12

For rating scales, five or seven response options generally allow about as much precision as respondents are capable of. However, numerical scales with more options can sometimes be appropriate

Question 13

Every survey should have a ____ or ___ introduction.

Answer 13

Written, Spoken.

Question 14

What are the two purposes of a survey introduction?

Answer 14

1. Encourage participants to participate in a survey.
2. Establish informed consent.

Question 15

What should come after a survey introduction?

Answer 15

-Instructions
-Most important questions
-Less important questions
-Least important questions

Question 16

What are the 2 categories of sampling?

Answer 16

Probability Sampling - This occurs when the researcher can specify the probability that each member of the population will be selected for the sample.

Non-Probability sampling - This occurs when the researcher cannot specify the probability that each member of the population will be selected for the sample.

Question 17

What is convenience sampling?

Answer 17

Convenience sampling—studying individuals who happen to be nearby and willing to participate—is a very common form of non-probability sampling used in psychological research.

Question 18

Other types of Non-probability sampling:

Answer 18

Other forms of non-probability sampling include snowball sampling (in which existing research participants help recruit additional participants for the study), quota sampling (in which subgroups in the sample are recruited to be proportional to those subgroups in the population), and self-selection sampling (in which individuals choose to take part in the research on their own accord, without being approached by the researcher directly).

Question 19

SAMPLING FRAME

Answer 19

Once the population has been specified, probability sampling requires a sampling frame. This sampling frame is essentially a list of all the members of the population from which to select the respondents. Sampling frames can come from a variety of sources, including telephone directories, lists of registered voters, and hospital or insurance records. In some cases, a map can serve as a sampling frame, allowing for the selection of cities, streets, or households.

Question 20

Simple Random Sampling

Answer 20

A probability sampling method in which each individual in the population has an equal probability of being selected for the sample.

Question 21

STRATIFIED Random Sampling

Answer 21

A common alternative to simple random sampling in which the population is divided into different subgroups or “strata” (usually based on demographic characteristics) and then a random sample is taken from each “stratum.”

Question 22

Proportionate Random Sampling

Answer 22

Is used to select a sample in which the proportion of respondents in each of various subgroups matches the proportion in the population.

Question 23

Disproportionate Stratified Random Sampling

Answer 23

Is used to sample extra respondents from particularly small subgroups—allowing valid conclusions to be drawn about those subgroups.

Question 24

Cluster Sampling

Answer 24

A type of probability sampling in which larger clusters of individuals are randomly sampled and then individuals within each cluster are randomly sampled. This is the only probability sampling method that does not require a sampling frame.

Question 25

How large does a survey sample need to be?

Answer 25

How large does a survey sample need to be? In general, this estimate depends on two factors. One is the level of confidence in the result that the researcher wants. The larger the sample, the closer any statistic based on that sample will tend to be to the corresponding value in the population. The other factor is a practical constraint in the form of the budget of the study. Larger samples provide greater confidence, but they take more time, effort, and money to obtain. Taking these two factors into account, most survey research uses sample sizes that range from about 100 to about 1,000. Conducting a power analysis prior to launching the survey helps to guide the researcher in making this trade-off.

Question 26

Sampling Bias

Answer 26

Occurs when a sample is selected in such a way that it is not representative of the entire population and therefore produces inaccurate results.

Question 27

Non-response bias

Answer 27

There is one form of sampling bias that even careful random sampling is subject to. It is almost never the case that everyone selected for the sample actually responds to the survey. Some may have died or moved away, and others may decline to participate because they are too busy, are not interested in the survey topic, or do not participate in surveys on principle. If these survey non-responders differ from survey responders in systematic ways, then this difference can produce non-response bias.

Question 28

How to reduce non-response bias

Answer 28

Although there are methods for statistically correcting for non-response bias, they are based on assumptions about the non-responders—for example, that they are more similar to late responders than to early responders—which may not be correct. For this reason, the best approach to minimizing non-response bias is to minimize the number of non-responders—that is, to maximize the response rate.

Question 29

offering an ___—especially cash—is a reliable way to ____ response rates. However, ethically, there are limits to offering_____ that may be so large as to be considered _____.

Answer 29

Incentive, increase, incentives, coercive

Question 30

Because of their low ____, and because ____ people are____ than ever before, internet surveys are likely to become the ____approach to survey data collection in the near future.

Answer 30

cost, more, online, dominant