3.2: Surveys

Question 1

Surveys

Answer 1

A method of gathering information from participants via self-report.

Question 2

What are 3 ways to present a survey?

Answer 2

1. Online
2. In Person Questionnaire
3. Interview

Question 3

What is an online survey in response to?

Answer 3

A choice someone makes

Question 4

What is an in person questionnaire and interview in response to?

Answer 4

A choice or an event

Question 5

What is an example of a survey that can be conducted everyday outside of a lab?

Answer 5

Ecological Momentary Assessment

Question 6

Ecological Momentary Assessment

Answer 6

A research method that involves collecting data from individuals in their natural environment, when they perform the behavior being studied.

Question 7

What is survey data collected critical for?

Answer 7

Making frequency claims that establish their associations

Question 8

Construct Validity

Answer 8

How well the variables in a study measure what they are intended to measure.

Question 9

What does a survey depend on to have high construct validity?

Answer 9

A good match of the type of information needed with the possibility of self report in the population.

Question 10

What is crucial for the construct validity?

Answer 10

How the questions in a survey are structured and worded

Question 11

What 4 situations should you not use a survey in?

Answer 11

1. The precise analysis of a behavior
2. Confidence/precise details for memories or events.
3. Finding what may influence the participants behavior
4. When self reports are not possible for a population (infants)

Question 12

Q: In which of the following studies is self-report the best data collection option?

A: A study examining the health of children born via natural childbirth.

B: A study examining the intensity of pain during natural childbirth.

C: A study examining discussions about natural childbirth between mothers and doctors.

D: A study examining the breathing styles used during childbirth.

Answer 12

B
- Pain is a subjective measure and only the person experiencing it can accurately describe it.

Question 13

Open Ended Questions

Answer 13

Allow the participant to fill in the response in any way they would like.

Question 14

What do open ended questions provide?

Answer 14

Rich data

Question 15

What is a con of open ended questions?

Answer 15

Hard to code

Question 16

What 3 situations should you use open ended questions with?

Answer 16

1. Sensitive topics
2. Wanting to explore how people express themselves
3. Early stage research

Question 17

Forced Choice

Answer 17

Questions that give a limited set of options and the participants must choose one.

Question 18

What do forced choice questions provide?

Answer 18

A few possible categories of responses

Question 19

What is easier of forced choice compared to open ended questions?

Answer 19

Coding
- Put choices into data matrix

Question 20

What are 2 examples of forced choice questions?

Answer 20

1. Likert Type
2. Semantic Differential

Question 21

Likert Type

Answer 21

To what extent a statement is a characteristic of you

Question 22

Semantic Differential

Answer 22

More open-ended rating on numeric scale based with bipolar adjectives

(one end is one extreme, the other end is the opposite extreme)

Question 23

What do open ended questions lean on?

Answer 23

What tends to be recalled easier

Question 24

Leading Questions

Answer 24

Elicit bias by using non-neutral words in framing question

Question 25

Double Barreled Questions

Answer 25

Ask you two or more questions within one question.

Question 26

What is a flaw of Negatively Worded Questions

Answer 26

Often hard to interpret, especially on likert scale.

Question 27

What are 4 steps to writing a god survey questions?

Answer 27

1. Choose a question structure. thoughtfully. - Structure -Open ended 2. Avoid issues in wording of the question - Phrases with bias - Leading questions - Double Barrled - Negatively worded 3. Use a previously tried questionnaire to get started 4. If making a new one, always pilot test to understand the impact of these factors.

Question 28

What are the two types of question structures?

Answer 28

- Open ended - Structured/close ended

Question 29

What should you consider to improve the validity of self report data?

Answer 29

Participants perspective - Shortcuts - Biases -Social desirability

Question 30

Response Sets

Answer 30

When participants give consistent responses across questions to save time, rather than accurately answering each question.

Question 31

What are the 3 types of response sets?

Answer 31

1. Acquiescence Bias 2. Fence Sitting 3. Social Desirability

Question 32

Acquiescence Bias

Answer 32

Participants respond by saying “yes” or “strongly agree” to all questions.

Question 33

How do you avoid acquiescence bias?

Answer 33

Include reverse wording

Question 34

Reverse Wording

Answer 34

Changing to the opposing side of an idea being questioned.

Question 35

Fence Sitting

Answer 35

When participants are hesitant to choose extreme answers and always opt for neutral responses.

Question 36

How do you avoid fence sitting?

Answer 36

removing the neutral response option

Question 37

Social Desirability

Answer 37

Participants may respond in a way they think is socially desirable.

Question 38

How do you avoid desirability in a survey?

Answer 38

Including survey questions to measure someone’s level of social desirability can help.

Question 39

Q: Why are response sets in surveys a potential problem? A: They may reflect social desirability biases. B: We are only measuring someone’s subjective opinions. C: We can’t differentiate someone that supports everything verses someone taking a shortcut. D: People may not know the correct answer to what we are asking.

Answer 39

C

Question 40

Q: Dr. Waters is designing a questionnaire to assess attitudes towards science. They plan to measure attitudes towards science with a self-report questionnaire, but they are concerned about fence sitting response sets. Which of the following might you recommend decreasing fence sitting? A: Using scales with an even number of response options. B: Remove question framing to avoid leading questions. C: Providing a “no opinion” option D: Using reverse-worded questions

Answer 40

A