Observations and Surveys (Pt.2)

Question 1

Open-ended questions

Answer 1

Allows respondents to say what they like, instead of choosing a response option (EX: What is helping you learn in this class? What is not working well for you in this class?)

Question 2

What are the Pros and Cons of open-ended questions

Answer 2

Pros: Provide researchers w/spontanous, rich information
Cons: Responses must be coded (time-consuming), need knowledge on appropriate coding techniques

Question 3

Forced-Choice Questions

Answer 3

Ask participants to choose the best of two (or more) options. Usually true/false or yes/no questions
(EX: I really like to be the center of attention, it makes me uncomfortable to be the center of attention, have you ever had a doctor make you feel unheard, etc.)

Question 4

Likert Scales

Answer 4

Series of statements w/a rating scale participants use to indicate their agreement (EX: please rate the following by how much you agree)

Question 5

Semantic Differential Format

Answer 5

Respondents rate a target using a numeric scale anchored w/ adjectives
(EX: Running is - then they’re given a scale of 1-5)

Question 6

Well-Worded Questions

Answer 6

How we word items can impact the way someone responds

Question 7

Leading questions or using “loaded” words

Answer 7

Wording leads people to pick one particular response over another (suggests a particular viewpoint), or simply using emotional terms

Question 8

Avoid double-barreled questions

Answer 8

Asking 2 or more questions in one sentence

Question 9

Avoid double negatives

Answer 9

When a question contains a double negative that leads to confusion

Question 10

Avoid making assumptions about the respondent

Answer 10

“What kind of vehicle do you own”

Question 11

Avoid non-inclusive reponse options

Answer 11

When the option you give participants don’t include all of the possibilities
(EX: How likely are you to get cancer in your lifetime - then given a very likely to very unlikely scale)

Question 12

Be specific and precise in your phrasing and wording

Answer 12

(EX: “Do you support Biden?” to “Do you support President Biden’s student loan forgiveness plan?”)

Question 13

Pretesting Questions

Answer 13

Run a pilot study to test items, calculate reliability estimates, ask participants for feedback, anything confusing or unclear

Question 14

Question order

Answer 14

Questions administered earlier can affect the way participants respond to subsequent questions (AKA order effects) - Want to avoid starting w/sensitive topics, make sure to measure “stable” traits at the end, and be sure to measure the most important things first

Question 15

Problems with self-report

Answer 15

People may not give completely accurate info because of many things: Minimizing memory errors, socially desirable responding, minimizing yea and nea saying, and fence-sitting

Question 16

Minimizing Memory Events

Answer 16

Experience Sampling methods (ESM) - Participants report what they are thinking, feeling, and doing at multiple points over time

Question 17

Socially Desirable Responding

Answer 17

When participants respond in a way that makes them look better than they really are - Minimizing this? Neutral questions (no right answers), Anonymous responding

Question 18

Minimizing yea and nea-sayin

Answer 18

Include an equal number of true/yes and false/no questions for the same issue. Keep survey short

Question 19

Fence-Sitting

Answer 19

Tendency to respond in the middle, such as “neither agree nor disagree” - Minimize this? No neutral response option, used forced-choice format, keep survey short