Chapter 6: Describing What People Do: Surveys, Observations and Sampling Flashcards
What are some ways survey and poll questions are done?
- phone, personal interviews, paper and pencil questionnaire or over the net.
Open ended questions?
L> advantages/disadvantages
- questions that allow respondents to answer in any way they see fit
L> provides spontaneous, rich info
L> downside: coding and categorizing responses is time consuming and difficult.
Forced choice format?
L>ex?
people give their opinion by picking the best of two or more options.
L> could also be asked their opinion on current issues or their preference between two options
ex: Narcissistic Personality Inventory
Likert Scale?
L>ex?
- people are presented with a statement and are asked to use a rating scale to indicate their degree of agreement.
- anchored by the terms: strongly agree, agree, neither, disagree, strongly disagree.
- ex? This app.
What is a scale called that does not fully follow the format of a Likert scale?
- Likert-type scale
L> ex:
1 2 3 4 5
Strongly Strongly
Disagree Agree
Semantic Differential Format?
- ppl are asked to rate a target object using a numeric scale that is anchored with adjectives.
ex: rate my prof dot com.
Easiness:
easy 1 2 3 4 5 hard
Do researchers ever combine formats for a single survey?
yes
Which is more important: the way a question is worded or the oder of the survey questions or the format of survey questions?
- the way questions are worded and ordered are equally important
- the type of format is not as important as the above.
Leading questions?
L> solution?
- questions that kind of suggest the desired response
L> word questions as neutrally as possible
How do researchers measure the extent of question wording’s influence on results?
- phrase questions more than one way
Double barrelled questions?
L> good construct validity?yes, no?
- asking two questions in one
L> they have poor construct validity…..bc ppl might be responding to the first half or the second half or both parts of the question.
Double negatives?
- these are cognitively difficult for people to respond to…causing confusion and therefore reducing construct validity.
- two negatives in a sentence
L> impossible and never for ex - when possible these should be avoided.
Solution to double negatives?
- ask them as two separate questions
- then use Cronbachs alpha to see where people respond similarly to both questions. (internal consistency)
What is the most direct way to control for order effects?
- prepare different versions of a survey, with questions in different orders.
- if results for the first order differ from the results of the second….one can report the results for the two separately….also they may be safe in assuming ppls endorsement of the first question on a survey is unaffected by the previous question
Response sets?
- type of shortcut respondents can take when answering a survey…..
L> when answering a set of related questions people may adopt a consistent way of answering all of them that has little to do with their sincere opinions. - answering positive, negative or in between for all.
L> hurting construct validity.
Acquiescence? ( response set)
- Yea saying - people say yes or strongly agree to every item
- Nay saying - people say no or strongly disagree to every item.
- survey measures the construct of peoples laziness or agreeableness..not opinions… (hurts construct v)
Solution to Acquiescence?
- reverse worded items.
L> slows people down so they think more about the questions - can help us distinguish the yea sayers from true believers.
ex: strongly agree becomes five and strongly disagree becomes 1 ….people that usually circle five will end up scoring closer to the middle of the scale.
original: 1 2 3 4 5 6 7
** increases construct validity
draw back of reverse worded items?
- sometimes they are more difficult to answer because they might contain double negs
Fence sitting??(response set)
- when a survey asks controversial questions some people play it safe and answer in the middle of the scale.
L> or if the q is confusing or unclear. - these people end up seeming like they don’t have an opinion when they really do!