Ch6 Flashcards
Data for frequency claims come from
- surveys and polls
- behavioral observations
Surveys/polls
method of asking people questions face to face, on the phone, on written questionnaires, or online
Three main subcategories in the construct validity of surveys/polls:
- Choosing question formats
- Writing well-worded questions
- Encouraging accurate responses
Formats of survey questions:
- Open-ended questions
- Forced-choice format
- Likert scale
- Semantic differential format
Open-ended questions, pros and cons
- answer however
Pros: Provides rich info
Cons: processing coding+ categorizing responses is labor intensive
Forced-choice format (define + example)
- choosing best of two or more options
ex:
- political polls- which candidate
- yes or no: abortion
- which of these two statements describes you?
Likert Scale
- given a statement, choose degree to which it is true
- format: Strongly agree, agree, neither agree nor disagree, disagree, and strongly disagree
- if it deviates, its a likert-type scale
ex: easy 12345 hard
Semantic differential format (define + example)
- rates using numerical scale anchored by adjectives
Ex:
- show up and pass 1 2 3 4 5 hardest thing I’ve ever done
- Five-star internet rating systems- one star = poor, 5 = outstanding
types of wording to avoid to create well-worded questions
- Leading questions
- Double-barreled questions
- Negatively worded questions
Leading question (define + ex)
- wording leads to a particular response
- Questions should be worded as neutrally as possible
Ex: how fast was the car going when it hit/smashed into the other car, smashed leads to higher speed estimate
double-barreled question (define + problem + ex)
- two questions in one
- problem: poor construct validity, can’t tell what construct is being measured OR what the answer is referring to
Ex: do you agree that the 2nd amendment guarantees the right to own a gun and that the 2nd amendment is as important as your other constitutional rights?
negatively worded questions
- makes q unnecessarily complicated, more confusion/ difficult to answer using double negatives
Ex: does it seem possible or does it seem impossible to you that the Nazi extermination of the Jews never happened?
how can you control for negatively worded questions?
- asking q’s two ways
- abortion should never be restricted (disagree=1, agree = 5)
- I favor strong restrictions on abortion (disagree=1, agree = 5)
- Then look at the internal consistency between the items using cronbach’s alpha
question order
- the order questions are asked in can affect responses to a survey
- Earlier q can change the meaning of later q’s
ex:
- “how often do your children play?” different if put after question about music lessons
- affirmative action for women, minorities- if asked about women first, white people more likely to support for minorities
how to control for question order?
- by having different versions of sequencing for the survey
- report both results separately
when is self report especially important/useful?
- Very useful to report own gender identity, ethnicity, etc.
- Sometimes the only option- content of dreams
types of shortcuts
- Response sets
- Acquiescence
- Fence-sitting
Response sets/ nondifferentiation (define, prevalent when?)
- a shortcut in which someone responds the same way to all questions
- most prevalent in long questionnaires
- Weaken construct validity by not giving truthful answers