Ch6 Flashcards

You may prefer our related Brainscape-certified flashcards:
1
Q

Data for frequency claims come from

A
  • surveys and polls

- behavioral observations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Surveys/polls

A

method of asking people questions face to face, on the phone, on written questionnaires, or online

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Three main subcategories in the construct validity of surveys/polls:

A
  • Choosing question formats
  • Writing well-worded questions
  • Encouraging accurate responses
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Formats of survey questions:

A
  • Open-ended questions
  • Forced-choice format
  • Likert scale
  • Semantic differential format
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Open-ended questions, pros and cons

A
  • answer however

Pros: Provides rich info

Cons: processing coding+ categorizing responses is labor intensive

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Forced-choice format (define + example)

A
  • choosing best of two or more options

ex:
- political polls- which candidate
- yes or no: abortion
- which of these two statements describes you?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Likert Scale

A
  • given a statement, choose degree to which it is true
  • format: Strongly agree, agree, neither agree nor disagree, disagree, and strongly disagree
  • if it deviates, its a likert-type scale
    ex: easy 12345 hard
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Semantic differential format (define + example)

A
  • rates using numerical scale anchored by adjectives

Ex:

  • show up and pass 1 2 3 4 5 hardest thing I’ve ever done
  • Five-star internet rating systems- one star = poor, 5 = outstanding
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

types of wording to avoid to create well-worded questions

A
  • Leading questions
  • Double-barreled questions
  • Negatively worded questions
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Leading question (define + ex)

A
  • wording leads to a particular response
  • Questions should be worded as neutrally as possible

Ex: how fast was the car going when it hit/smashed into the other car, smashed leads to higher speed estimate

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

double-barreled question (define + problem + ex)

A
  • two questions in one
  • problem: poor construct validity, can’t tell what construct is being measured OR what the answer is referring to

Ex: do you agree that the 2nd amendment guarantees the right to own a gun and that the 2nd amendment is as important as your other constitutional rights?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

negatively worded questions

A
  • makes q unnecessarily complicated, more confusion/ difficult to answer using double negatives

Ex: does it seem possible or does it seem impossible to you that the Nazi extermination of the Jews never happened?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

how can you control for negatively worded questions?

A
  • asking q’s two ways
    • abortion should never be restricted (disagree=1, agree = 5)
    • I favor strong restrictions on abortion (disagree=1, agree = 5)
  • Then look at the internal consistency between the items using cronbach’s alpha
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

question order

A
  • the order questions are asked in can affect responses to a survey
  • Earlier q can change the meaning of later q’s

ex:
- “how often do your children play?” different if put after question about music lessons

  • affirmative action for women, minorities- if asked about women first, white people more likely to support for minorities
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

how to control for question order?

A
  • by having different versions of sequencing for the survey

- report both results separately

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

when is self report especially important/useful?

A
  • Very useful to report own gender identity, ethnicity, etc.

- Sometimes the only option- content of dreams

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

types of shortcuts

A
  • Response sets
  • Acquiescence
  • Fence-sitting
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Response sets/ nondifferentiation (define, prevalent when?)

A
  • a shortcut in which someone responds the same way to all questions
  • most prevalent in long questionnaires
  • Weaken construct validity by not giving truthful answers
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Acquiescence/ yeasaying

A
  • type of response set in which someone responds “yes” or “strongly agree” to all q’s - common bias
  • Threatens construct validity- measuring tendency to agree or not thinking carefully instead of construct
20
Q

how to control for acquiescence (+ drawback)

A
  • use reverse-worded items
  • Slows people down to answer more carefully
  • Drawback- sometimes creates negatively worded items
  • Must rescore before computing average- switch 1 and 5
21
Q

Fence sitting

A
  • type of response set- giving all neutral answers

- Can weaken construct validity by suggesting more people have no opinion

22
Q

how to control for fence-sitting

A
  • Control by removing middle, neutral option
    • Sometimes people really do have no opinion though
  • Control by using forced-choice questions- choose one of two answers
23
Q

Trying to look good

A
  • Socially desirable responding/ faking good

- Faking bad

24
Q

Socially desirable responding/ faking good + faking bad

A
  • giving answers that make you look better
    • Embarrassed, shy, hiding unpopular opinion
  • Faking bad is less common, same idea but reversed
25
Q

how to control for faking good/bad ( 3 ways, + ex)

A

1) Control by reminding participants of anonymity

  • This can cause less serious, less careful answers
    - more likely to use response sets

2) Control by including items that identify socially desirable responding
- Ex: I don’t find it particularly difficult to get along with loud-mouthed, obnoxious people

3) Can also control by asking people’s friends to rate them

26
Q

how do you test for implicit biases

A

Implicit associations test- quickly attach positive or negative words to right or left key along with black or white faces

  • if people respond more white/positive and black/negative, researchers can assume participant has a bias
27
Q

Self-reports can be especially inaccurate when

A
  • asking why someone answers/acts the way they do
    • Ex: 6 pairs of stockings, most women chose the far right pair.
      Researchers asked why, they said they were better quality, even
      when asked if it was because of the placement. All stockings
      where the same
  • Self reporting memories of events- people’s memories are not very accurate
  • rating products - people rated products based off cost and prestige of brand
28
Q

ex of memory of events innacuracy

A

Ex: researchers administer short questionnaire to students day after dramatic event asking who they were with, where they were, etc

  • A few years later, given same questionnaire, + how confident are they in their memory of it
  • Overall accuracy is very low, doesn’t matter how confident people were in their answers
29
Q

Observational research

A
  • researcher watches people or animals and systematically records what they are doing
  • Another type of data (in addition to self-report) that can be used to support frequency claims
30
Q

Observing how much people talk- study

A

Mattias Mehl developed an electronically activated recorder (EAR) for observing what people say in everyday conversations

  • Has a microphone and digital recording device
  • Every 12.5 minutes, records for 30 sec., which is later transcribed
    • Example of experience sampling
  • result: Women didn’t use significantly more words than men
31
Q

experience sampling

A

people’s behaviors are reported throughout the day

- ex: observing how much people talk study

32
Q

Observing hockey moms and dads

A
  • Observed hockey games and recorded violent, negative behavior along with positive/supportive behavior by parents
  • 64% comments were positive, 4% negative
33
Q

Observing families in the evening

A

Study of families where both parents work- camera crew follow both parents (30 families) from the time they got home till 8

behaviors were coded from the tapes-

  • emotional tone (results: slightly positive)
  • Food-related conversation- (kids- distaste, parents - health)
34
Q

what should you ask of observational measures?

A
  • what is the variable of interest?

- did the observations accurately measure that variable?

35
Q

Construct validity of observations can be compromised by:

A
  • Observer bias
  • observer effects
  • Reactivity
36
Q

Observer Bias:

A
  • observer sees what they expect to see

Ex: therapists shown video of man talking to professor about feelings and work experiences- some told he was a patient, others job applicant
- Those told he was applicant used terms like attractive, candid, innovative, vs those thought he was a patient saw him as “tight, defensive”

37
Q

how to control for observer bias

A

keeping observer unaware of study’s hypothesis/ exact research q

38
Q

Observer effects (experimenter bias, expectancy effects)

A

Observers inadvertently change the behavior of those they’re observing

Ex: Bright and Dull rats- Those believed to be bright went through the maze faster and made fewer mistakes

ex: clever hans- He was reading the cues of the questioners

39
Q

Preventing Observer Bias and Observer Effects

A
  • Careful researchers train observers well

- Develop clear rating instructions - often called codebooks

40
Q

Codebooks

A

precise statements of how the variables are operationalized

  • The clearer the codebook statements, the more valid the
    operationalization
41
Q

how to test construct validity of coded measure

A

Assesses interrater reliability- multiple observers

  • If interrater reliability is low,
    - coders need to be retrained
    - or a clearer coding system for behaviors may need to be
    developed
    - or both
42
Q

correlation that quantifies interrater agreement

A

ICC

43
Q

Masked Design (Blind Design)

A

observers don’t know the purpose of the study or the conditions participants have been assigned to

44
Q

Reactivity

A

Change in behavior when study participants know someone is watching

45
Q

3 solutions to reactivity

A

1) blend in: make yourself less noticeable
- Unobtrusive observations
- ex: one-way mirror, act as casual onlooker

2) wait it out: allow research participants to get used to your presence by visiting many times until they are comfortable acting normal
- ex: jane goodall + chimps

3) Measure the behavior’s results: instead of observing behavior directly, measure the traces of a behavior
- Unobtrusive data
- ex: alcohol consumption via # bottles

46
Q

when is ok to use secretive observing methods like one-way mirrors?

A
  • Usually must obtain permission in advance to watch or record people’s private behavior
  • Always has to go through some sort of IRB process
  • If hidden video recording is used, it must be explained in the debrief