Survey Methods Flashcards

You may prefer our related Brainscape-certified flashcards:
1
Q

Descriptive Survey

A
  • Descriptive <> Describe %
  • Researcher seeks to determine what percentage of the population has a certain characteristic, holds a certain opinion, or engages in a particular behavior.
  • Do you approve of how president Bush is handling the war in Iraq?
  • Ex: What percent of the population…?
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Analytic Survey

A

•Analytic <> Associated Variables
•Researcher seeks to determine relevant variables and how they might be related.
•What factors are involved in the experience of depression.
Ex: What are the factors associated with …?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Two Types of Surveys

A
  1. Descriptive

2. Analytic

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Five Types of Survey Questions

A
  1. Yes-No Questions
  2. Forced Alternative Questions
  3. Multiple Choice Questions
  4. Likert-Type Scales
  5. Open-Ended Questions
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Yes-No Questions

A

Have only Yes or No answers

Ex: The thought of death seldom enters my mind? Yes or No

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Forced Alternative Questions

A

Only get two options at the polar extremes from each other and must choose one or the other.
Ex a: There are institutions in our society that have considerable control over me.
Ex b: Little in this world controls me. I usually do what I decide to do.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Locust of Control

A

Internal Locust: Whether or not we have control over things

External Locust: Whether things have control over me (Luck, outside influences).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Terror Management Theory

A

We are all aware on some level that we are going to die.
If you make one aware that you are dying you will become more racist.
Fear of dying -> in group focus. Don’t like people outside our group.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Multiple Choice Questions

A

Compared to the average student:
A. I give much more effort
B. I give an average amount of effort
C. I give less effort

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Likert-Type Scales

A

Usually 5, 7 points. A point value scale for characteristics.
Ex: I enjoy social gatherings to be with people:
1. Not at all Characteristic
2. …
3. …
4. …
5. Very Characteristic

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Open-Ended Questions

A

Not Yes or No questions
Ex 1: How would you summarize your chief problems in your own words?
Ex 2: Describe what you did today?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Mistakes to Avoid When Writing Survey Questions

A
  1. Avoid Leading Questions
  2. Avoid Social Desirability Bias
  3. Avoid Double-Barreled Questions
  4. Avoid Long Questions
  5. Avoid Negation
  6. Avoid Big Words
  7. Avoid Words That May Be Misinterpreted
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Avoid Leading Questions

A

A question that leads participant to the answer you want.

Ex: You disapprove of the biased, horrible way that television news covers the abortion issue, don’t you?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Avoid Social Desirability Bias

A

Socially correct answers.

Ex: Do you donate money to worthwhile causes?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Avoid Double-Barreled Questions

A

Asking two questions at once; two factors in same question.
Ex: How much do you agree with the following statement:
Colleges need to spend more time on students emotional AND physical development.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Avoid Long Questions

A

No more than 10 words.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Avoid Negation

A

Negative sentence format.
Ex 1: Do you NOT LIKE it when students DON’T STUDY?
Ex 2: Do you LIKE it when students STUDY?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Avoid Big Words

A

Keep questions at a fourth grade reading level.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Avoid Words That May Be Misinterpreted

A

Ex: Junk food: could have lots of different meanings to lots of different people.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Pretesting

A

Bring in, Look at Questions
Bring in participants, give them the questions, and ask to critique them
On target audience.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Order of Questions

A
1. Put personal questions last
So people will answer.
So you don't change how people answer. (stereotype threat)
2. Put demographic questions last
3. Keep similar questions together.
4. Be aware if response sets.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Response Sets

A

When survey participants do not answer questions truthfully.

1a: Acquiescence
1b: Nay-Saying
2a: Social Desirability
2b: Faking Bad
3a: Extremity
3b: Cop-Out
4a: Inconsistent
4b: Fabrication

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Acquiescence

A

Tendency to answer Yes or True

• Always Yes/True

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Nay-Saying

A

Tendency to answer No or False
•Always No/False

•Avoid by using Reverse Coding, changing wording on questions.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

Social Desirability

A

Tendency to present oneself in a socially acceptable light.

•Socially Acceptable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

Faking Bad

A

Tendency to present oneself in a socially unacceptable light.
•Socially Unacceptable
•”Betty Badass”

•Avoid by using: Lie Scale

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

Extremity

A

Tendency to select the extreme alternatives.

•Always Great/Aweful

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

Cop-Out

A

Tendency to select neutral answers.

•Always OK/Maybe

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

Inconsistent

A

Tendency to give careless answers, not read thoroughly.

•Don’t care

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

Fabrication

A

Tendency to make up answers to questions even when they are unaware of the issues involved.
•Make up answers

31
Q

Controlling for Response Sets

A
  1. Lie Scales

2. Negative Wording?Reverse Coding

32
Q

Lie Scales

A

Questions that are used to detect response sets and other dishonest responses.
•Used to avoid Faking Bad and social desirability

33
Q

Negative wording/Reverse Coding

A

The good answer is changed from all yes to now no answers.

•Used to avoid Nay-saying, Acquiescence, and Inconsistent responding.

34
Q

Formats of Surveys

A
  1. Mail Survey
  2. Personal Interview
  3. Telephone Survey
35
Q

Mail Surveys

A
Pros:
•Lots of people
Cons:
•Don't know who filed it out
•Low return rate
•Potential biased interpretation

Ex: Women and Love Survey
1/2-million surveys went out and 12,000 came back = >10%.

•Must Have 67% Response Rate
>50% responses - inadequate
50% responses - adequate
60% responses - good
70%< responses - very good
36
Q

Types of Personal Interviews

A
  1. Structured

2. Semi-Structured

37
Q

Structured Personal Interview

A

Standard list of questions in a standard order.

38
Q

Semi-Structured Personal Interview

A

Core standard of questions without a strict order.

Pros:
High response rates
Cons:
•Expensive
•Interviewer Bias
•Social Desirability Bias
39
Q

Telephone Interview

A
Pros:
•Reduced bias
•Not face-to-face
Cons:
•Expensive
•Interviewer Bias
•Social Desirability Bias
•Lack of Rapport (easy to hang up)
40
Q

Tests and Inventories

A

Assess a specific attribute, ability, or characteristic possessed by the individual being tested.

41
Q

Reliability

A

Consistency in measurement over time.

The extent to which the test is consistent in its evaluation of the same individual over repeated administrations.

42
Q

How Reliability is Assessed

A
  1. Test-Retest
  2. Parallel or Alternate Forms
  3. Internal-Consistency
    a: Split-Half
    b: Coefficient (Cronbachs) Alpha
43
Q

Test-Retest

A

1 group of people
1 test
2 time periods
•The HIGHER the reliability, the HIGHER the correlation coefficient.
•Higher correlational coefficient higher the reliability.
Ex: height over time

44
Q

Parallel or Alternative Forms

A

1 group of people
2 different tests that are parallel/equivalent
2 time periods
Ex: Midterm
Form A
Form B
Cons: Risk loosing participants at 2nd time period.

45
Q

Internal-Consisitency

A

1 group of people
1 test
1 time period
Correlate parts of the tests with each other.

46
Q

Internal-Consistency:

Split-Half

A

Divide test in halves and correlate the two halves in some way. High correlation.
Ex: Questions 1-20, correlate with Questions 21-40
or Evens and Odds

47
Q

Internal-Consistency:

Coefficient (Cronbachs) Alpha

A

Average correlation between every item and every other item on the test.
Ex: 40 item midterm
right = 1, wrong = 0
correlate 1-1, 1-2, 1-3, 1-4…
get one right you should get them all right.

Best test questions are where the top 25% of class get them right and the bottom 25% get them wrong.

48
Q

Validity

A

Are you measuring what you say you are measuring?

Reliability and validity are NOT the same thing.

49
Q

Types of Valitidy

A

(Like a Pyramid you have to build from the bottom up)

  1. Content Validity (bottom)
  2. Criterion Related Validity (middle)
  3. Construct Validity
50
Q

Content Validity (BOTTOM)

A

Does your measure include the universe of all of the relevant content of phenomenon that you want to measure
•Content that is on your survey, basics, items.

51
Q

Types of Content Validity

A

Must establish these two to get Content Validity:

  1. Face Validity
  2. Sampling Validity
52
Q

Content Validity

Face Validity

A

Does the measure look like its measuring what it’s supposed to?
Questions should be relevant to your subject.

53
Q

Content Validity

Sampling Validity

A

Get expert opinions on whether the whole range of the construct is captured by your measure. What is important and not to subject.

54
Q

Criterion Related Validity (MIDDLE)

A

How well does the test estimate present or future performance.

55
Q

Types of Criterion Related Validity

A
  1. Concurrent Validity

2. Predictive Validity

56
Q

Criterion Related Validity

Concurrent Validity

A

Concurrent: At the same time.
Do scores on the test correlate with other measures of the construct.
Do multiple sources of information agree?

57
Q

Criterion Related Validity

Predictive Validity

A

Does your instrument predict future performance for the construct accurately?

58
Q

Construct Validity (TOP)

A

How well does the instrument measure the theoretical construct it was designed to reflect?

59
Q

Types of Construct Validity

A
  1. Convergent Validity

2. Divergent Validity

60
Q

Construct Validity

Convergent Validity

A

Converge: Come (funneled) together.
Concurrent and predictive come together. The extent to which a measure correlates to all existing measures related to the same construct.

61
Q

Construct Validity

Divergent/discriminant Validity

A

Divergent: To separate.

The extent to which a measure does not correlate with measures of a different construct.

62
Q

Can be Reliable but not be Valid

A

Can’t be Valid without being Reliable

63
Q

Types of Tests and Inventories

A
  1. Achievement Tests
  2. Aptitude Tests
  3. Personality Tests
  4. Objective Tests
64
Q

Achievement Test

A

Evaluates an individual’s level of mastery or competency.
•Level of Mastery
Ex: Midterm Exam

65
Q

Aptitude Tests

A

Assess an individual ability or skill in a particular situation or job.
•Potential ability or skill
Ex: ASVAB, IQ, LSAT

66
Q

Personality Tests

A

Measures a specific aspect of an individual’s personality.

67
Q

Personality Tests

Objective Tests

A

Someone’s personality is assessed by the answers they give on standardized questions.
Ex: NEO-PI Personality Inventory

68
Q

The Big Five

A

Uncorrelated, can have every single one in a section and low in another section.
•People don’t change. They are who they are, you are who you are.
NEOAC = OCEAN

69
Q

The Big Five: N

Neuroticism

A

tendency to experience unpleasant emotions. More likely to be anxious, angry, depressed, self-conscious. Challenging type of people.
Ex: ask how their day was at different times and their is still a long chaotic list of negatives.
Neurotism |——| Emotional Stability

70
Q

The Big Five: E

Extroversion

A

Tendency to seek stimulation and to enjoy the company of others. If you are pumped up by the more people you are around you are extrovert, if you thrive on being alone you are introvert.
Ex: Facebook: pictures and friends have lots.

71
Q

The Big Five: A

Agreeableness

A

Tendency to be compassionate toward others.

72
Q

The Big Five: C

Conscientiousness

A

Perfectionists

73
Q

The Big Five: D

Openness to Experience

A

Tendency to enjoy new things.

74
Q

Personality Inventories

A

Projective Tests: Tell me what you see?

  1. Rorschach Inkblots
  2. Thematic Apperception Test
  3. Implicit Personality Test