Survey Methods Flashcards

1
Q

Descriptive Survey

A
  • Descriptive <> Describe %
  • Researcher seeks to determine what percentage of the population has a certain characteristic, holds a certain opinion, or engages in a particular behavior.
  • Do you approve of how president Bush is handling the war in Iraq?
  • Ex: What percent of the population…?
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Analytic Survey

A

•Analytic <> Associated Variables
•Researcher seeks to determine relevant variables and how they might be related.
•What factors are involved in the experience of depression.
Ex: What are the factors associated with …?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Two Types of Surveys

A
  1. Descriptive

2. Analytic

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Five Types of Survey Questions

A
  1. Yes-No Questions
  2. Forced Alternative Questions
  3. Multiple Choice Questions
  4. Likert-Type Scales
  5. Open-Ended Questions
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Yes-No Questions

A

Have only Yes or No answers

Ex: The thought of death seldom enters my mind? Yes or No

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Forced Alternative Questions

A

Only get two options at the polar extremes from each other and must choose one or the other.
Ex a: There are institutions in our society that have considerable control over me.
Ex b: Little in this world controls me. I usually do what I decide to do.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Locust of Control

A

Internal Locust: Whether or not we have control over things

External Locust: Whether things have control over me (Luck, outside influences).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Terror Management Theory

A

We are all aware on some level that we are going to die.
If you make one aware that you are dying you will become more racist.
Fear of dying -> in group focus. Don’t like people outside our group.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Multiple Choice Questions

A

Compared to the average student:
A. I give much more effort
B. I give an average amount of effort
C. I give less effort

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Likert-Type Scales

A

Usually 5, 7 points. A point value scale for characteristics.
Ex: I enjoy social gatherings to be with people:
1. Not at all Characteristic
2. …
3. …
4. …
5. Very Characteristic

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Open-Ended Questions

A

Not Yes or No questions
Ex 1: How would you summarize your chief problems in your own words?
Ex 2: Describe what you did today?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Mistakes to Avoid When Writing Survey Questions

A
  1. Avoid Leading Questions
  2. Avoid Social Desirability Bias
  3. Avoid Double-Barreled Questions
  4. Avoid Long Questions
  5. Avoid Negation
  6. Avoid Big Words
  7. Avoid Words That May Be Misinterpreted
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Avoid Leading Questions

A

A question that leads participant to the answer you want.

Ex: You disapprove of the biased, horrible way that television news covers the abortion issue, don’t you?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Avoid Social Desirability Bias

A

Socially correct answers.

Ex: Do you donate money to worthwhile causes?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Avoid Double-Barreled Questions

A

Asking two questions at once; two factors in same question.
Ex: How much do you agree with the following statement:
Colleges need to spend more time on students emotional AND physical development.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Avoid Long Questions

A

No more than 10 words.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Avoid Negation

A

Negative sentence format.
Ex 1: Do you NOT LIKE it when students DON’T STUDY?
Ex 2: Do you LIKE it when students STUDY?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Avoid Big Words

A

Keep questions at a fourth grade reading level.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Avoid Words That May Be Misinterpreted

A

Ex: Junk food: could have lots of different meanings to lots of different people.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Pretesting

A

Bring in, Look at Questions
Bring in participants, give them the questions, and ask to critique them
On target audience.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Order of Questions

A
1. Put personal questions last
So people will answer.
So you don't change how people answer. (stereotype threat)
2. Put demographic questions last
3. Keep similar questions together.
4. Be aware if response sets.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Response Sets

A

When survey participants do not answer questions truthfully.

1a: Acquiescence
1b: Nay-Saying
2a: Social Desirability
2b: Faking Bad
3a: Extremity
3b: Cop-Out
4a: Inconsistent
4b: Fabrication

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Acquiescence

A

Tendency to answer Yes or True

• Always Yes/True

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Nay-Saying

A

Tendency to answer No or False
•Always No/False

•Avoid by using Reverse Coding, changing wording on questions.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Social Desirability
Tendency to present oneself in a socially acceptable light. | •Socially Acceptable
26
Faking Bad
Tendency to present oneself in a socially unacceptable light. •Socially Unacceptable •"Betty Badass" •Avoid by using: Lie Scale
27
Extremity
Tendency to select the extreme alternatives. | •Always Great/Aweful
28
Cop-Out
Tendency to select neutral answers. | •Always OK/Maybe
29
Inconsistent
Tendency to give careless answers, not read thoroughly. | •Don't care
30
Fabrication
Tendency to make up answers to questions even when they are unaware of the issues involved. •Make up answers
31
Controlling for Response Sets
1. Lie Scales | 2. Negative Wording?Reverse Coding
32
Lie Scales
Questions that are used to detect response sets and other dishonest responses. •Used to avoid Faking Bad and social desirability
33
Negative wording/Reverse Coding
The good answer is changed from all yes to now no answers. | •Used to avoid Nay-saying, Acquiescence, and Inconsistent responding.
34
Formats of Surveys
1. Mail Survey 2. Personal Interview 3. Telephone Survey
35
Mail Surveys
``` Pros: •Lots of people Cons: •Don't know who filed it out •Low return rate •Potential biased interpretation ``` Ex: Women and Love Survey 1/2-million surveys went out and 12,000 came back = >10%. ``` •Must Have 67% Response Rate >50% responses - inadequate 50% responses - adequate 60% responses - good 70%< responses - very good ```
36
Types of Personal Interviews
1. Structured | 2. Semi-Structured
37
Structured Personal Interview
Standard list of questions in a standard order.
38
Semi-Structured Personal Interview
Core standard of questions without a strict order. ``` Pros: High response rates Cons: •Expensive •Interviewer Bias •Social Desirability Bias ```
39
Telephone Interview
``` Pros: •Reduced bias •Not face-to-face Cons: •Expensive •Interviewer Bias •Social Desirability Bias •Lack of Rapport (easy to hang up) ```
40
Tests and Inventories
Assess a specific attribute, ability, or characteristic possessed by the individual being tested.
41
Reliability
Consistency in measurement over time. | The extent to which the test is consistent in its evaluation of the same individual over repeated administrations.
42
How Reliability is Assessed
1. Test-Retest 2. Parallel or Alternate Forms 3. Internal-Consistency a: Split-Half b: Coefficient (Cronbachs) Alpha
43
Test-Retest
1 group of people 1 test 2 time periods •The HIGHER the reliability, the HIGHER the correlation coefficient. •Higher correlational coefficient higher the reliability. Ex: height over time
44
Parallel or Alternative Forms
1 group of people 2 different tests that are parallel/equivalent 2 time periods Ex: Midterm Form A Form B Cons: Risk loosing participants at 2nd time period.
45
Internal-Consisitency
1 group of people 1 test 1 time period Correlate parts of the tests with each other.
46
Internal-Consistency: | Split-Half
Divide test in halves and correlate the two halves in some way. High correlation. Ex: Questions 1-20, correlate with Questions 21-40 or Evens and Odds
47
Internal-Consistency: | Coefficient (Cronbachs) Alpha
Average correlation between every item and every other item on the test. Ex: 40 item midterm right = 1, wrong = 0 correlate 1-1, 1-2, 1-3, 1-4... get one right you should get them all right. Best test questions are where the top 25% of class get them right and the bottom 25% get them wrong.
48
Validity
Are you measuring what you say you are measuring? Reliability and validity are NOT the same thing.
49
Types of Valitidy
(Like a Pyramid you have to build from the bottom up) 1. Content Validity (bottom) 2. Criterion Related Validity (middle) 3. Construct Validity
50
Content Validity (BOTTOM)
Does your measure include the universe of all of the relevant content of phenomenon that you want to measure •Content that is on your survey, basics, items.
51
Types of Content Validity
Must establish these two to get Content Validity: 1. Face Validity 2. Sampling Validity
52
Content Validity | Face Validity
Does the measure look like its measuring what it's supposed to? Questions should be relevant to your subject.
53
Content Validity | Sampling Validity
Get expert opinions on whether the whole range of the construct is captured by your measure. What is important and not to subject.
54
Criterion Related Validity (MIDDLE)
How well does the test estimate present or future performance.
55
Types of Criterion Related Validity
1. Concurrent Validity | 2. Predictive Validity
56
Criterion Related Validity | Concurrent Validity
Concurrent: At the same time. Do scores on the test correlate with other measures of the construct. Do multiple sources of information agree?
57
Criterion Related Validity | Predictive Validity
Does your instrument predict future performance for the construct accurately?
58
Construct Validity (TOP)
How well does the instrument measure the theoretical construct it was designed to reflect?
59
Types of Construct Validity
1. Convergent Validity | 2. Divergent Validity
60
Construct Validity | Convergent Validity
Converge: Come (funneled) together. Concurrent and predictive come together. The extent to which a measure correlates to all existing measures related to the same construct.
61
Construct Validity | Divergent/discriminant Validity
Divergent: To separate. | The extent to which a measure does not correlate with measures of a different construct.
62
Can be Reliable but not be Valid
Can't be Valid without being Reliable
63
Types of Tests and Inventories
1. Achievement Tests 2. Aptitude Tests 3. Personality Tests 4. Objective Tests
64
Achievement Test
Evaluates an individual's level of mastery or competency. •Level of Mastery Ex: Midterm Exam
65
Aptitude Tests
Assess an individual ability or skill in a particular situation or job. •Potential ability or skill Ex: ASVAB, IQ, LSAT
66
Personality Tests
Measures a specific aspect of an individual's personality.
67
Personality Tests | Objective Tests
Someone's personality is assessed by the answers they give on standardized questions. Ex: NEO-PI Personality Inventory
68
The Big Five
Uncorrelated, can have every single one in a section and low in another section. •People don't change. They are who they are, you are who you are. NEOAC = OCEAN
69
The Big Five: N | Neuroticism
tendency to experience unpleasant emotions. More likely to be anxious, angry, depressed, self-conscious. Challenging type of people. Ex: ask how their day was at different times and their is still a long chaotic list of negatives. Neurotism |------| Emotional Stability
70
The Big Five: E | Extroversion
Tendency to seek stimulation and to enjoy the company of others. If you are pumped up by the more people you are around you are extrovert, if you thrive on being alone you are introvert. Ex: Facebook: pictures and friends have lots.
71
The Big Five: A | Agreeableness
Tendency to be compassionate toward others.
72
The Big Five: C | Conscientiousness
Perfectionists
73
The Big Five: D | Openness to Experience
Tendency to enjoy new things.
74
Personality Inventories
Projective Tests: Tell me what you see? 1. Rorschach Inkblots 2. Thematic Apperception Test 3. Implicit Personality Test