Survey Design Flashcards

1
Q

What 6 components do we need to consider when designing surveys?

A

1) Instructions (to standardise and increase reliability)

2) Order of the questions

3) Demographics (characteristics of our sample)

4) Open vs Closed questions

5) Writing/formulating the questions

6) Avoiding response bias

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What are the criteria for good survey instruction?

A
  • Standardised (the same instructions given to all Ps)
  • Clear and direct
  • Avoid jargon and complex/technical terms
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

How do we order the survey questions?
List 4 things we could do.

A
  • Divide a survey into sections (e.g. by topic or question type)
  • Ensure Ps are eligible (screening)
  • Start with easy and engaging questions
  • Use funnelling/branching questions if appropriate
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are survey demographics?

A

The characteristics of the sample that is participating in the survey

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What could be included in the survey to obtain information on sample demographics? List 8 examples

A
  • D.O.B./age
  • Gender
  • Ethnic and/or racial background
  • Place of birth
  • Religion
  • Sexual orientation
  • Relationship status
  • Occupation or earnings
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What 2 criteria must demographic survey questions follow?

A

1) Must be relevant questions
2) Ensure that response options are inclusive to all

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What are the advantages of open questions?

List 3

A
  • Provide more detail
  • Rich data
  • Don’t impose assumptions
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What are the disadvantages of open questions?

List 2

A
  • Longer and more difficult to complete
  • Difficult to analyse responses (often subjective)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

When should we use open questions?

A

Only when they are justified

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

When are open questions most useful?

A

For descriptive, exploratory work

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What are the advantages of closed questions?

List 3

A
  • Quick to complete
  • Easy to analyse
    (objective)
  • Standardised responses
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What are the disadvantages of closed questions?

List 2

A
  • Can impose assumptions
  • Oversimplify complex issues
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What 3 things must we consider when asking closed questions?

A
  • Ensure questions are unambiguous
  • Provide clear response options
  • Carefully consider the style of response options
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

When are closed questions most useful?

A

For explanatory or predictive work

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

When formulating survey questions, what 5 things should we avoid?

A

1) Double-barrelled questions
2) Double-negative questions
3) Ambiguous questions
4) Leading questions
5) Questions with jargon

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What are double-barrelled questions?

A

Composed of two separate issues or topics but allows just one response

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Composed of two separate issues or topics but allows just one response

This is known as…?

A

Double-barrelled questions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Why should we avoid double-barrelled questions?

A

Because they are confusing and it is impossible to determine the true intention of respondents from data

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What is the problem with this question?

Is your personal style influenced by magazines and TV?

A

Double-barrelled question

20
Q

What is the problem with this question?

How satisfied are you with your pay and work environment?

A

Double-barrelled question

21
Q

Why should we not ask double-negative questions?

A

Double negatives can occur as a result of negative response options

22
Q

What is wrong with this question?

It is not a good idea to not submit work on time

A

Double-negative question

23
Q

Why should we not ask questions with negotiations? List 2 reasons

A

1) Introduce complexity and can be missed
2) Can result in non-response or misunderstanding

24
Q

Instead of negotiations, how should we present questions?

A

Present questions as a positive statement instead of negative statements

25
Q

What is wrong with this question?

Statistics should not be a compulsory unit of study

A

Negotiations

26
Q

What are ambiguous questions?

A

Questions that are vague, or over-generalised and are open to interpretation

27
Q

What is wrong with this question?

Where do you like to shop?

A

Ambiguous question

28
Q

What is wrong with this question?

Is your personal style influenced by magazines?

A

Ambiguous question

29
Q

What is wrong with this question?

Do you believe that the media have a dangerous influence on women’s perceptions of themselves?

A

Question with emotive language

30
Q

What is wrong with this question?

Experts suggest that exposure to violent video games can result in behavioural problems in children. Do you agree?

A

Leading

31
Q

How do we improve this question?

Do you believe that the media have a dangerous influence on women’s perceptions of themselves?

A

Do you believe that the media have an influence on women’s perceptions of themselves?

32
Q

How do we improve this question?

Experts suggest that exposure to violent video games can result in behavioural problems in children. Do you agree?

A

To what extent do you believe that exposure to violent video games can result in behavioural problems in children?

33
Q

What is a question with jargon?

A

When the question contains technical terms that Ps won’t be familiar with

34
Q

What is wrong with this question?

The use of cloning and burning in fashion photographs is morally wrong

A

Leading

35
Q

Why should we avoid asking questions leaning towards social desirability? List 2 reasons

A

1) Ps may respond in a positively biased way
2) Ps may identify with a lie or social desirability scale

36
Q

What is wrong with this question?

How much is each statement True or False for you?

No matter who I’m talking to, I’m always a good listener

A

Question leaning towards social desirability (response bias)

37
Q

What are the 2 types of survey response bias?

A

1) Response acquiescence
2) Social desirability effects

38
Q

What is a response acquiescence?

A

The tendency to agree rather than disagree

39
Q

What type of survey induces response acquiescence?

A

Surveys which include both positively and negatively worded questions

40
Q

What is wrong with this survey?

It was easy to find what I wanted on the website

I had no problems navigating the website

A

Response acquiescence

It includes both positively and negatively worded questions

41
Q

Match the statement below to a problem.

My mood is influenced by sport

a. Jargon
b. Leading
c. Double-barrelled
d. Double-negative
e. Ambiguous

A

e. Ambiguous

42
Q

Match the statement below to a problem.

The height and weight of a person impacts our first impressions of them

a. Jargon
b. Leading
c. Double-barrelled
d. Double-negative
e. Ambiguous

A

c. Double-barrelled

43
Q

Match the statement below to a problem.

It is not unlike me to have a glass of wine with dinner

a. Jargon
b. Leading
c. Double-barrelled
d. Double-negative
e. Ambiguous

A

d. Double-negative

44
Q

Match the statement below to a problem.

An implementation mode which decouples performance indicators from organisational objectives seems to further implementation success

a. Jargon
b. Leading
c. Double-barrelled
d. Double-negative
e. Ambiguous

A

a. Jargon

45
Q

Match the statement below to a problem.

Do you agree with the widely held view that capital punishment is morally wrong?

a. Jargon
b. Leading
c. Double-barrelled
d. Double-negative
e. Ambiguous

A

b. Leading

46
Q

Which of the following is a benefit of using open questions?

a. Provide rich data

b. Quick to complete

c. Easy to analyse

d. Standardised responses

A

a. Provide rich data

47
Q

Which is a drawback of closed questions?

a. Can oversimplify complex issues

b. Difficult to complete

c. Subjective responses are dificult to analyse

d. Tend to be longer than open questions

A

a. Can oversimplify complex issues