Brainscape's Knowledge GenomeTM

Browse over 1 million classes created by top students, professors, publishers, and experts.


See full index

RM > Surveys 2 > Flashcards

Surveys 2 Flashcards

1
Q

Avoid these types of questions

A
  1. Double-barreled questions
  2. Ambiguous questions
  3. Recall-dependent questions
  4. Leading questions
  5. Non-neutral questions
  6. Social desirability question
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Avoid these traits in surveys

A
  1. No overlapping answers (Options should be mutually exclusive and collectively exhaustive)
  2. Avoid typos
  3. Avoid formatting issues
  4. Avoid lengthy surveys
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Length of questions

A
  • Simple, short questions are preferable to long ones.
  • As a rule of thumb, a question or a statement in a survey should not exceed 20 words.
  • Better split questionnaire in multiple pages
  • Better click next than having to scroll down
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Test Ride / Pretest/Experts

A

Ask small sub-sample of population to respond to your survey and either ask them about the survey or analyze their responses.

Check whether your respondents understand the questions as you would expect them to.

Ask experts (like your coach and co-reader)

NOTE: Make sure the participants of your pre-test are not participating in the main study.

  1. ask small SUB-SAMPLE of the POPULATION
  2. check if they UNDERSTAND
  3. ask EXPERTS
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Administering Survey

A

How will you contact respondents?
• Using online platforms for data collection, such as AMT / Prolific
• Using student samples/FB
• Company surveys: ask ‘support’ from management

A reminder can increase your response rate by up to 50%

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Amazon Mechinal Turk (AMT)

A

• Very fast (up to 500 responses in a few hours)

• Relatively reliable (respondents are experienced)
Option to filter based on quality and experience

• Cost included
Rule of Thumb is approx. $0.10 per minute per respondent

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Prolific Academic

A

• Fast (up to 200 responses in a few hours)

• More reliable (respondents are experienced)
Option to filter based on quality and experience

• Cost included
Rule of Thumb is approx. $0.11 per minute per respondent

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Sequence of elements

A
  1. Introduction
  2. Experimental Task (choice, stimuli etc.)
  3. Start with DV
  4. Include manipulation checks
  5. Main IVs of your conceptual model (if these are not the manipulated variables in the experiment)
  6. Control variables
  7. Demographics
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Order of questions

A

DV -> IV -> Controls

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

A good introduction

A
  • Proper introduction that clearly discloses the identity of the researcher and conveys the purpose of the survey is necessary.
  • Assurance of confidentiality of the information provided by them will allow for less biased answers.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Reliability

A
  • How accurate is the measurement of our constructs?
  • Cronbach’s Alpha (>0.7)
  • Inter-rater reliability
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Validity

A

Are we measuring the right thing?

  • Face validity
  • Convergent validity
  • Discriminant validity
  • External validity
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Factor Analysis

A

• Check reliability of multi-item constructs

• Check if the questions we think reflect on 1 construct do
indeed reflect on that construct (convergent validity)

• Check if the questions we think reflect on 1 construct do NOT reflect on other constructs (discriminant validity)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Moderation effects

A
  • If you include a moderator (x2), you need to include both the interaction term (x1*x2) as well as the main effect of the moderator (x2).
  • You may consider floodlight / spotlight analysis
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Possible threats to surveys

A
  1. Response biases

2. Common method bias (CMB)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Response biases

A

Extreme/Neutral responses

  • Use standard response tendency scales for calibrating
  • Check for means & standard deviations, outliers
  • Quality of professional respondents (AMT/Prolific)
17
Q

Common method bias (CMB)

A

Finding ‘fake’ relationships, because respondents tend to tick the same boxes (all high, all low, all middle)

  • Include items to measure an unrelated construct (marker variable) in your survey to ‘control’ for CMB, important to discuss if you use survey!
  • Instead of phrasing all questions positively, include some negatively worded questions, so the tendency in respondents to mechanically circle the points toward one end of the scale is minimized.
  • Measure time spent per page in Qualtrics

RM (12 decks)

Brainscape helps you reach your goals faster, through stronger study habits.
© 2024 Bold Learning Solutions. Terms and Conditions