Chapter 21 - Questionnaire Development

Question 1

What is a questionnaire?

Answer 1

A series of questions used as a tool for systematically gathering data from study participants

Question 2

What is the general Questionnaire Design plan (9 steps)

Answer 2

1) Identify general question categories

2) Select specific question topics

3) Choose question and answer types

4) Check wording

5) Choose order

6) Format layout

7) Pretest

8) Revise

9) Use

Question 3

What is Systems thinking?

Answer 3

The process of identifying the underlying causes of complex problems so that sustainable solutions can be developed and implemented

Question 4

What are Open-ended vs. Close ended questions?

Answer 4

• Open ended allows for unlimited number of responses and for people to explain their answers at length
• Close ended allows for a limited number of possible responses

Question 5

What is a Likert scale?

Answer 5

A Likert scale presents ordered responses to a questionnaire item that asks participants to rank preferences numerically from 1-5

Question 6

What is Anonymity?

Answer 6

The inability of a participant’s identity to be discerned from his or her responses to a survey instrument or records in a database.

Question 7

What is Habituation?

Answer 7

An error that occurs when participants completing a questionnaire or interview become so accustomed to giving a particular response (like “agree . . . agree . . . agree . . .”) that they continue to reply with the same response even when that does not match their true perspectives.

Question 8

What is a filter/contingency question?

Answer 8

A question that determines whether the respondent is eligible to answer a subsequent question or set of questions.

Question 9

What can skip-logic code do?

Answer 9

It can automatically hide irrelevant questions from participants based on their responses to filter questions

Question 10

What is Reliability/Precision vs. Validity/Accuracy?

Answer 10

• Reliability is more when there are consistent responses for the same questions or the same outcomes (think about a dart hitting the same spot on a target consistently)
• Validity or accuracy of a survey instrument or a diagnostic test is established when the responses are correct (the dart hitting the target)

Question 11

What is internal consistency?

Answer 11

It is an aspect of reliability which is present when the items in a survey instrument measure various aspects of the same concept

Question 12

What is Content/logical validity ?

Answer 12

Content validity, is present when subject-matter experts agree that a set of survey items captures the most relevant information about the study.

Question 13

What is Face validity?

Answer 13

Face validity is present when content experts and users agree that a survey instrument will be easy for study participants to understand and correctly complete.

Question 14

What is Construct validity?

Answer 14

Assesses how well a test measures a concept it was designed to evaluate

Question 15

What is Factor analysis?

Answer 15

A sophisticated statistical method aimed at reducing a large number of variables into a smaller set of factors

Question 16

What is Convergent vs. Discriminant validity?

Answer 16

• Convergent validity is present when two items that the underlying theory says should be related are shown to be correlated.
• Discriminant validity is present when two items that the construct says should not be related are shown not to be associated.

Question 17

What is Criterion validity?

Answer 17

It uses an established test or outcome as a standard (or criterion) for confirming the utility of a new test that examines a similar theoretical construct

Question 18

What is Concurrent vs. Predictive validity?

Answer 18

Concurrent validity compares two instruments or methods that measure the same or a similar construct at the same time, while predictive validity compares one instrument or method that measures a construct at one time with another outcome that occurs at a later time.

Question 19

What is a Pilot test?

Answer 19

A small-scale preliminary study conducted to evaluate the feasibility of a full-scale research project

Question 20

What is back translation or double translation?

Answer 20

One person translates the questionnaire from the original language to a new language and then a second person translates the survey instrument in the new language back into the original language