Week 3 Lecture 3: Survey Questionnaires

Question 1

Data collection methods (5)

Answer 1

• interviews
• focus groups
• questionnaires
• observing
• analysis of routine data collected by others

Question 2

Survey

Answer 2

= a process of gathering data that could involve a wide variety of data collection methods (including a questionnaire)

Question 3

Questionnaire

Answer 3

= an instrument for collecting data, subject responds to set of written or oral questions
- usually closed-ended questions (answers coded and analysed quantitatively) but can include open-ended questions
- self-administered (on paper, online etc.) or by an interviewer orally

Question 4

Descriptive research questions

Answer 4

= answer “what” questions:
* characteristics of a population
* levels of a phenomenon

Question 5

Explanatory research questions

Answer 5

= answering “why” questions:
- searching for causes
- searching for consequences
- testing a simple causal proposition
- testing complex ideas

Question 6

Questionnaire design steps in the context of the survey process (9)

Answer 6

1. Create research aim and research question
2. Identify population and sample
3. Decide how to collect replies
4. Decide how to analyse replies
5. Design questionnaire
6. Run pilot survey
7. Run survey
8. Analyse data
9. Report findings and disseminate

Question 7

Questionnaire strengths

Answer 7

• target a large number of people
• reach ppl in widely dispersed locations
• cheap, fast, easy
• straight forward analysis, responses can be precoded
• useful for collecting quantitative data
• low pressure for respondents
• lack of interviewer bias (but possibility of ‘ghost interviewer effect’)

Question 8

Questionnaire limitations (10)

Answer 8

• low response rate
• accessibility (literacy, visual impairments, online)
• ghost interviewer effect
• misunderstandings cannot be corrected, questions cant be clarified
• difficult to account for cultural and language differences
• no opportunity to probe and develop answers
• no control over context or order of questions answered (unless online)
• no check on incomplete responses (unless online)
• design issues
• respondants lying

Question 9

Ghost interviewer effect

Answer 9

= question wording/framing influencing response

Question 10

Techniques for maximising response rate (9)

Answer 10

• good design: layout, easy to follow, simple questions, appearance, length, degree of interest and importance, ethical issues, thank for taking part
• pre-notification
• explanation of selection
• sponsorship: letter of introduction/recommendation by others
• cover letter: explains purpose
• incentives: understanding importance or prizes
• reminders
• confidentiality/anonymity
• pre-paid return envelopes if postal survey

Question 11

Things to avoid when wording questions (10)

Answer 11

• abbreviations
• alternate meanings
• ambiguity and vague wording
• double-barreled questions
• double negatives
• inappropriate categories
• leading questions
• memory issues
• social desirability
• complexity

Question 12

Double-barrelled questions

Answer 12

= asking about two different issues while only allowing one answer

Question 13

Leading questions

Answer 13

= survey questions that are framed in a way to encourage or guide the respondent towards a desired answer

Question 14

Closed question/closed-ended question

Answer 14

= choice of alternative replies

Question 15

Open question/open-ended question

Answer 15

= written text or spoken answers, can reply with anything

Question 16

Scales

Answer 16

= measurement instruments that are a collection of items )questions/statements) intended to reveal theoretical variables (abstract concepts) not readily observable by direct means
e.g. sense of satisfaction, locus of control

Question 17

Scales underlying structure

Answer 17

• Abstract concept, e.g. unsatisfactory patient encounters
• specific items, e.g. statements regarding nature of encounters
• uniform response categories, e.g. scale 1-5

Question 18

Construct validity (of scales)

Answer 18

items in scale define and distinguish concept from other concepts

Question 19

Internal consistency/reliability of scales

Answer 19

items in scale relate to concept

Question 20

Methodological issues with specific items in scales (4)

Answer 20

• consider reading level of respondants
• avoid jargon and colloquialisms
• express only one idea in each item
• use both positively and negatively worded items but avoid use of negatives (not, etc.) in negatively wording item

Question 21

Methodological issues with uniform response categories in scales

Answer 21

• reasonable no. response categories, taking into account concept and respondents ability to discriminate
• meaningful labels for categories

Question 22

Credibility

Answer 22

= is the measure believable? is it viewed as a reasonable and appropriate way to capture info?

Question 23

Internal validity

Answer 23

= how well does the measure capture what it is supposed to?

Question 24

Reliability

Answer 24

= reproducibility