Chapter B (Survey Instrument, Probing, Processing, Coding) Flashcards
Questions that require respondents to
provide an answer in their own words since a
complete list of answer categories are not
provided
Open Ended
Questions that provide a complete set of
alternative answers from which respondents
select their choice
Close Ended
Questions that have the option for the
respondents to provide answers other than
the categories provided
Semi-open
Uses a general-to-specific question flow
Funnel approach
Uses a general-to-specific question flow
Work approach
▧ Aims to determine any errors in the
questionnaires or areas that need
improvements such as the ordering of
questions, wording, and the natural flow
from one section to another
▧ There are no rules regarding the
respondents who will be part of the pretest
and the sample size
Pretest
▧ Respondents are informed about a practice
run and are asked to give comments and
suggestions to the questionnaire
Participating Pretest
▧ Respondents are not informed that the
questionnaire is only a draft and the
interviewer plays it straight
Undeclared Pretest
The most commonly used measure of reliability
▧ If alpha is high (at least 0.80, closer to 1.00),
then this suggests that all of the items are
reliable and the entire questionnaire is internally consistent
▧ If alpha is low (less than 0.60), then at least one of the items is unreliable and must be identified via the item analysis procedure
Cronbach’s Alpha
▧ It is not the same as reliability
▧ The ability of the questionnaire to measure
what it intends to measure (the latent
variable, e.g. happiness, is measured using all
items in the questionnaire)
▧ Types of validity include face validity,
content validity, criterion-related validity, and
construct validity – test1: Confirmatory
Factor Analysis and Rasch Analysis)
Validity
▧ A small trial run of the entire survey process
▧ It is undertaken after pretest
▧ It is completed prior the final survey goes
into the field, to alert the enumerator to
possible difficulties that were not
anticipated
Pilot Survey
To clarify answers in a non-directive way
▧ To motivate the respondent
▧ To make the respondent focus on a
particular question
Probing
The rambler R how to deal?
The silent treatment. Stop the “uh-huh” and
keep quiet.
The rude approach. Wait until R stops for a
breath, then quickly ask the next Q. If R still
doesn’t answer the Q, wait for another breath,
say “I see,” then repeat Q.
Change focus approach. Drop all pencils on the
floor. Everything stops cold while picking up all
the pencils.
▧ R is deaf or has severe speech problems or
other disabilities that make completion of an
interview extremely difficult for them
Thanks, R, for his/her time. Mark this interview
as “no eligible respondent.”
The process of inspecting the raw data from
a questionnaire and correcting for any error
to ensure its accuracy and reliability (data
screening)
Data Editing
▧ The process of converting answers to survey
questions into numerical form (codes) to
help compile the survey statistics
Data Coding
▧ Correspond to a list of choices or possible
responses
▧ Successive integers, beginning with 0 or 1,
are assigned to the items in the list of
possible responses
Listing Codes
▧ Represent ranges or class intervals
▧ These are frequently used for numerical
responses like income and age in which the
respondent may not be able to provide an
exact answer
Bracket Codes
▧ Represent grouping of responses that vary in
degree or intensity along a continuum
▧ Commonly used for coding responses to
attitudinal questions (Likert scaling)
Scale Codes
▧ Multi-digit codes are divided into two sets –
(1) leading digits represent a major
classification, and (2) trailing digits represent
a specific category within the major
classification
▧ This coding scheme can be extended to more
than two levels
Series Code
▧ For each possible response, create a
dichotomous variable with a value of 1 to
indicate that the response was given and a
value of 0 if not
Methods of Coding Multiple Response
Multiple Dichotomy Method
Create new categories that are combinations
of the possible responses
Methods of Coding Multiple Response
Coding Combination Method
▧ It should be coded NO or given a code
number directly following the other
categories
▧ Code: Yes ‘1’; No ‘0’ and No Opinion/No
Comment a code ‘2’
No Opinion/No Comment