Exam #2 - Chps. 5-8 Flashcards
A set of structured questions to which a respondent replies is a…
questionnaire
Questionnaires provide ____________ and _____________ in data gathering.
standardization and uniformity
The questionnaire must translate the information needed into a set of specific questions that the respondent…
can and will answer
What is the questionnaire design process?
- Confirm research objectives and information requirements
- Select appropriate data collection method
- Develop questions and scaling
- Determine layout and evaluate questionnaire
- Obtain initial client approval
- Pretest, revise, and finalize questionnaire
- Implement the survey
What is a a double-barreled question?
two or more questions are combined into one
ex. “Do you think Coca-Cola is a tasty and refreshing soft drink?”
How can you increase the willingness of participants?
- Place sensitive topics at the end of the questionnaire.
- Preface the question with a statement that the behavior of interest is common.
- Ask the question using the third-person technique. Phrase the question as if it referred to other people.
- Hide the question in a group of other questions which respondents are willing to answer. The entire list of questions can then be asked
quickly. - Provide response categories rather than asking for specific figures.
- Use randomized techniques.
What are unstructured questions?
open-ended questions
respondents are asked to reply in their own words
What are advantages of unstructured questions?
useful for when you can’t come up with an exhaustive list of all of the choices
What are the disadvantages of unstructured questions?
might not get what you’re looking for
hard to analyze / get into numerical form
What are structured questions?
where respondents choose from a pre-specified list of answers
What are the three types of structured questions?
- dichotomous
- multiple choice
- scales
What are the advantages of structured questions?
easy to analyze
What are the disadvantages of structured questions?
takes more time to come up with an exhaustive list
might not capture all
What are dichotomous questions?
a question that has only two response alternatives: yes or no,
agree or disagree, etc.
For dichotomous questions, the two alternatives of interest are supplemented by a…
neutral alternative (no opinion, both, don’t know, etc.)
What are multiple choice questions?
the researcher provides a choice of answers and respondents are asked to select one or more of the alternatives given
True or False: Multiple choice questions often provide more clarity and refinement than dichotomous questions.
TRUE!
What are scaled response questions?
the choices are designed to capture the intensity of the respondent’s answers, such as attitudes or intentions
Creating a continuum upon which measured objects are located is known as…
scaling!
Assigning numbers or other symbols to characteristics of objects according to certain pre-specified rules is known as…
measurement!
What are the rules for assigning numbers during measurement?
- One-to-one correspondence between the numbers and the characteristics being measured.
- The rules for assigning numbers should be standardized and applied uniformly.
- Rules must not change over objects or time.
What are the primary scales of measurement?
- nominal scale
- ordinal scale
- interval scale
- ratio scale
___________ scales partition data into mutually exclusive and collectively exhaustive categories.
nominal
__________ scales are nominal scales that can order the data.
ordinal
__________ scales are ordinal scales with equal intervals between points to show relative amounts.
interval
__________ scales are are interval scales a meaningful zero point.
ratio
_________ scales allows magnitudes to be compared arithmetically.
- nominal
- ordinal
- interval
- ratio
ratio
This is an example of what type of scale question?
Are you satisfied with your present diet?
___Y___ N (where 1=y, and 2=n)
nominal
This is an example of what type of scale question?
Rank the following foods in order of preference (1=most preferred, 4=least)
___ Carrots
___ Cupcakes
___ Fish
___ Macaroni and Cheese
ordinal
This is an example of what type of scale question?
I eat 5 servings of vegetables a day.
Agree Disagree
1 2 3 4 5
interval
This is an example of what type of scale question?
Please allocate 100 points based on your preferences to the following foods:
___ Carrots
___ Cupcakes
___ Fish
___ Mac ‘n Cheese
100 Sum
ratio
What analyses can you perform on data that come from nominal scale questions?
basic analysis.
- frequencies
- counts
- %s
numbers don’t have distance!
What analyses can you perform on data that come from ordinal scale questions?
basic analysis.
- frequencies
- counts
- %s
numbers don’t have distance!
What analyses can you perform on data that come from interval scale questions?
distance has meaning, so you can take averages.
also basic analysis.
- frequencies
- counts
- %s
What analyses can you perform on data that come from ratio scale questions?
zero has meaning, it means nothing.
also basic analysis.
- frequencies
- counts
- %s
What are the two main types of scaling techniques?
comparative and non-comparative
What falls under comparative scales?
- paired comparison
- rank order
- constant sum
What falls under non-comparative scales?
- continuous rating scales
- itemized rating scales
- Likert
- semantic differential
- Stapel
In (comparative/non-comparative) scales, the stimulus objects are directly compared.
comparative
In (comparative/non-comparative) scales, the scale data must be interpreted in relative terms and have only ordinal or rank order properties.
comparative
In (comparative/non-comparative) scales, each object is scaled independently of the others in the stimulus set.
non-comparative
In (comparative/non-comparative) scales, the resulting data are generally assumed to be interval or ratio scaled.
non-comparative
The most widely used comparative scaling technique is…
paired comparison scaling.
In paired comparison scaling…
a respondent is presented with two objects and asked to select one
according to some criterion.
In rank order scaling…
respondents are presented with several objects simultaneously and asked to order or rank them according to some criterion.
True or False: In rank order scaling, the options are always put in alphabetical order so there is no bias.
TRUE!
In constant sum scaling…
respondents allocate a constant sum of units, such as 100 points, to attributes of a product to reflect their importance.
What does giving something a ‘zero’ in constant sum scaling mean?
it’s unimportant
How do you know if something is twice as important as something else in constant sum scaling?
It receives twice as many points.
In continuous rating scales…
respondents rate the objects by placing a mark at the appropriate position on a line that runs from one extreme of the criterion variable to the other.
In itemized rating scales…
respondents are provided with a scale that has a number or brief description associated with each category.
How are the categories ordered in itemized rating scales?
by scale position
What are the three main examples of itemized rating scales?
- the Likert scale
- the semantic differential
- the Stapel scale
In this type of itemized rating scale, the respondents are required to indicate a degree of agreement or
disagreement with each of a series of statements about the stimulus objects.
the Likert scale
In this type of itemized rating scale, respondents are provided a seven-point rating scale with endpoints associated with opposite, worded labels.
semantic differential
True or False: Negative labels are always on the left side of a semantic differential.
FALSE! It switches intentionally so that respondents are forced to pay attention.
What are the two ways that items on a semantic differential scale may be scored?
+3 or -3
1-7 scale
In this type of itemized rating scale, the respondent is provided a unipolar rating scale with ten categories numbered from -5 to +5,
without a neutral point (zero). This scale is usually presented vertically.
the Stapel scale
What issues must you consider when designing itemized scales?
- Number of Scale categories
- Odd or Even # of Scale categories
- Balanced vs. Unbalanced Scales
- Forced vs. Nonforced scales
- Nature and degree of verbal description
- Physical form or configuration
If a scale is reliable, it is free of what kind of error?
random error
If a scale is valid, it is free of what kind of error?
measurement error
____________ means that a measure provides consistent results over time.
reliability
____________ means that a measure measures what it’s supposed to.
validity
True or False: A measure must be reliable in order to be valid.
TRUE!