Quiz 10

Question 1

Survey Research Design

Answer 1

Research design that looks to understand a population by collecting data about knowledge, attitudes, behaviors, and beliefs from a sample. Collects data through asking questions of respondents, recording responses, and analyzing them statistically. Understanding of the sample “predicts attitudes and behaviors.”

Question 2

Survey

Answer 2

Data collection instrument that asks questions through a questionnaire or interview that incorporates a level of standardization into the structure.
Can be used in either quantitative or qualitative studies.

Question 3

What is the difference between Survey Research and Survey?

Answer 3

Survey Research : Research design used to “predict attitudes and behaviors” or “describe attributes”

• Non-experimental
• Can collect data on small groups or worldwide populations

Survey: Data collection tool that requires a level of standardization and can be used in quantitative (structured) or qualitative (unstructured) research
Data collected through a questionnaire or an interview
Answers analyzed statistically or thematically

Question 4

Standardization

Answer 4

Everyone is asked the same questions in roughly the same order using the same terminology. Answers to those questions are analyzed numerically.

Question 5

Power of Survey Research Design Example

Answer 5

The Pew Research Center’s Global Attitudes Project:
Public opinion surveys around the world on a broad array of subjects
people’s assessments of their own lives
views about the current state of the world

Question 6

Survey Research- Personal Interview

Answer 6

Strengths – higher response rate, allows for elaboration

Weaknesses – slow, costly, difficult to control for biases

Question 7

Survey Research- Telephone Interview

Answer 7

Strengths – fast, inexpensive, reaches large representative sample, random digital dialing (RDD), better response rate than mailed surveys

Weaknesses – higher non-response rate, no visual cues, hard to control for question confusion when answering

Question 8

Survey Research-Mail Survey

Answer 8

Strengths – inexpensive, responder convenience

Weaknesses – low response rate, slow

Question 9

Survey Research- Online Survey

Answer 9

Strengths – very low cost, timely, can reach global representative sample easily
Weaknesses – very low response rates, respondent bias

Question 10

Training the Interviewers

Answer 10

Explain interviewer bias: This is especially a problem when the content of the survey is highly charged and people have strongly held convictions

Skills in questioning: Cues, leading questions, managing group dynamics, etc.

Question 11

Writing Survey Research Questions

Answer 11

Focus:
Staying focused on a specific topic keeps the question clear

Clarity:
Keeping the question clear avoids misinterpretation and incorrect answers

Brevity:
Shorter questions are easier to answer.

Question 12

Open/Unstructured Research Questions

Answer 12

Allow the respondents some sense of freedom to answer the question and give the opportunity to elaborate on the topic using his or her own words. Usually involves some form of qualitative analysis

Question 13

Closed/ Structured Research Questions

Answer 13

Limit the responses that can be given by requiring that each respondent indicate agreement od disagreement with predetermined choices. Easy to quantify and turned into numerical form for analysis. Harder to write/comeup with questions

Question 14

Nominal

Answer 14

Label, group, name or describe. One object is different from another; the number next to each response has no meaning except as a placeholder for that response Researcher does not assign a value to each response

Question 15

Ordinal

Answer 15

Assign meaning through ranking. One object is bigger or better or more of anything than another with no way to determine the distance between responses

Question 16

Interval

Answer 16

Assign meaning through ranking. Distance between responses is measured in standard increments
3Types:
-Likert
-Semantic Differential
-Guttman

Question 17

Interval Question: Likert Scale

Answer 17

Used to quantitatively assess abstract concepts, attitudes, behaviors, etc.
*Traditional 1-to-5 rating

Ask an opinion question on a 1-to-5 bipolar scale (it’s called bipolar because there is a neutral point and the two ends of the scale are at opposite positions of the opinion).

Level of agreement of disagreement with a statment

Question 18

Interval Question: Semantic

Answer 18

Researchers measure attitudes, values, opinions, by having respondents rate their opinion or belief on a scale using bipolar adjectives

Question 19

Interval Question: Guttman Scale

Answer 19

Cumulative rank scale often used to determine an individual’s knowledge or the existence or degree of agreement with a concept or belief. Statements are listed in ascending or descending order, starting with the least extreme and moving forward with the most extreme statement appearing last

Question 20

Dichotomus Questions

Answer 20

When a question has two possible responses.
Surveys often use dichotomous questions that ask the respondent to select one of two possible answers
Yes/No
True/False
Agree/Disagree response

Question 21

Sample size is determined by analyzing

Answer 21

Significance level
Confidence levels
Type I and Type II errors

Question 22

How will you sample?

Answer 22

The first set of considerations has to do with the population and its accessibility

Looking for generalizable findings - probability sampling

Question 23

Can the population be enumerated?

Answer 23

For some populations, you have a complete listing of the units that will be sampled
registered voters or person with active driver’s licenses

For other populations, it will be difficult
-If your study requires input from homeless
persons, you will need to go find your population
-May rule out mail surveys or telephone
interviews

Question 24

Double Barreled

Answer 24

Asking two questions in one where the responded might feel differently about each statement and therefore be unable to answer.

Question 25

Biased or Loaded Questions

Answer 25

Framing a question in a way that does not allow a respondent to disagree with the question or using words that create an assumption

Question 26

Set the Tone

Answer 26

Set the tone by using an introduction that allows someone to admit to an undesirable behavior

Question 27

sampling

Answer 27

Probability and non-probability sampling methods

Response rate must be taken into account when determining number of participants needed

Question 28

Data Collection

Answer 28

Through asking questions in a questionnaire or interview

Question 29

Data Analysis

Answer 29

Employs both descriptive and inferential data analysis

Structured questions are assigned a numeric value for each response during the design phase (precoded)

Answers to unstructured questions are assigned numerical values for each written-in response (postcoded)

Question 30

Face Validity

Answer 30

Do the questions make sense?

Question 31

Content Validity

Answer 31

Do the questions express the underlying concept they were designed to reflect?

Question 32

Criterion Validity

Answer 32

Do the responses to the questions agree with an objective criterion or gold standard for the underlying concepts?

Question 33

Construct Validity

Answer 33

Are the hypotheses concerning the relationships between the underlying concepts borne out by the responses?

Question 34

Threats to Internal Validity

Answer 34

Threats to internal validity (results are true because the study worked and not due to a confounding variable or bias)
Self-selection
Response bias
Recall bias
Interview distortion
False respondents

Question 35

Survey Instrument Validity and Reliability

Answer 35

Instrument reliability
Test-retest
Does the same question have the same response over time or with a different sample?

Interrater
Do two interviewers with the same questionnaire get similar responses?

Internal consistency
Do questions designed to evaluate the same concept get equivalent responses?