test 1, survey research Flashcards

1
Q

Identify the steps in the survey research process.

A
1. Data collection 
(1) Sampling
(2) Questionnaire design or survey instrument design)
(3) Conducting the survey
 Survey modes:
(a) mail
(b) telephone
(c) in-person
(d) Internet
2. Data entry and data processing
3. Data analysis
4. Survey report (description of the survey process, major findings, conclusions, etc.; diagrams, charts, tables, etc.will be used)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Define and find examples of sample.

A

part” or subset of population

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What are the major similarities between census and survey?

A

Both census and survey use the same basic techniques and methods for data collection, data entry and processing, data analysis, and findings reporting.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Discuss the widespread use of sampling and survey by other academic disciplines and professions.

A

costco, schools, marketing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

When can errors occur in the survey process?

A
  1. Using “part” (sample) to estimate or project
  2. Using a “whole”( population )to estimate or project
  3. Respondent answers are not accurate measures of the characteristics of the respondents.
  4. Sample does not represent population.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Discuss various types of biases in surveys.

A
  1. Incomplete sample frame: Sample frame does not include all the people to be sampled.
  2. Sampling is not random.
  3. Incomplete answers, non-response, and low completion rate.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Differentiate between random error and systematic error in sampling Find real life examples for each.

A

sampling is concerned with the selection of a subset of individuals from within a statistical population to estimate characteristics of the whole population

systematic error is called a bias ex. is an internet survey

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Define sampling.

A

sampling is concerned with the selection of a subset of individuals from within a statistical population to estimate characteristics of the whole population

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is the relationship between a sample and the population

A

a sample is a subset of a population

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Identify and find examples of the major sampling methods. And discuss their appropriate uses.

A

1 stage sampling

a. Simple random sampling:
b. . Systematic sampling
c. Stratified sampling
2. multistage sampling
a. Area probability sampling
b. Random-digit dialing (RDD)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Why is stratified sampling needed

A

When the distribution of the target population on a particular indicator (e.g., gender, grade level) is known, stratified sampling can give all sub-groups equal representation in the sample through unequal weighting of different strata

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What does the chance of selection refer to?

A

Each individual in the population of interest has an equal likelihood of selection.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What are the factors affecting sample quality?

A

Feasibility
Cost
Precision (how large a sampling error can be tolerated)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What are the characteristics of a good sample frame?

A

Comprehensiveness (must include all the people to be sampled)
A person’s probability of selection (to be selected) can be calculated.
Efficiency (the people to be sampled can be found easily and cost-effectively)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Identify the major causes of non-response.

A

Interviewee cannot be reached.
Interviewee refuses to answer questions.
Interviewee cannot provide data due to difficulties (e.g., illness, language problems, etc.)
sensitive questions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

How samples are drawn in Systematic sampling

A
  1. Decide sample size.
  2. Divide the total population into equal “blocks” by the sample size.
  3. Select a random number within the boundaries of one block and use it SYSTEMATICALLY throughout for ALL BLOCKS.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Under what circumstances do people are most likely to respond to a survey?

A

interest and relevance

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

How to calculate response rate

A

people who complete the survey / total number of people surveyed.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Generally speaking, which groups (in terms of age, education, immigration status, etc.) are more likely to respond in surveys?

A

older educated natives

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Generally speaking, which area (urban vs. suburban) tends to have a higher response rate?

A

suburban

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

How to reduce non-response in interviewer-administered surveys?

A

make appointments, know your timing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Discussthe nature and effects of non-response

A

Non-response error is hard to measure. There is still no clear evidence on when and how much non-response will or will not affect survey estimates.
The effect of non-response on one variable can be different than for others in the same survey.
No one knows how biased non-response is, but you have to assume it is biased.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Discuss the merits and weaknesses of internet surveys.

A

most biased
reach only part of the population
people have multiple email accounts
cheap can get to a lot of people

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

How to reduce non-response in mail surveys?

A

(1) Questionnaire must be easy to see, easy to read and easy to answer.
(2) Small cash payment improves response rate significantly.
(3) Repeated contacts and telephone follow-ups are needed.

25
Q

What are the good practices to boost response rate?

A

(1) Combine 2-3 modes or methods to produce a higher response rate. For example: use mail or email for first phase of data collection, followed by telephone interviews with non-respondents.
(2) Data collected from follow-ups using a different mode need to analyze to make sure they are comparable with previously collected data.

26
Q

Identify self-administered, surveys.

A

mail, internet, and computer-assisted surveys.

27
Q

Identify interviewer-administered, surveys.

A

telephone and personal interview surveys.

28
Q

Identify group-administered surveys.

A

college classroom

29
Q

Identify the major answer errors respondents are likely to make.

A

(1) Misunderstanding of survey questions
(2) No knowledge or not sure
(3) No standard measure for subjective feelings
(4) Overstatement, understatement or pure lying

30
Q

What does reliability refer to?

A

providing CONSISTENT measures

31
Q

Define and find examples of validity.

A

measure what it is supposed to measure; using the right measure

32
Q

What are the ways to increase reliability?

A
  1. Ask the same set of questions for each respondent.
  2. Wording of the questions must be universally understood
  3. AVOID complicated and unfamiliar words and phrases, poorly defined terms, and incomplete sentences.
  4. Use optional wording as needed.
  5. Avoid asking multiple questions in a single sentence.
  6. In case translation is needed, use special wording for special subgroups to avoid misunderstanding or loss of meaning.
  7. Whenever possible, use closed questions and provide respondents with a list of acceptable or expected answers.
33
Q

How to increase validity?

A
  1. Validity: Right measure for right subject.
  2. Validity is somewhat different for subjective and objective measures.
  3. Validity of opinions and feelings is hard to assess. It can only be assessed in relation to other answers a respondent gives.
  4. Whenever possible, use closed questions.
  5. Provide definitions to complex terms to reduce answer error.
  6. change the question to ask information that is less detailed and easier to recall or estimate.
  7. Tuse self-administered survey methods and assure confidentiality and anonymity.
  8. Ask several questions with different question forms that measure the same subjective matters.
34
Q

What are open-ended questions and their appropriate uses?

A

This type of question allows participants to respond in any way they choose

used in exploratory research.

35
Q

What are the major types of closed-ended questions and their appropriate uses?

A

Multiple-choice-Use a multiple-choice question when you want your respondents to choose the best possible answer among all options presented.

Nominal (categorical or dichotomous)-Use a categorical question when the possible answers are categories, and the respondent must belong to one category.

Ordinal-Sometimes you may want your respondents to rank order their responses. A ranking indicates the importance assigned by a participant to an attitudinal object.

Likert scale- one standardized form of ordinal question format. Use a Likert-scale question when you are trying to determine respondents’ attitudes or feelings about something.

Semantic differential (one form of ordinal question format)-opinions very much like to very much hate

Guttman scale (one form of Semantic-Here, the respondent checks each item with which they agree. The items themselves are constructed so that they are cumulative – if you agree to one, you probably agree to all of the ones above it in the list.

Numerical-

Ordinal

provide primarily quantitative data, and are frequently used in confirmatory research.

36
Q

What are contingency questions and their appropriate uses?

A

Sometimes you have to ask the respondent one question in order to determine if they are qualified or experienced enough to answer a subsequent one

37
Q

What are matrix questions and their appropriate uses?

A

The matrix question is an efficient format for presenting several items sharing the same response categories.

38
Q

What are the major differences between census and survey? With the subject matter

A
            Census Survey

Subject: IndividualsIndividuals, organizations, or other

39
Q

What are the major differences between census and survey? With the data collected

A

Census Survey

Data collected: Facts only Opinions, facts, or both

40
Q

What are the major differences between census and survey? With the cycle(how often)

A

Census Survey

Cycle: Every 10 years Anytime

41
Q

What are the major differences between census and survey? With the sponsors

A

Census Survey

Sponsor: Census Bureau Any organization or individual

42
Q

What are the major differences between census and survey? With the expense

A

Census Survey Expense: Expensive Inexpensive

43
Q

What are the major differences between census and survey? With the scale

A

Census Survey

Scale: Large Small

44
Q

Identify the major answer errors respondents are likely to make.

A

(1) Misunderstanding of survey questions
(2) No knowledge or not sure
(3) No standard measure for subjective feelings
(4) Overstatement, understatement or pure lying

45
Q

How samples are drawn in Stratified sampling

A

Before sampling, the population is divided into characteristics of importance for the research. For example, by gender, social class, education level, religion, etc. Then the population is randomly sampled within each category or stratum. If 38% of the population is college-educated, then 38% of the sample is randomly selected from the college-educated population.

46
Q

How samples are drawn in Simple random selection

A

In a simple random sample (SRS) of a given size, all such subsets of the frame are given an equal probability. Each element of the frame thus has an equal probability of selection

47
Q

How samples are drawn in multistage selection

A

Stage 1: Select a small number of “clusters” (geographic areas, organizations, etc.)–NOT INDIVIDUALS–from all the “clusters” as sample. At this stage: Population—all “clusters” Sample–some “clusters”
Stage 2: Select individuals from the selected “clusters” At his stage: Population–all individuals in the selected “clusters” Sample–some individuals selected from these clusters

48
Q

How to calculate non-response rate?

A

total number of people surveyed/people who complete the survey

49
Q

In group-administered surveys, respondents answer questions (record answers) just like in _______.

A

self report

50
Q

Discuss the suitable uses for each survey mode.

A

mail
telephone
in-person
Internet

51
Q

Discuss issues about questions format,

A

open-ended-coding is impossible, only use when exploring new issues, and a small population

close ended-yes no questions

52
Q

What is the difference between error and bias

A

error is random it can go both ways. bias is consistent can go only one way

53
Q

What kind of errors are there

A
  1. human
  2. equipment
  3. answer either lack of knowledge or misunderstanding
  4. unrepresented sample
54
Q

what is a sample frame

A

as close to the population as you can get

55
Q

Discuss issues about , costs,

A

costs from high to low: personal interview survey telephone survey group-administered survey mail survey Internet and computer-assisted surveys.

56
Q

Discuss issues about response time,

A

the order of response rate–from high to low– looks like the following: group-administered survey personal interview survey telephone survey Internet and computer-assisted surveys mail survey
Mail and personal interview surveys are not suitable for fast response.

57
Q

Discuss issues about equipment requirements,

A

Internet and computer-assisted surveys have higher requirements on facilities and are not suitable for sparsely populated areas and small cities where high-speed Internet service and computer labs are not readily available.

58
Q

Discuss issues about content

A

Closed-end questions are preferable, especially for mail survey.
Break down complex questions into a set of simpler ones.
Sensitive questions are more suitable for mail, Internet and computer-assisted surveys.