Sample Surveys Flashcards

1
Q

Target Population

A

The set of units from the population to be studied

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Survey population

A

Frame is the list that allows us to access the survey
population

A complete non-overlapping list of the persons or objects in the population

The survey population is the population who can be
reached via this sampling frame

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Sample

A

Selected from the sampling frame, the group from which measurements will be sought

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Responding Sample

A

The group of people or objects that are successfully
measured
Data collection from the responding sample, e.g.
questionnaire

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Objectives

A

research questions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Resources

A

money/ budget, constraints, people, alternative data sources

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Population of interest

A

details of population (scope)

units, reference period, geographic coverage

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Sampling frame

A

is a list which enables us to sample and
contact members of the population

list of units, extra information
does it correspond to target population?

examples:
electronic or hard copy white pages
random digit dialing frame is every 10 digit number
society membership
customer database
Medicare members
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Planning a Survey

A
Objectives
Resources
Population of interest
Sampling frame
data collection
analysis plan
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Sample Survey Process

A
Define research objectives
Choose mode of collection and choose sampling frame
Construct and pretest questionnaire
Design and select sample
Design and implement data collection
Code nd edit data
Make postsurvey adjustments
Perform analysis
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Units

A
what are the objects we want to sample and
measure?
-people
-households
-businesses (what definition?)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Scope

A

who is in and who is out

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Reference period

A

e. g. permanent residents as of 1/1/2015?

e. g. businesses in operation as of 1/7/2016?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Over-coverage

A

People in the survey population not in the target population

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Under-coverage

A

People in the target population not in the survey population

If `coverage rate’ is too low, then may change the target population to something more achievable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Coverage rate

A

What target population is feasible?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Collection method

A

e.g. if frame has phone numbers only, then must use a

phone survey etc

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Sampling design

A

If we want to target our sample in some way (e.g. select more women than men), we can only do this using information on the frame!

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Probability sampling

A

is preferable in most situations

everyone in the survey population has a chance of being selected

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Simple random sampling

A

every sample is equally likely
N is the population size, n is the sample size
assign a random number (1, …, N) to every unit and take
the n units with the smallest values
there are many other designs - seek advice!
e.g. a sample of streets, take all residents

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Sample Designs

A
Simple Random Sampling
Convenience Sampling
Systematic Sampling
Cluster Sampling
Stratified Sampling
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Stratified sampling

A

simple random sample is taken from each strata the

population has been divided into (e.g. states)

23
Q

Systematic sampling

A

the elements of a frame are ordered and then chosen

systematically (e.g. every 10th element)

24
Q

Cluster sampling

A

the population is divided into clusters/groups (e.g. city
blocks) and a sample of the clusters is selected, then
sample all the units within each selected cluster

25
Q

Multistage sampling

A

like cluster sampling, but elements within each cluster are randomly selected

26
Q

Main goal in surveys is to

A

compare between subgroups, or to compare across time

27
Q

Responding Sample

A

Is an attempt to survey all units in the sample.

Some will not be contactable
Some will refuse to participate
Some will be ineligible for the survey (over-coverage)

28
Q

Response rate

A

is an important measure of quality

29
Q

Non-respondents

A

may be systematically different to respondents, leading to substantial bias

30
Q

Improving Response Rate

A

An introductory statement, stating the relevance of the survey and reassuring and true statements about confidentiality

Professional appearance & conduct of interviewer

Survey organisation has a good reputation

Good questionnaire/interview design

Survey not too long

Callbacks

Incentives

Collection method

31
Q

Collection Methods

A

Mail
Telephone
Field Interview
Internet Survey

32
Q

Mail

A

relatively cheap
response rates may be poor: may need 3 mail-based
follow-ups

33
Q

Telephone

A

require a frame of telephone numbers
coverage imperfect
call-backs needed

34
Q

Field Interview

A

face to face interview

more detailed information and complex sequencing are possible

35
Q

Internet Survey

A

new area

obvious challenges are coverage and response rate

36
Q

Prototype form

A

Like a draft form of the survey

37
Q

Pilot Study

A

Visit a small sample of individuals from the population

Ask them to ll out the form as if received by mail
Observe, ask questions as they go (hesitations etc)
What did you take this to mean?
Never defend the form
Probe everything - introduction, explanatory notes, examples; even colour and font
Need to secure their commitment

38
Q

Professional appearance

A

clear, appealing and uncluttered layout more important than the number of pages

39
Q

Consistent

A

typeface and fonts so that questions, instructions and explanations and examples are clearly delineated

40
Q

First Page must have…

A

why the survey is being conducted
believable and true statements about confidentiality
the due date, how the form is to be returned
title of survey and survey organisation
how long the form should take to fill in

41
Q

Questionnaire

A

Do not mix too many different typefaces
Use boxes and boundaries to clearly define where things should be
Specificc instructions and examples next to the relevant question
Use dot points for instructions and explanations
The design of instructions and explanations is as important as the design of the questions
Consider how data entry is to be done

42
Q

Language issues

A

Assume a reading age of about 12
Simple, non-technical language, e.g. help instead of
facilitate
Avoid negatives

43
Q

Make the meaning clear

A

Provide examples if appropriate
Be specific: who, what, when, where
A question should be about only one topic
Questions should be short, but not at the expense of clarity
Questions can include memory aids such as examples and scene-setting, providing they do not lead the respondent
Do not use double-barreled questions

44
Q

Ordering questions

A

screen people out of questions that do not apply to them with clear sequencing
make it as clear as possible what you want them to do
e.g. use tick one, tick one or more, write here etc
ask general questions first
use transition phrases when changing topics within the
questionnaire

45
Q

Presentation

A

present the answer categories vertically
use booklet form for the questionnaire

For each question on the form ask yourself why you are asking the question

46
Q

Sampling Error

A

Sample survey estimates differ (size) from the result that a complete enumeration

For a probability sample - the size but not direction can be indicated from standard error

Other sampling methods - not possible to estimate

Reduce sampling errors by using probability sampling
methods

47
Q

Types of Errors: Non-sampling Errors

A
Coverage error
Non-response error
Interviewer error
Instrument errors
Mode of data collection
Respondent error
48
Q

Coverage Error

A

some units were not on the sampling frame

49
Q

Non-response error

A

errors because some selected units could not be contacted or refused to provide the information

50
Q

Interviewer error

A

interviewers may affect the responses

51
Q

Instrument errors

A

errors or differences due to the way the questions are asked or the instructions are given

52
Q

Mode of data collection

A

different answers to the same question may be obtained when using different modes

53
Q

Respondent Error

A

errors due to faulty reporting by the respondent

54
Q

Reducing Non-Sampling Error

A

Careful design of survey instrument

Training interviewers

Pretesting the survey

Input editing: Remove any apparently contradictory data items e.g. male but pregnant, employed but under 15, etc

Output editing: Integrity checks, unexpected results, e.g. prevalence of a condition much higher in one state than another