class 1-TSE overview Flashcards

0
Q

Demming (1994)

A

first listing of sources of problems-beyond sampling issues
classification of factors affecting the usefulness of a survey
-bias of the auspices
- bias from late reports
- bias from unrepresentative selection of the date for the survey

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
1
Q

Total survey error

A

an indicator of data quality measured by the accuracy of the mean square error of the estimate

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Demming (1994)-errors

A
nonresponse
sampling
interviewer effects
mode
estimation step errors (wrong weighting)
NO COVERAGE ERRORS- drawing a sample in a population
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Kish (1965)

A

-focus on biases
separates errors of observation and non observation
-does not note that sampling errors are errors of non observation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

analytic errors

A

emerging research

estimation step errors

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Types of non sampling biases

A

non observation

observation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

types of Sampling biases

A

frame biases
consistent sampling bias
constant statistical bias

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Mode error bias

A

differing responses based on mode of administration

e.g., variance- answer quickly in internet mode

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Four components of error

A

frame errors-missing elements, improper use of clustered frames
sampling errors
non response errors- item non response, unit non response
measurement errors

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

sources of observation errors

A
field-data collection
office-processing
interviewer
respondent
instrument
mde
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

sources of non observation errors

A

non coverage
non response
sampling

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Bias

A

systematic differences between expected value of survey estimate and population value

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

non observation errors

A

departure of survey estimate from pop value because of failures to measure some pop measure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Specification error

A

“construct validity”

Do we measure what we planned to measure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

observation errors

A

departure of survey estimate from pop because of deficiencies in the measurement process

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Total Survey Design- Dalenius (1974)

A

Requirements-everyone needs to respond
Specifications-contact households in person
Operations- fieldwork stops after 5 attempts

16
Q

Groves (1989)

A

linkage between TSE and psychometric true score theories and measurement error and selection bias

17
Q

Intro to Survey Quality (2003) Biemer and Lyberg

A

division of sampling and non sampling error
adds specification error
fitness of use- usability of surveys

18
Q

variance

A

dispersion (over replications) of departures between survey estimate and expected value of survey estimate

19
Q

total survey error evolution

A

began as a way to caution against focusing on sampling error only
contains statistical and non stat notions
1970s- attention to total survey design
1980-1990s- include psychometric

20
Q

understudied in TSE

A
Specification error
processing error
bias
linkage errors
estimation errors
21
Q

weakness of TSE

A
Exclusion of key quality concepts
-a user perspective
lack of routine measurement
ineffective on proff standards
burden on design of some estimators
22
Q

Indicator quality

A

credibility
relevance
estimator quality
data quality

23
Q

credibility

A

fairness
independence
transparency
integrity

24
Q

relevance

A

promptness
completeness
effectiveness

25
Q

estimator quality

A

accuracy

revisability

26
Q

data quality

A

reliability
validity
confidentiality
response burden

27
Q

Strengths of TSE

A

Separation of whats affecting stats differently
conceptual foundation of survey meth
able to identify problems in research

28
Q

TSE and costs

A

efforts to reduce errors increase costs