Surver research

Question 1

Name all types of reliability

Answer 1

Test-retest

alternate form reliability

internal consitency

inter-observer

Question 2

Test-retest reliability

Answer 2

Ask the same respondents to complete the
survey questions at different times.
If the correlation, , between the first set of
answers and the second is greater than 0.7,
we can assume that test-retest reliability is
good.

Question 3

alternate form reliability

Answer 3

Test-retest reliability
suffers from practice
effect and recall
problems.
Solution: Give the same
respondents different
versions of the
questionnaire with
questions being
reworded or reordered.

Question 4

internal conscistency reliability

Answer 4

Ask group of questions that measure
different aspects of the same concept.
We want to make sure that these aspects
are consistent with respect to the overall
concept.

Question 5

Inter-observer (inter-rater) reliability:

Answer 5

We need to check whether or not different
observers give similar answers when they
assess the same situation.
Krippendorff’s
(see Hayes & Krippendorff (2007))

Question 6

name all types of validity

Answer 6

content validity

criterion validity

construct validity

Question 7

content validity

Answer 7

Subjective assessment of how appropriate
the instruments seems to a group of
reviewers with knowledge of the subject
matter.

Question 8

criterion validity

Answer 8

Compares one instrument to another
instrument.

Question 9

construct validity

Answer 9

Assess the extent to which different data
collection approaches produce similar
results.
Often requires many years of experience to
assess it.

Question 10

Name two survey instrument validation

Answer 10

Focus groups
Pilot studies