Lecture 8 Flashcards

1
Q

Surveys are valuable tools for ____ ____ and anyone wanting to collect original data to _____ a population that is …

A
  • social scientists
  • describe
  • too large to observe directly
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Prevalence of polls (and telemarketers) may have ______ the status of surveys in the eyes of the public.

A

diminished

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Survey:

A

technique that seeks to determine present practices or opinions of a specified population

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Questionnaire:

A

type of paper and pencil or electronic survey in which information is obtained by asking participants to respond to questions rather than by observing their behaviour

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

The purpose of survey design is to provide _____ or _____ description of _____, _____, or _____ of a population by studying a sample of that population.

A
  • quantitative
  • numeric
  • trends
  • attitudes
  • opinions
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Most common type of descriptive research:

A

survey research

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Pros of survey research:

A
  • Can solicit info from large populations.
  • Best at determining current opinion or trends in a population.
  • Can provide a basis for making broad based comparisons &
    decisions
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Cautions of survey research:

A
  • must ensure the population is adequately represented
  • reliant on the honesty of the respondent
  • very difficult to establish cause and effect
  • difficult to gain the underlying reason for the info solicited
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

5 methods of a survey method plan:

A
  • the survey design
  • the population and sample
  • creating and pretesting an instrument
  • variables in the study
  • data analysis and interpretation
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Survey design:

A

a plan for quantitative or numeric description of trends, attitudes, or opinions of a population by studying a sample of the population

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

In the survey design, we indicate why a survey is the ____ type of data collection procedure for the study, examine the _____ of this design for the study.

A
  • preferred

- advantages

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

2 types of survey design:

A
  • cross section

- longitudinal

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Cross-section survey design:

A

participants assessed at one point in time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Longitudinal survey design:

A

following participants over time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

In a survey design, we must specify the form of ____ _____, examine the _____ and ______ for the ones chosen.

A
  • data collection

- strengths and weaknesses

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Types of data collection:

A
  • telephone
  • mail
  • drop-off
  • internet surveys
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

A challenge of questionnaires is that you only get responses to ….

A

the questions that you ask (if you ask a poor question, you may not get the types of responses that you were expecting)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

When posing questions, make sure that the question _____ to the respondent.

A

applies

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

When posing questions, make sure the question is ______ ______.

A

technically accurate

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

When posing questions, ask ____ _____ at a time.

A

one question

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

When posing questions, use _____ and _____ words.

A
  • simple

- familiar

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

When posing questions, use ____ and ____ words to specify the concepts clearly.

A
  • specific

- concrete

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

When posing questions, use ___ words as possible to pose the question.

A

few

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

When posing questions, use ____ sentences with ____ sentence structures.

A
  • complete

- simple

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

When posing questions, make sure ___ means _____ and ____ means ____ (ie. avoid ____ _____).

A
  • yes means yes
  • no means no
  • double negatives
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

When posing questions, be sure that the question specifies the ____ _____.

A

response task

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

In the population and sample stage, identify the ____ in the study, state the _____ of the population, means of _____ individuals in the population, and _____ of sample frames.

A
  • population
  • size
  • identifying
  • availability
28
Q

In the population and sample stage, we need to specify if the sampling design will be:

A
  • single stage

- multi stage

29
Q

Single stage sampling design:

A
  • there is access to the names of the people in the population
  • they may be sampled directly
30
Q

Multi stage sampling design:

A

will identify groups or organizations who will assist in the gathering the names of individuals who will be sampled

31
Q

In the population and sample stage, we need to identify the _____ process for the sample.

A

selection

32
Q

In the population and sample stage, we need to indicate if the population and subsequent sample will be _____ based on …

A
  • stratified
  • specific population characteristics
  • eg. age, gender, income levels, education
33
Q

In the population and sample stage, we need to discuss how sample will be _____ from available lists.

A

selected

34
Q

In the population and sample stage, we need to indicate the ____ of people in the sample and the ____ used to compute this number.

A
  • number

- procedures

35
Q

In the population and sample stage, attention must be given to the _____ of the population that will be included in the:

A
  • percentage/fraction
  • sample
  • margin of error
  • confidence interval
  • confidence level
  • response rate
36
Q

The ____ ____ will dictate the type of participants you need for the study.

A

research question

37
Q

In the population and sample stage, we need to ensure sampling/participants are ______ for your chosen research design and methods.

A

appropriate

38
Q

The greater the variability in your outcomes, the _____ sample size needed to find _____.

A
  • larger

- significance

39
Q

In the population and sample stage, we need to think about _____ considerations (_____), such as…

A
  • practical
  • feasibility
  • time, money, resources
  • participant availability
40
Q

In creating and pretesting an instrument stage, we need to name the survey ____ used to collect data.

A

instrument

41
Q

When using an existing instrument, describe the established ____ _____ from previous use.

A

validity scores

42
Q

Validity scores in a survey identifies ….

A

whether the instrument is a good one to be used

43
Q

3 components of validity scores;

A
  • construct
  • content
  • criterion
44
Q

Construct (validity scores):

A

how one translates the idea or construct into something real or concrete

45
Q

Content (validity scores):

A

a check of the operationalization against the relevant content domain of the construct

46
Q

Criterion (validity scores):

A

the validation of a measure based on its relationship to another independent measure as predicted by your theory of how the measures should behave

47
Q

In creating and pretesting an instrument stage, we need to mention whether scores resulting from past use of the instrument demonstrate _____.

A
  • reliability
  • test-retest correlations
  • consistency in test administration and scoring
48
Q

In the pilot testing phase, survey should be tested with a sample as _____ to the sample used in the ____ ____ ______ as possible.

A
  • similar

- full survey presentation

49
Q

4 stage process for pilot testing:

A
  • review by knowledgeable colleagues and analysts
  • interview with potential survey respondents to evaluate each question
  • conduct a small pilot test
  • a final check from a small group of individuals with no role in survey development or revisions
50
Q

The variables in the study phase is useful in the _____ section to relate the variables to ____ _____ and items on the _____.

A
  • methods
  • research questions
  • instrument
51
Q

The variables in the study phase allows the reader to easily determine how the _____ ______ connects to the variables and _____ or _____.

A
  • data collection
  • question
  • hypotheses
52
Q

The variables in the study phase allows for ____-______ the variables, the _____ or ______, and specify ____ ____.

A
  • cross-referencing
  • questions
  • hypotheses
  • survey items
53
Q

Steps for analyzing the data in data analysis and interpretation phase:

A
  1. report response rate
  2. determine response bias: the effect of nonresponses on survey estimates
  3. discuss plan to provide descriptive analysis
  4. check instrument’s scales
  5. statistics and statistical computer program for inferential statistical analyses
  6. present and interpret results
54
Q

The the data analysis and interpretation phase, report how the results answered the _____ ____ or _____.

A
  • research question

- hypotheses

55
Q

The the data analysis and interpretation phase, discuss the ______ for the results for practice or _____ research on the topic. Draw _____ and ____ from results.

A
  • implications
  • future
  • inferences
  • conclusions
56
Q

2 questions asked when looking at error in survey research:

A
  • how closely the responding sample is representative of the population
  • how well the questionnaire answers measure the characteristics to be described
57
Q

2 errors related to how closely the responding sample is representative of the population:

A
  • sampling error

- frame (coverage) error

58
Q

sampling error:

A

occurs when a sample drawn from the population is not representative of the entire population

59
Q

Frame (coverage) error:

A

occurs when the list from which the sample is drawn fails to contain all members of the population

60
Q

2 errors related to how well the questionnaire answers measure the characteristics to be described:

A
  • response error

- nonresponse error

61
Q

Response error:

A
  • occurs when the respondent is unable or unwilling to respond to all items in a survey as a result of the communication process
  • do not answer truthfully to items
62
Q

Nonresponse error:

A

extent to which individuals included in the sample fail to provide usable responses (systematically different from those who respond to the survey)

63
Q

Falling response rates:

A

less effective surveys = % of surveys that are returned compared to the # sent out

64
Q

potential reasons for falling response rates:

A
  • changing cultural norms of cooperation
  • overexposure to academic and marketing surveys
  • increasing concerns regarding confidentiality
65
Q

Benefits of internet surveys:

A
  • potentially allow to reach more of the population
  • 24/7 data collection
  • ease of delivery
  • easy storage
  • provide less threatening approach for sensitive data
66
Q

Costs of internet surveys:

A
  • sources of error (frame, sampling, measurement)
  • ethical issues
  • level of expertise required