Unit 6: Non-Experimental Research: Survey Research

Question 1

Population

Answer 1

the whole group of interest to the researcher

Question 2

Sample

Answer 2

a small portion of the population that is selected to conduct the study with. They must be representative of the population for results to be externally valid (generalizable)

Question 3

Sampling frame

Answer 3

method of selecting a sample from the population

Question 4

Element

Answer 4

each individual that falls within the sampling frame

Question 5

Open-ended questions

Answer 5

Respondents can answer in their own words.

Question 6

Closed-ended questions

Answer 6

Respondents can only select from a set of response options offered by the researcher

Question 7

social desirability

Answer 7

Giving responses that are deemed to be the most socially-desirable responses, even if they are not in accordance with the subject’s true beliefs.

Question 8

acquiescence

Answer 8

tendency to agree to any response regardless of honesty/contradiction

Question 9

Likert scale

Answer 9

Question that asks for degree of agreement/disagreement on a 5 or 7 point scale

Question 10

response or return rate

Answer 10

The number of people who return a survey

Question 11

simple random sampling

Answer 11

every element has an equal chance of being selected and do not effect the probability of another element being selected. Use random number generator

Question 12

systematic sampling

Answer 12

a sampling technique in which every one doe not have an equal chance of selection (ex. every 5th one)

Question 13

stratified sampling

Answer 13

a random sampling technique in which two or more subsamples are proportionately represented. One subsample may be oversampled, so they are overrepresented in the sample, if they are a small but particularly important subsample.

Question 14

Cluster sampling

Answer 14

A sample selected by using groups or clusters from the population.

Question 15

For what purposes are surveys used?

Answer 15

Surveys are used to describe people’s thoughts, feelings, and opinions. They are used to describe the correlation relationship between variables.

Question 16

What are the characteristics of a survey?

Answer 16

• Involves sampling
• Self-reporting
• response rate
• everyone answers the same questions so results can be compared

Question 17

What is a representative sample?

Answer 17

A sample that accurately represents the characteristics of a population.

Question 18

Why is it important to select a representative sample?

Answer 18

It is important so that results can be generalized to the population and a selection bias does not occur (threat to internal validity).

Question 19

advantages and disadvantages of mail surveys

Answer 19

Advantages: low cost, anonymity, no interviewer bias
Disadvantages: slow response rate, no control over what order the questions are answered in or who answers them, must be self-explanatory

Question 20

advantages and disadvantages of interviews

Answer 20

Advantages: interviewer as motivator, can clarify, higher response rate
Disadvantages: interviewer bias, responses may be tailored, more expensive, no supervision, hard to reach people

Question 21

advantages and disadvantages of phone surveys

Answer 21

Advantages: less expensive, can be supervised, can clarify, easier access to people
Disadvantages: interviewer bias, can’t use visual aids, people screen calls, only good for short interviews

Question 22

advantages and disadvantages of internet surveys

Answer 22

Advantages:
Disadvantages: low cost, fast, easier to reach people,

Question 23

advantages and disadvantages of internet surveys

Answer 23

Advantages: low cost, fast, easier to reach people, control over sequencing, easy to check for errors
Disadvantages: no control over who fills it out, response bias, selection bias, difficult to check other demographic info

Question 24

advantages and disadvantages of using open-ended questions

Answer 24

Advantages: gathers more complete information, more detail;
Disadvantages: barrier to participation, harder to code, bias towards articulate people
Better for small-scale studies and pilot surveys

Question 25

advantages and disadvantages of using closed-ended questions

Answer 25

Advantages: easier to code, easier to participate
Disadvantages: limited responses might not be accurate, reduce expressiveness and unanticipated info.
Better for larger scale studies when a pilot has been done.

Question 26

State the criteria for a useful questionnaire item.

Answer 26

• be clear, concise
• avoid leading or loaded questions
• the key idea has to follow the conditional ideas
• use language familiar to the participant

Question 27

Describe how the ordering of questions in a survey may influence the quality of data.

Answer 27

For self-administered, start with interesting questions to hook the respondent.
For interviewer-led, start with easier questions to warm up.
Have more general followed by more specific.
Use branching to avoid respondent answering redundant questions.

Question 28

Under what circumstances will responses be biased?

Answer 28

• if the researcher/interviewer is biased
• if the respondent doesn’t give honest information
• if the questions are biased

Question 29

How can you avoid acquiescence?

Answer 29

By asking for responses along a scale rather than in binary format - ex. visual scale.

Question 30

What is the response rate or return rate of a survey? What can researchers do to increase the response rate of a survey, particularly a mail survey?

Answer 30

The percentage of sample elements who returned the survey. Should be noted in the discussion.
Include self-addressed, stamped envelopes. Offer incentives.

Question 31

Discuss two limitations of survey research.

Answer 31

1. Does not describe cause-effect relationships

2. Many ways for bias to occur.

Question 32

Briefly describe the ethical issues in conducting survey research. What steps should researchers take to ensure that ethical principles are followed?

Answer 32

Informed consent can be lengthy and determined.

Confidentiality can be an issue.