Chapter 9 - Constructing & Administering Flashcards

1
Q

Surveys

A
  • Focus on group outcomes.
  • Results are presented at the group level
  • Surveys are scored by the percentage of respondents who selected each answer.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Psychological Tests

A
  • Focus on individual outcomes.
  • The results are reported at the individual outcome.
  • Reported in terms of overall derived scores or scaled scores.
  • Sample the behaviours thought to measure an attribute or thought to predict an outcome.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Survey Research Firms

A
  • Companies that specialize in the construction and administration of surveys and analysis of data.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Survey Researchers

A
  • People who design and conduct surveys and analyze their results.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What are good characteristics of surveys?

A
  • Specific and measurable objects
  • Straightforward questions
  • Pretested
  • Good sample
  • Appropriate analysis
  • Accurate reporting of results
  • Reliability and Validity
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Experimental research techniques vs descriptive research techniques

A
  • Experimental: Help determine cause and effect.
  • Descriptive: Help describe a situation or phenomenon.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What research technique are surveys typically used for?

A
  • Descriptive Research Techniques
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What are Helmstadter’s Six Methods for Acquiring Knowledge?

A
  • Tenacity: Based on something we already believe.
  • Intuition: Without any reasoning or inferring.
  • Authority: From a highly respected source.
  • Rationalism: Through reasoning.
  • Empiricism: Through personal experience.
  • Scientific Method: By using the scientific method.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What are the five steps associated with the scientific method while constructing a survey?

A
  • Identifying - Presurvey issues
  • Designing - Construct the survey
  • Conducting - Administer the survey
  • Analyzing - Analyze data
  • Communicating - Communicate the findings
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What’s the first step in preparing a survey?

A
  • Planning the survey objectives
  • The purpose of the survey and what the survey will measure.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is the second step in preparing a survey?

A
  • Establish operational definitions
  • Specific behaviours that represent the purpose
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is the third step in preparing a survey?

A
  • Constructing a plan
  • Includes a list of all the phases and steps necessary, a cost estimate, survey’s development and administration, analysis of data, a timeline
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is involved in the second phase of creating a survey?

A
  • The construction of a survey
  • Involves writing survey questions, preparing the survey instrument, and pretesting the survey
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Self-Administered Surveys

A
  • Those that individuals complete themselves.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Mail Surveys

A
  • Mailed to respondents with instructions for completing and returning them.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Individually Administered Surveys

A
  • Administered by a facilitator in person for respondents to complete in the presence of the facilitator.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Personal Interviews

A
  • Surveys that involve direct contact between the survey researcher and the respondents in person or by phone.
  • Can include face-to-face surveys or telephone surveys.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Face-to-Face Surveys

A
  • The interviewer asks a series of questions in respondents’ homes, a public place, or the researcher’s office.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Telephone Surveys

A
  • Interviewer calls respondents and asks them questions over the phone.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Structured Record Reviews

A
  • Forms that guide data collection from existing records.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Structured Observations

A
  • Forms that guide an observer in collecting behavioural information.
22
Q

What are the stages people go through when answering survey questions?

A
  • Comprehension
  • Retrieval
  • Judgment
  • Response Communication
23
Q

Qualities of good survey questions

A
  • Purposeful and straightforward
  • Unambiguous
  • Correct syntax
  • Appropriate response options
  • Appropriate categorical alternatives
  • Written at a comfortable reading level

-

24
Q

Double-Barreled Questions

A
  • A question that is actually asking two or more questions in one.
25
Q

What happens after we write our survey questions?

A
  • We prepare the survey instrument
  • Create the survey so people want to complete it.
26
Q

What should the front page of a survey include?

A
  • State the purpose of the survey
  • Explain who is sponsoring or conducting the survey
  • Explain why it is important for respondents to complete the survey to the best of their ability
  • Explain how to complete the form
  • Assure confidentiality
  • Thank them for their cooperation
27
Q

What should a survey include?

A
  • Appeal and instructions
  • Headings and subheadings
  • Transitions
  • Response instructions
  • Bold typeface
  • Justification of response spaces
  • Shading/White spaces
  • Good printing/Font
28
Q

Nonsampling Measurement Errors

A
  • Errors associated with the design and administration of the survey
29
Q

What does pretesting allow us to do?

A
  • Identify sources of error
  • Examine the effectiveness of the questions/survey
  • Examine the effect of alternate versions of a question
  • Assess the final version of a survey for understanding, time, and ease
  • Obtain data and make format changes to make analysis more efficient
30
Q

Focus Group

A
  • Bring together people who are similar to the target respondents in order to discuss issues related to the survey.
31
Q

Field Test

A
  • An administration of the survey or test to a large representative group of individuals to identify problems with administration, item interpretation, and so on.
32
Q

Split-Sample Tests

A
  • This method involves field-testing two or more versions of a question, sets of questions, or surveys.
  • Its objective is to find which version gives the most accurate results.
33
Q

Item Nonresponse Rate

A
  • How often an item or question is not answered.
34
Q

What is the third step in administering a survey?

A
  • Actually administering the survey.
35
Q

Probability Sampling

A
  • A type of sampling that uses statistics to ensure that a sample is representative of a population.
36
Q

Simple Random Sampling

A
  • Every member of a population has an equal chance of being chosen as a member of the sample.
37
Q

Systematic Sampling

A
  • A variation of simple random sampling.
  • Every -nth (e.g., every fifth) person in a population is chosen as a member of the sample.
38
Q

Stratified Random Sampling

A
  • Population is divided into subgroups or strata.
  • A random sample is selected from each stratum.
  • The strata should be based on some evidence that they are related to the issue or problem the survey addresses.
39
Q

Cluster Sampling

A
  • Used when it is not feasible to list all of the individuals who belong to a particular population and is a method often used with surveys that have a large target population.
40
Q

Nonprobability Sampling

A
  • A type of sampling in which not everyone has an equal chance of being selected from the population.
  • Often used because they are convenient and less expensive than probability sampling.
41
Q

Convenience Sampling

A
  • The survey researcher uses any available group of participants to represent the population.
42
Q

The Homogeneity of the Population

A
  • How similar the people in your population are to one another.
43
Q

What is the last step of the third phase of creating a survey?

A
  • Distributing the survey.
44
Q

What is the fourth phase of survey development?

A
  • Involves coding and entering the survey data into computer software for analysis.
45
Q

Database

A
  • A matrix in the form of a spreadsheet that shows the responses given by each participant and for each question in the survey.
46
Q

Response Rate

A
  • The number of individuals who responded to the survey divided by the total number of individuals to whom the survey was sent.
47
Q

Univariate Analyses

A
  • Computation of statistics that summarize individual question responses.
48
Q

Bivariate Analyses

A
  • Provide information on two variables or groups.
49
Q

Multivariate Analyses

A
  • Provide information on three or more variables or groups.
50
Q

What are the steps to survey development?

A
  • Preparing the survey
  • Pre-testing the survey
  • Administering the survey
  • Coding, entering, and analyzing data
51
Q

What are the three sets of instructions?

A
  • For the person administering the test
  • For the person taking the test
  • For the person scoring/interpreting the results
52
Q

Testing Environment

A
  • The circumstances under which the test is administered that affect how one may respond.