Surveys And Questionnaire Construction

Question 1

What are the hallmarks of surveys?

Answer 1

• Primarily focused on breadth not depth of phenomena

- Conducted through questionnaires

Question 2

What kinds of questionnaires are there?

Answer 2

• Open ended questions
  
  • Exploratory research
• Closed ended questions
  
  • Causal, correlational, or descriptive research
  • To operationalise a theoretical framework

Question 3

What different manners of conducting surveys?

Answer 3

• Face to face
• Self administered
• Post
• Online/others

Question 4

What kinds of survey designs are there?

Answer 4

• Cross sectional (correlational)
• Longitudinal (causal)
• Panel (causal)

Question 5

What is a cross sectional survey design?

Answer 5

• A study in which various segments of a population are samples an data
  are collected at a single moment in time
• Prone to common method variance

Question 6

What is common method variance (CMV)?

Answer 6

• Variance in a variable that is attributable to the measurement method rather than to the constructs the measures represent
• A source of systematic measurement error
• Common method of measurement of IV and DV can inflate the correlation between them. Can be considered as self-report bias
• Highlight problems of single-source questionnaires

Question 7

What is a longitudinal survey design?

Answer 7

• A survey of respondents at different times, thus allowing analysis of changes over time
• Temporal separation of IVs from DV
• Tracking study - compare trends and identify changes
• Can help CMV

Question 8

What is a panel survey design?

Answer 8

• A longitudinal survey of the same sample of individuals or households to record their attitudes, behaviour or purchasing habits over time
• Can help reduce CMV

Question 9

What types of survey questionnaires are there?

Answer 9

• Open ended
  
  • Ask respondents to answer questions in any way they choose
• Closed-ended questions
  
  • Ask the respondent to make choice among a set of alternatives given by the researcher

Question 10

What are the components of a questionnaire?

Answer 10

• Cover letter
• General instructions & scale instructions
• Sets of questions sectioned with generic headings
• Demographics of participants at beginning or end

Question 11

What are the pros of using a questionnaire?

Answer 11

• Empirical data
• Wide and inclusive
• Conducive to quantitative data analysis
• Cost and time

Question 12

What are the cons of using a questionnaire?

Answer 12

• Detail and depth
• Accuracy and honesty of responses
• Typically yield low response rates which can lead to sampling error

Question 13

How can measurement error be avoided in survey research?

Answer 13

• Adhere to principles of measurement by using existing validate and reliable scales
• Piloting
• Multi-Source surveys in cross sectional designs to allay CMV
• Increasing response rates

Question 14

What are the components of total survey error?

Answer 14

• Random sampling error

* Systematic/measurement error (bias)

Question 15

How does random sampling error relate to surveys?

Answer 15

• Statistical fluctuation that occurs because of the chance variation in elements selected for the sample.
• Can only be minimised by increasing sample size

Question 16

How does random systematic/measurement error relate to surveys?

Answer 16

• Results form imperfect aspects of research design or from a mistake in the execution of it, and also from repsondents
• Discrepancy between observed score and true scores of a construct

Question 17

What kinds of random systematic/measurement errors are there in regards to surveys?

Answer 17

• Administrative

* Respondent

Question 18

What are examples of administrative errors in surveys?

Answer 18

• Unreliable scales
• Construct and content invalid scores
• Inappropriate instrucitons
• Too long means hurried unreliable responses
• Data processing error
• Sample selection error
• Interviewer effects on an examiner

Question 19

What kinds of respondent errors are there in regard to surveys?

Answer 19

• Non response

* Response Bias

Question 20

What are non response errors in regards to surveys?

Answer 20

• People who do not participate
• A reflection of sampling design and number of respondents
• Response rates are an accepted index for non-repose error
• Low response rates reflect a self-selection bias
  
  • Over represents extreme positions
  • Under-represents indifference

Question 21

What is a response bias in regards to surveys?

Answer 21

• A bias that occurs when respondents tend to answer questions with a certain slant that consciously or unconsciously misrepresents the truth
• Deliberate falsification or unconscious misrepresentation
  
  • Social desirability bias
  • Acquiescence bias
  • Extremity bias

Question 22

What is the difference between methodology and methods?

Answer 22

• Methodology refers to the underlying philosophy/approach and how the research was conducted
• Methods are the specific means of data collection
• Survey vs questionnaire/interview
• Case study vs interviews/focus group
• Ethnography vs observation
• Experimental design vs laboratory/field