Lecture 5 - Surveys Flashcards
What are some downsides to surveys?
- No chance to clarify or ask follow-ups
- Hard to know how questions are interpreted
- Difficult to adjust after release
What are Surveys?
Any means of aking people for information
When are surveys used?
When we want to measure Knowledge, opinions, behaviours and perception
What are some steps to ensure good Survey Development
- Define variables to measure
- Develop/adapt/find appropriate questions to measure those
- Validate and pilot
When creating a Survey, what is the first step?
Variable Definition: Define variables and come up with question to measure those variables.
What are the 2 type of questions we can use in a Variable Definition?
- Knowledge questions (Pick the correct answear)
- Likert scale questions (How well do you agree with the following statement)
What is true about question development?
- Using several questions for the same variable
- We can use/adapt questions from previous surveys
- Create new questions
4 thing that should be concidered when developing questions?
- Clarity
- Consistecy
- Question order
- Response order
What should be concidered when validating a survey?
- Need to test the survey
- How well it measures what it inteds to measure
- Reliability and consistency
What are the two main approaches to validating a survey?
- Expert review
- Piloting
What is it called when participants are monitored while completing a survey?
Cognitive Interview
What is a benefit of asking participants about their thought and verbal expressions as they complete a survey?
We can see how participants interpret our survey questions and how well they comprehend it
Why do we need to carefully choose our target group for sampling?
Because our sample should accurately represent our target population at large
What is a type of sampeling chooses participants at random where anyone could be selected?
Random Sampling
What type of sampling splits the population into sub-populations based on criteria such as age and gender?
Stratified Sampling
What type of sampling recruits participants who are close at hand, such as friends and social media?
Convenience sampling
What is a drawback when using Convenience sampling?
We cannot know how representative the sample is of the target population
What type of sampling selects “high-value” participants that ar emore likely to generate valuable data?
Purposive Sampling
What type of error can improper sampling result in?
Sampling bias
What type of error stems from invited participants unwillingness to respond to the survey?
No-response bias
We can perform a survey with no bias? True/False?
False! We have to acknowledge and try to minimize bias
Because participants tends to agree with opinions, what can we do to minimize Conformation Bias?
Try to avoid opinionated questions
Why should we randomize questions?
To avoid Question Order Bias
What is Survey Fatigue bias?
If a survey is too long participants will get tired and stop answering questions properly