4. Self-report methods Flashcards
What are self-report methods?
- Quantitative
- Qualitative
- Survey/questionnaires & rating scales
- Diary studies/experience sampling
- UX Curve
What are goals of surveys?
- Profile your user group
- Assess, values, needs, beliefs
- Evaluate design
In which stages does surveys fit in in the model?
- Anticipated UX
- Episodic UX
- Cumultative UX
What are requirements for designing a survey?
- Unambiguous & specific questions
- Mostly close-ended
- Multiple choice
- Checklist
- rating scales
- Preferably no longer than 20 minutes
What are open questions in a survey?
- Free-form
- Fully free
- Set input type (e.g. length of text)
What are listings in a survey?
- “Name the 5 things you like the most about this product?”
- “Name the 5 things you like the least about this product?”
What is the Likert scale in a survey?
- Statement
- Rating level of agreement
- 5- or 7-point scale
What is a semantic differential scale in a survey?
- Pairs of bipolar adjectives
- 5- or 7-point scale
What are frequency scales in a survey?
How frequent do you use Microsoft Excel?
- More than once a day
- Once a day
- Once a week
- etc…
What is the paired comparison scale in a survey?
Of the two website you visited today, which did you prefer?
- Enterprise
- Budget
What is Single Ease Questions (SEQ) in a survey?
Overall how difficult or easy did you find this task
- Very difficult
- Very easy
(7 point Likert-scale dus)
What is the System Usability score?
Standardized scale for perceived usability and learnability
How do you interpret the System Usability Score?
- <50: not acceptable
- 50-70: marginal
- > 70: acceptable
How do you calculate the SUS score?
- Assign numeric values 0-4
- Invert items, 2,4,6,8,10
- Sum scores
- Multiply by 2,5 for score on 100-point scale
When do you use diary studies?
- Tracking everyday prolonged product usage
- Following specific type of (long-term) experience
- Remote testing of working prototypes or products
- When context is important
- Studying appropriation
What are different entry schedules for diary studies?
- Fixed (every day, every week, ..)
- Variable (e.g. prompted by researcher or activity/incident)
–> Experience sampling
How long and often do you conduct diary studies?
At least half a dozen incidents of your topic of interest
What are different diary formats?
- Classical: paper booklets
- Voice messages
- Dedicated online apps
What are advantages and disadvantages of the classical diary format?
- Easy to use, easy to bring anywhere
- Cheap, no tech skills required
- No way to monitor completion
What are advantages and disadvantages of the voice messages diary format?
- Expressive
- Easy to use anywhere
- Very limited possibilities, not always suitable
What are advantages and disadvantages of the dedicated online apps diary format?
- Easy monitoring, easy to remind
- Multimedia exercises (= high expressiveness)
- Requires technical skills to develop
What is the UX curve?
It is a retrospective method (memory)
Participants draw one or more curves to describer how the experience about a product changed over time
What should you present in your findings?
Types of data gathered
- Task performance
- Attitude (self-report, interview)
- Usability issues
What should you present during task performance?
- Task success
- Time on task
- Errors
