2. No theme? Flashcards
What are performance measures?
- Task success
- Time on task
- Errors
- Click path
What are advantages of performance measures?
- Statistically valid
- Clear to explain
- Easy to compare
Of what should you be aware when using performance measures?
- Number fetishism
- Cause & effect implications
What is task success?
Determines what is success and what is failure
What could failure be?
- Person gives up
- Time limit reached
- Researcher intervenes
- Incorrect answer
Think this through!
How can you define success criteria thoroughly?
Task with a clear end state
What are levels of success?
- Requiring assistance (perceived struggle and needed assistance)
- Difference in journeys (optimal vs. less optimal way)
What are levels of succes in the usability perspective?
- Complete succes (with or without assistance)
- Partial success (with or without assistance)
- Failure (user thought was complete but wasn’t or gave up)
What are the 4 levels of succes from the user experience perspective?
- = No problem
- = minor problem
- = major problem
- failure/gave up
What does no problem means in the user experience perspective levels of success?
The user completed the task successfully without any difficulty or inefficiency.
What does minor problem means in the user experience perspective levels of success?
The user completed the task successfully but took a slight detour. He made one or two small mistakes but recovered quickly and was successful.
What does major problem means in the user experience perspective levels of success?
The user completed the task successfully but had major problems. She struggled and took a major detour in her eventual successful completion of the task
What does Failure/gave up means in the user experience perspective levels of success?
The user provided the wrong answer or gave up before completing the task or the moderator moved on to the next task before successful completion.
Wat is usage?
Tasks that are performed repeatedly
Why should you be aware of what you expect a good time on task is?
Short time on task can mean, not hindered by issues.
Long time on task could mean engagement OR issues
Therefore you should always do a mix of methods. E.g. ask how the user perceived the passage of time
What is usage in combination with errors?
Error could be the result of an underlying (usability) use
Or symptom of task failure, but NOT reason