Chapter 9 - Evaluation Flashcards
1
Q
Evaluation
A
- Summative evaluation
- – assesses for aspects of usability of finished system
- – good system can evolve through generating, representing, testing, refining ideas
- Formative evaluation
- – usable interfaces never produced spontaneously by designer
- – process produces good usability through evolution
- – data derived will point to strengths & weaknesses of proposed system
- – provides ways of learning about design options, user group, task space by deep analysis of proposed systems
2
Q
Observational evaluation
A
Choice between user observation & user experimentation
- observation
- Emphasis on real tasks and environment
- real users and system tested and observed
- experimentation
- rigour & replicability of results
3
Q
Observational evaluation problems
A
- hawthorne effect
- observer bias
- halo effect
4
Q
Designing Observations
A
- tasks
- users
- environment
- 1 or 2 significant functional requirement
5
Q
Verbal Protocol
A
record that contains
- description of environment
- tasks completed by user
- users background & demographic details
- users comments, body language, facial expressions record
- aspects of interface that responses relate to
6
Q
How To Conduct Session
A
- choose task
- select users
- explain purpose to users
- conduct evaluation
7
Q
Transcript
A
- data available at the end of session
- commentary, including user’s interpretation what’s seen, expectations and response to what happened
- – categories include frequency, fundamentality
8
Q
stock walkthrough questions to be asked at each step of task
A
- will user be trying to achieve right effect
- will user know correct option is available
- will user realise correct option
- will user understand feedback to correct option
9
Q
summative vs formative evaluation
A
summative
-assesses finished system for aspects of usability
formative
-produces good usability through evolution, deep analysis of proposed designs
10
Q
comments categories (2)
A
- frequency
- fundamentality
