L6: Usability Evaluation Flashcards
Cognitive walkthroughs are good for testing…
a. Concepts and terminology
b. Layout and design
c. Detailed interaction
a. Concepts and terminology
Which of the following IS NOT TRUE of high fidelity prototyping?
a. Suitable for detailed interaction
b. Avoids superficial distraction
c. Best for final assessment
b. Avoids superficial distraction
Usability evaluations test…
whether a solution is suitable for its users
Functional testing determines
only whether the solution does what you said it would
What is a fidelity?
Refers to the amount of detail present in a screen or page design.
Low-fidelity evaluations can be done at
very early stages
What are the examples of low-fidelity?
- Sketches
- Paper prototypes (including ‘digital’)
- Wireframes(basic)
- No or minimal functionality
What are the examples of medium-fidelity?
- Wireframes
- Digital mock-ups
- Some functionality
What are the examples of high-fidelity?
- Finished designs
2. Usually fully functional but can just be screenshots
What are some good methods to test concepts and terminology?
- Card sorting
- Design (cognitive) walkthroughs
- Reverse card sorting/tree sorting
Expert or heuristic evaluations rely on the
experience and expertise of the evaluator
Benchmark metrics tend to be:
a. Feature-specific
b. Project-specific
c. Goal-oriented
c. Goal-oriented
What are Nielsen’s 10 UI heuristics?
- Visibility of system status
- Match between system and the real world
- User control and freedom
- Consistency and standards
- Error prevention
- Recognition rather than recall
- Flexibility and efficiency of use
- Aesthetic and minimalist design
- Help users recognize, diagnose and recover from errors
- Help and documentation
Visibility of system status
The sytem should always keep users informed about what is going on, through appropriate feedback within a reasonable time
Match between system and the real world
The system should speak the users’ language, with words, phrases and concepts familiar to the user, rather than system-oriented terms
User control and freedom
Users often choose system functions by mistake and will need a clearly marked “emergency exit” to leave the unwanted state without having to go through an extended dialogue.
Error prevention
Even better than good error messages is a careful design which prevents a problem from occurring in the first place.
Recognition rather than recall
Minimize the user’s memory load by making objects, actions, and options visible.
Applying the benchmark consistently allows solutions to be
Compared
Structure, detail, meaning, price, availability are examples of what type of sample metrics
Content
Layout, legibility, color, graphics, consistency are examples of what type of sample metrics?
Visual Design
Terminology, menus, page titles, navigational feedback, back button, consistency are examples of what type of sample metrics?
Navigation
Rewarding to use, interactive features, empowering features, on-page interaction, sense of community are all examples of what type of sample metrics?
Engagement
Paper prototyping:
a. Can be produced at a very early stage
b. Is hard to create, modify and animate
c. Is more intimidating to users
a. Can be produced at a very early stage
Which of the following IS NOT a common usability testing metric?
a. Task success rate
b. Conversion rate
c. Task time
b. conversion rate
Most usability testing focuses on
difficulties users have in achieving their goals
Metrics used for usability testing
- Task success rate
- Task time
- Number of errors
What is a common reading pattern for web pages?
a. ‘F’ pattern
b. ‘G’ pattern
c. ‘E’ pattern
a. ‘F’ pattern
Eye tracking measures
where users fix their gaze
Hardware based eye tracking systems can cost up to
$50,000
What required for eye-tracking measures?
Specialist equipment, software and expertise is required
Multivariate testing is used for:
a. Websites with small traffic
b. Websites with high traffic
c. Mobile apps only
b. Websites for high traffic
Both A/B tests should be shown
at the same time. eg.) Version A shouldn’t be shown on week 1 and then Version B shown on week 2