Evaluation Flashcards
What is the purpose of the evaluation stage?
To assess the effectiveness of the final product/solution in meeting its goals and objectives, and to identify opportunities for improvement based on user feedback and performance metrics.
When does evaluation occur?
After the implementation stage once the final product has been developed
Who should perform the evaluation?
It should be done by a diverse group of stakeholders.
Why is evaluation necessary?
To gather feedback, measure performance, and identify opportunities for improvement in order to ensure that the product/solution meets its intended goals.
Describe the following types of evaluation, in general terms.
* Expert Reviews
* Usability Testing
* Surveys
* Acceptance Tests
* Evaluation During Active Use
Expert Reviews involves usability experts evaluating an interface design.
Usability Testing involves real users interacting with an interface.
Surveys collect feedback from users through questionnaires or interviews.
Acceptance Tests determine if a system meets requirements.
Evaluation During Active Use involves monitoring how users interact with a system in their normal environment to identify issues and opportunities for improvement.
Describe the following types of expert reviews
* Heuristic Evaluation
* Guidelines Review
* Consistency Inspection
* Cognitive Walkthrough
* Formal Usability Inspection
Heuristic Evaluation: A usability inspection method where a group of evaluators systematically evaluate the interface against a set of usability principles or guidelines.
Guidelines Review: A review of the interface design and usability guidelines to determine if they have been met.
Consistency Inspection: A review of the interface design to ensure that it is consistent with other products or systems within the same category.
Cognitive Walkthrough: A method for evaluating the usability of an interface from the perspective of a new user.
Formal Usability Inspection: A structured approach for evaluating the usability of a system or product, involving a team of experts who use a predefined set of criteria and procedures to identify potential usability problems.
Describe the following types of usability testing.
* Think aloud about what they are doing
* Videotaping
* Field Tests
* Paper Mockups
* Can-you-break-this
* Competitive Usability Testing
Think-aloud testing: Participants explain what they are doing and thinking while using the interface.
Videotaping: Participants are recorded while using the interface for later analysis.
Field tests: Testing is conducted in the real-world environment where the system will be used.
Paper mockups: Low-fidelity prototypes are used to test early design concepts.
Can-you-break-this: Participants are encouraged to try to break the system to identify potential issues.
Competitive usability testing: Participants compare and evaluate multiple similar products or designs to determine which is most usable.
What must be done at the start of the survey process?
Clearly define the objectives and target audience.
What is an acceptance test?
Conducted by client or end user to ensure that the product or system meets the agreed upon requirements and specifications before it’s release.
Discuss 5 measurable criteria that can used be for acceptance testing of user interfaces.
- Performance
- Accessibility
- Compatibility
- Functionality
- Usability
Describe the four points that are considered when choosing the evaluation method.
- Development Stage
- Available Resources
- Purpose of evaluation
- Target user Group
What are the 5 evaluation methods
Expert reviews
Usability testing
Surveys
Acceptance tests
Evaluation during use
