Usability Testing Flashcards
Define the purpose of usability testing.
Conducted to evaluate how well a system can be used by the target users to accomplish a specified goal.
Define the purpose of accessibility testing.
Conducted to ensure that users of all abilities can successfully use the product. Considered a subset of usability testing.
What three factors should be considered during usability testing? List and define.
- Efficiency: how much effort is required to accomplish a goal?
- Effectiveness: is the desired result achieved?
- User satisfaction: is the user “happy” with the software?
What is the main focus of usability testing? What is a useful approach when determining the focus?
Focus should be on areas that will be most frequently used. Useful to compare an existing product that has complex interfaces and a high number of technical support issues.
What is sampling? When is it useful and what kind of test does this serve as?
Type of testing that provides information regarding expected user experience by allowing testing across the overall UI.
Useful when usage of a new software is anticipated but not known. Can serve as a breadth-based test.
What is depth-based testing? (i.e., where is it used?)
Used in areas where extensive usage is expected.
What type of usability testing results in the best coverage over a short period of time?
Combination of breadth and depth based testing.
Describe who usability test participants are and what type of training and skills they have.
Usability is a specialized discipline that uses usability experts with training in psychology and design. Professional testers often work closely with usability experts to design tests.
Usability experts should represent the skill levels and knowledge of actual users.
Explain how usability tests are planned and designed.
Test plan should be formally documented with guidelines for observer behavior. Users are observed without interference from the observer.
How are users in usability testing categorized?
Users are categorized into personas: a representation of a type of user. Often given specific characteristics (age, gender, profession), and their activities can be evaluated against the personas.
Define user experience (UX).
Refers to a person’s perceptions of and responses to the software before, during, and after usage.
What is formative testing and how is it done? Who normally assists with usability testing in Agile?
Conducted as the software is being designed (BEFORE it is coded), done with written description, wireframes, or prototypes.
The PO normally assists to ensure the product meets expectations.
Where are formal and informal usability tests typically conducted? Describe the environments, equipment, and test design.
Formal: tests are conducted in a usability lab; may use audio and video recording devices, as well as software to track eye movements.
Informal: conducted in office settings
Tests are ideally conducted in an environment that closely mimics the user’s work environment; user manuals and process documents can also be tested for correctness.
How are results and feedback gathered in usability testing? (List two.)
- Defect reports
- Questionnaire/surveys
What are the two international standards that deal with usability?
- ISO 9241-210: discusses human-centered design, based on understanding the expected use, specifying requirements, producing solutions, evaluating solutions, and designing the best solution to meet the usability requirements.
- ISO 25010: describes the quality characteristic called usability
