Lecture 13: User Testing Flashcards
What are the THREE kinds of user tests?
- Formative Evaluation
- Field Study
- Controlled Experiment
What is the formative evaluation method?
The formative evaluation method finds problems for the next iteration of the design, it involves evaluating the prototype or implementation in lab on chosen tasks. The results will produce qualitative observations.
There are 6 stages to conducting the formative evaluation method of user testing.
What is the Field Study method?
The field study finds problems in context, and evaluates the working implementation in real context on real tasks. The field study results will provide mostly qualitative observations with some quantitative observations.
What is the Controlled Experiment method?
The controlled experiment tests a hypothesis, and evaluates working implementation in controlled lab environment on chosen tasks. The controlled experiment results in mostly quantitative observations: time, error rate, satisfaction etc.
What can usability be measured in?
- Qualitative - stress responses, subjective satisfaction, perceived effort or difficulty.
- Quantitative - time on task, success / failure rates and effort: number of clicks / perception of progress.
What is the user observation method?
- Tester selects the task to be completed
- User is given the task and access to the interface
- User navigates through the system and tries to complete the task.
- User speaks all thoughts aloud.
- Tester watches the user and records all spoken thoughts and reactions for later evaluation.
What is the Think Aloud method?
The think aloud method is when the user testing is taking place the user speaks their thoughts aloud, the tester stays quiet and does not respond to questions. If the user is quiet, the tester can prompt them.
What are the FOUR advantages of the Think Aloud method?
- Gives insight into what the user is thinking
- Usable in early iterations
- Shows whether user understands system image
- Most widely used evaluation method in industry
What are the THREE disadvantages of the Think Aloud method?
- May alter the way users do the task - take longer and slower to complete tasks
- Unnatural - awkward and uncomfortable
- Hard to talk if they are concentrating.
In the formative evaluation method, what are the six stages to conducting the user test?
- Develop the test plan.
- Select and acquire participants
- Prepare test materials
- Run a pilot test
- Conduct the real test
- Analysis and final report
What is the facilitator’s role?
The facilitator does the briefing, provides the tasks, prompts the user to think aloud by asking questions and controls the session and prevents interruptions.
What is the user’s role?
The user needs to complete the task and should think aloud.
What is the observer’s role?
The observer is quiet and take notes.
