Chapter 10A Flashcards

1
Q

Conceptual Models?

A

Mental representation of how the object works and how interface controls effect it

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Design model should equal customer’s model?

A

Mismatches lead to errors

Use customer’s likely conceptual model to design

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Design guides?

A

Make things visible
Map interface controls to customer’s model
Provide feedback

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Goals of evaluation?

A

Access extent of system functionality
Access extent of interface on user
Identify specific problems

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Evaluation through Expert Analysis?

A

Cognitive Walkthrough
Heuristic Evaluation
Model-Based
Review-Based evaluation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Evaluation through User Participation?

A

Laboratory studies

Field studies

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Cognitive Walkthrough?

A

Proposed by Polson

  • Evaluates design on how well it support user in learning task
  • Usually performed by expert in cognitive psychology
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

For each task walkthrough considers?

A

What impact will interaction have on user?
What cognitive processes are required?
What learning problems may occur?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Analysis focuses on?

A

Goals and knowledge: does the design lead the user to generate the correct goals.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

The 3 Questions?

A

Will the correct action be sufficiently evident to the user?
Will the user notice that the correct action is available?
Will the user associate and interpret the response from the action correctly?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Advantages and Problems of Cognitive Walkthrough?

A

Few ethical & practical issues to consider because users are not involved.
Can be difficult & expensive to find experts.
Best experts have knowledge of application domain and users

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Biggest problems of Cognitive Walkthrough?

A

Important problems may get missed
Many trivial problems are often identified
Experts have biases

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Heuristic Evaluation?

A

Proposed by Nielsen and Molich
Usability criteria (heuristics) are identified
Design examined by experts to see if these are violated

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Example heuristics?

A

System behaviour is predictable
System behaviour is consistent
Feedback is provided

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Heuristic evaluation _____ design?

A

debugs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Why do User Testing?

A

Can’t tell how good UI is until?
- People use it

Expert review methods are based on evaluators who:?

  • May know too much
  • May not know enough

Hard to predict what real users will do

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

User Testing Requires an?

A

Artefact

- Simulation, prototype, full implementation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Laboratory Studies Advantages?

A

Specialist equipment available

Uninterrupted environment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Laboratory Studies Disadvantages?

A

Lack of context

Difficult to observe several users cooperating

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Field Studies Advantages?

A

Natural Environment
Context Retained
Longitudinal Studies Possible

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Field Studies Disadvantages?

A

Distractions

Noise

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Experimental Factors?

A

Subjects
Variables
Hypothesis
Experimental Design

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Ethical Considerations?

A

Usability tests can be distressing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Alleviating issues regarding Ethical Considerations?

A

Make voluntary with informed consent
Avoid pressure to participate
Let them know they can stop at any time
Stress that you are testing the system, not them
Make collected data as anonymous as possible

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Preparing for a Test?
``` Select your customers Prepare scenarios that are - Typical of the product during actual use - Make prototype support these Practice to avoid "bugs" ```
26
Four Roles of Conducting a Test?
Greeter - puts users at ease and gets data Facilitator - only team member who speaks Computer - knows application logic Observers - take notes and recommendations
27
Wizard of Oz technique?
Faking the interaction
28
User Test Proposal?
A report that contains - Objective - Description of system being tested - Task environment and materials - Participants - Methodology - Tasks - Test measures
29
The tasks must?
Encourage participation
30
Order of Tasks?
Choose one simpler order
31
Training?
Depends how real system will be used
32
What if someone doesn't finish?
Assign very large time and large # of errors or remove and note
33
Pilot study?
Helps you fix the problems of the study | Do two, first with colleagues, then with real users
34
Keeping variability down?
Recruit test users with similar background | Brief users to bring them to common level
35
Debriefing test users?
Often don't remember, so demonstrate or show video segments | Ask for comments on specific features
36
Two types of data to collect?
Process Data - Observations of what users are doing and thinking - Qualitative Bottom-Line data - Summary of what happened - Dependent variables - Quantitative
37
Why focus on process data first?
Gives good overview of where problems are?
38
Evaluating Results?
``` Sort and prioritize observations - What was important - Lots of problems in the same area Create a written report on findings - Gives agenda for meeting on design changes Make changes and iterate ```
39
Evaluation Methods?
``` Think Aloud Cooperative evaluation Protocol Analysis Automated Analysis Post-Task Walkthrough Query Techniques ```
40
Think Aloud?
Users observed performing the task, describe what he/she is doing and why
41
Advantages of Think Aloud?
Simplicity -requires a little expertise Can provide useful insight Can show how system is actually use
42
Disadvantages of Think Aloud?
Subjective Selective Act of describing may alter task performance
43
Steps to Think Aloud?
Prompt/Encourage the user to keep talking Only help on things you have pre-decided Recording
44
Instructions to Participants?
Describe the purpose of evaluation Tell them they can quit anytime Demonstrate the equipment
45
Cooperative Evaluation?
Variation on think aloud where the interviewer cooperates with the user
46
Cooperative Evaluation Advantages?
Less constrained and easier to use User is encouraged to criticize system Clarification possible
47
Protocol Analysis?
Tools: * Paper and pencil * Audio * Video * Computer logging * User notebooks
48
Automated Analysis Advantages?
Analyst has time to focus on relevant incidents | Avoid excessive interruption of task
49
Automated Analysis Disadvantages?
Lack of freshness | May be post-hoc interpretation of events
50
Interviews?
Analyst questions user on one-to-one basis usually based on prepared questions
51
Interview Advantages?
Can be varied to suit context Issues can be explored more fully Can elicit user views and identify unanticipated problems
52
Interview Disadvantages?
Very subjective | Time consuming
53
Questionnaires?
Set of fixed questions given to users
54
Advantages of Questionnaires?
Quick and reaches large user group | Can be analyzed more rigorously
55
Disadvantages of Questionnaires?
Less flexible | Less probing
56
Questionnaires styles of questions?
``` General Open-ended Scalar Multi-choice Ranked ```
57
Emotional Response Linked to?
Physical changes | These may help determine a user's reaction to an interface
58
Using the Test Results?
Summarize the data What does data tell you? Update tasks & rethink design
59
Measuring Bottom-Line Usability?
Situations in which numbers are useful | Ease of measurement
60
Two Alternatives (Groups)
Between Groups Experiment | Within Groups Experiment
61
When in process?
Design vs Implementation
62
Style of evaluation?
Laboratory vs field
63
How objective?
Subjective vs objective
64
Type of measures?
Qualitative vs quantitative
65
Level of information?
High level vs low level
66
Resources available?
time, subjects, equipment, expertise