Chapter 10A Flashcards

1
Q

Conceptual Models?

A

Mental representation of how the object works and how interface controls effect it

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Design model should equal customer’s model?

A

Mismatches lead to errors

Use customer’s likely conceptual model to design

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Design guides?

A

Make things visible
Map interface controls to customer’s model
Provide feedback

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Goals of evaluation?

A

Access extent of system functionality
Access extent of interface on user
Identify specific problems

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Evaluation through Expert Analysis?

A

Cognitive Walkthrough
Heuristic Evaluation
Model-Based
Review-Based evaluation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Evaluation through User Participation?

A

Laboratory studies

Field studies

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Cognitive Walkthrough?

A

Proposed by Polson

  • Evaluates design on how well it support user in learning task
  • Usually performed by expert in cognitive psychology
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

For each task walkthrough considers?

A

What impact will interaction have on user?
What cognitive processes are required?
What learning problems may occur?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Analysis focuses on?

A

Goals and knowledge: does the design lead the user to generate the correct goals.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

The 3 Questions?

A

Will the correct action be sufficiently evident to the user?
Will the user notice that the correct action is available?
Will the user associate and interpret the response from the action correctly?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Advantages and Problems of Cognitive Walkthrough?

A

Few ethical & practical issues to consider because users are not involved.
Can be difficult & expensive to find experts.
Best experts have knowledge of application domain and users

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Biggest problems of Cognitive Walkthrough?

A

Important problems may get missed
Many trivial problems are often identified
Experts have biases

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Heuristic Evaluation?

A

Proposed by Nielsen and Molich
Usability criteria (heuristics) are identified
Design examined by experts to see if these are violated

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Example heuristics?

A

System behaviour is predictable
System behaviour is consistent
Feedback is provided

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Heuristic evaluation _____ design?

A

debugs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Why do User Testing?

A

Can’t tell how good UI is until?
- People use it

Expert review methods are based on evaluators who:?

  • May know too much
  • May not know enough

Hard to predict what real users will do

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

User Testing Requires an?

A

Artefact

- Simulation, prototype, full implementation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Laboratory Studies Advantages?

A

Specialist equipment available

Uninterrupted environment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Laboratory Studies Disadvantages?

A

Lack of context

Difficult to observe several users cooperating

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Field Studies Advantages?

A

Natural Environment
Context Retained
Longitudinal Studies Possible

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Field Studies Disadvantages?

A

Distractions

Noise

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Experimental Factors?

A

Subjects
Variables
Hypothesis
Experimental Design

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Ethical Considerations?

A

Usability tests can be distressing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Alleviating issues regarding Ethical Considerations?

A

Make voluntary with informed consent
Avoid pressure to participate
Let them know they can stop at any time
Stress that you are testing the system, not them
Make collected data as anonymous as possible

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

Preparing for a Test?

A
Select your customers
Prepare scenarios that are
- Typical of the product during actual use
- Make prototype support these
Practice to avoid "bugs"
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

Four Roles of Conducting a Test?

A

Greeter - puts users at ease and gets data
Facilitator - only team member who speaks
Computer - knows application logic
Observers - take notes and recommendations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

Wizard of Oz technique?

A

Faking the interaction

28
Q

User Test Proposal?

A

A report that contains

  • Objective
  • Description of system being tested
  • Task environment and materials
  • Participants
  • Methodology
  • Tasks
  • Test measures
29
Q

The tasks must?

A

Encourage participation

30
Q

Order of Tasks?

A

Choose one simpler order

31
Q

Training?

A

Depends how real system will be used

32
Q

What if someone doesn’t finish?

A

Assign very large time and large # of errors or remove and note

33
Q

Pilot study?

A

Helps you fix the problems of the study

Do two, first with colleagues, then with real users

34
Q

Keeping variability down?

A

Recruit test users with similar background

Brief users to bring them to common level

35
Q

Debriefing test users?

A

Often don’t remember, so demonstrate or show video segments

Ask for comments on specific features

36
Q

Two types of data to collect?

A

Process Data

  • Observations of what users are doing and thinking
  • Qualitative

Bottom-Line data

  • Summary of what happened
  • Dependent variables
  • Quantitative
37
Q

Why focus on process data first?

A

Gives good overview of where problems are?

38
Q

Evaluating Results?

A
Sort and prioritize observations
- What was important
- Lots of problems in the same area
Create a written report on findings
- Gives agenda for meeting on design changes
Make changes and iterate
39
Q

Evaluation Methods?

A
Think Aloud
Cooperative evaluation
Protocol Analysis
Automated Analysis
Post-Task Walkthrough
Query Techniques
40
Q

Think Aloud?

A

Users observed performing the task, describe what he/she is doing and why

41
Q

Advantages of Think Aloud?

A

Simplicity -requires a little expertise
Can provide useful insight
Can show how system is actually use

42
Q

Disadvantages of Think Aloud?

A

Subjective
Selective
Act of describing may alter task performance

43
Q

Steps to Think Aloud?

A

Prompt/Encourage the user to keep talking
Only help on things you have pre-decided
Recording

44
Q

Instructions to Participants?

A

Describe the purpose of evaluation
Tell them they can quit anytime
Demonstrate the equipment

45
Q

Cooperative Evaluation?

A

Variation on think aloud where the interviewer cooperates with the user

46
Q

Cooperative Evaluation Advantages?

A

Less constrained and easier to use
User is encouraged to criticize system
Clarification possible

47
Q

Protocol Analysis?

A

Tools:

  • Paper and pencil
  • Audio
  • Video
  • Computer logging
  • User notebooks
48
Q

Automated Analysis Advantages?

A

Analyst has time to focus on relevant incidents

Avoid excessive interruption of task

49
Q

Automated Analysis Disadvantages?

A

Lack of freshness

May be post-hoc interpretation of events

50
Q

Interviews?

A

Analyst questions user on one-to-one basis usually based on prepared questions

51
Q

Interview Advantages?

A

Can be varied to suit context
Issues can be explored more fully
Can elicit user views and identify unanticipated problems

52
Q

Interview Disadvantages?

A

Very subjective

Time consuming

53
Q

Questionnaires?

A

Set of fixed questions given to users

54
Q

Advantages of Questionnaires?

A

Quick and reaches large user group

Can be analyzed more rigorously

55
Q

Disadvantages of Questionnaires?

A

Less flexible

Less probing

56
Q

Questionnaires styles of questions?

A
General
Open-ended
Scalar
Multi-choice
Ranked
57
Q

Emotional Response Linked to?

A

Physical changes

These may help determine a user’s reaction to an interface

58
Q

Using the Test Results?

A

Summarize the data
What does data tell you?
Update tasks & rethink design

59
Q

Measuring Bottom-Line Usability?

A

Situations in which numbers are useful

Ease of measurement

60
Q

Two Alternatives (Groups)

A

Between Groups Experiment

Within Groups Experiment

61
Q

When in process?

A

Design vs Implementation

62
Q

Style of evaluation?

A

Laboratory vs field

63
Q

How objective?

A

Subjective vs objective

64
Q

Type of measures?

A

Qualitative vs quantitative

65
Q

Level of information?

A

High level vs low level

66
Q

Resources available?

A

time, subjects, equipment, expertise