2. No theme? Flashcards

1
Q

What are performance measures?

A
  • Task success
  • Time on task
  • Errors
  • Click path
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What are advantages of performance measures?

A
  • Statistically valid
  • Clear to explain
  • Easy to compare
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Of what should you be aware when using performance measures?

A
  • Number fetishism

- Cause & effect implications

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is task success?

A

Determines what is success and what is failure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What could failure be?

A
  • Person gives up
  • Time limit reached
  • Researcher intervenes
  • Incorrect answer

Think this through!

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

How can you define success criteria thoroughly?

A

Task with a clear end state

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What are levels of success?

A
  • Requiring assistance (perceived struggle and needed assistance)
  • Difference in journeys (optimal vs. less optimal way)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What are levels of succes in the usability perspective?

A
  • Complete succes (with or without assistance)
  • Partial success (with or without assistance)
  • Failure (user thought was complete but wasn’t or gave up)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What are the 4 levels of succes from the user experience perspective?

A
  1. = No problem
  2. = minor problem
  3. = major problem
  4. failure/gave up
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What does no problem means in the user experience perspective levels of success?

A

The user completed the task successfully without any difficulty or inefficiency.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What does minor problem means in the user experience perspective levels of success?

A

The user completed the task successfully but took a slight detour. He made one or two small mistakes but recovered quickly and was successful.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What does major problem means in the user experience perspective levels of success?

A

The user completed the task successfully but had major problems. She struggled and took a major detour in her eventual successful completion of the task

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What does Failure/gave up means in the user experience perspective levels of success?

A

The user provided the wrong answer or gave up before completing the task or the moderator moved on to the next task before successful completion.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Wat is usage?

A

Tasks that are performed repeatedly

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Why should you be aware of what you expect a good time on task is?

A

Short time on task can mean, not hindered by issues.

Long time on task could mean engagement OR issues

Therefore you should always do a mix of methods. E.g. ask how the user perceived the passage of time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is usage in combination with errors?

A

Error could be the result of an underlying (usability) use

Or symptom of task failure, but NOT reason

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What are errors?

A

The outcomes of usability issues

18
Q

What are slips?

A

Typo, accidental misclick

19
Q

What are mistakes?

A

Clicking on something that is not clickable, entering wrong data, performing the wrong action

20
Q

How do you improve slips?

A

Reduce number of actions required, work on error handling and prevention

21
Q

How do you improve mistakes?

A

Provide better supports, hints, fix UI problems, fix usability study scenario/tasks

22
Q

What is click path?

A

Number and sequence of clicks (actions) needed to complete a task

23
Q

For what are first click test useful?

A

For small tasks or UI considerations

24
Q

What is user testing?

A

Generally scripted product use (tasks, based on user research)

25
Q

What is the usability trap?

A

Only creating what a usability test can measure (avoiding complexity)

26
Q

What is the main idea of log data?

A

Essentially being able to reconstruct (parts of) the interaction of one particular user with a system while also being able to generalize and find patterns

27
Q

What is A + B testing?

A
  • The same as A/B testing, but sequential.
  • –> compare your measures before and after the change was made
  • Within subjects (also bit between)
28
Q

What are analytics compared to usability testing

A
  • Generally collected remotely and asynchronously
  • Larger sample size (but more anonymous)
  • Over time (returning users - learnability, active users, adoption)
  • Allows you to discover patterns in the data
  • Natural product use (no predefined tasks)
29
Q

What are analytics compared to logging?

A
  • Very similar, but then with standardized measures

- Logging can be part of a usability study and an analytics approach

30
Q

What are implicit measurements?

A
  • Psychophysiology
  • Eye tracking
  • Facial behavior analysis
  • Pose, motion tracking
31
Q

How does eye tracking work?

A

The light reflecting from the cornea and the center of the pupil are sued to inform the eye tracker about the movement and direction of the eye

32
Q

What are fixations in eye tracking?

A

100-300ms: visual information is gathered

33
Q

What are saccades in eye tracking?

A

20ms Vision is suppressed

34
Q

What are fixation sequences (scan path) in eye tracking?

A

When, where and for how long people looked at it

35
Q

Which questions can fixation sequences answer?

A
  • Where do people look first?
  • What did they look at before the usability issue occurred?
  • How do people learn from an interface?
36
Q

What is the area of interest (AOI)?

A

a pre-post-selected area on the interface you are interested in researchingg

37
Q

What is facial behavior analysis?

A
  • Focus on strong emotional reactions

- Primitive emotions or action units

38
Q

What is the Facial Action Coding System?

A
  • Systematic description of facial muscle movements and corresponding emotions
  • Basis for face reader software (e.g. lie to me)
39
Q

When do you use the face reader?

A
  • When strong emotional occur
  • When the temporal pattern of emotion is important
  • When strong emotional reactions matter in the usability of the product
40
Q

What are challenges of the face reader?

A
  • Limited to basic emotions and extreme cases

- Unclear what triggered a change in emotion