Brainscape's Knowledge GenomeTM

Browse over 1 million classes created by top students, professors, publishers, and experts.


See full index

RS: Usability & User experience Evaluation > 4. Self-report methods > Flashcards

4. Self-report methods Flashcards

1
Q

What are self-report methods?

A
  • Quantitative
  • Qualitative
  • Survey/questionnaires & rating scales
  • Diary studies/experience sampling
  • UX Curve
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What are goals of surveys?

A
  • Profile your user group
  • Assess, values, needs, beliefs
  • Evaluate design
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

In which stages does surveys fit in in the model?

A
  • Anticipated UX
  • Episodic UX
  • Cumultative UX
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are requirements for designing a survey?

A
  • Unambiguous & specific questions
  • Mostly close-ended
  • Multiple choice
  • Checklist
  • rating scales
  • Preferably no longer than 20 minutes
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What are open questions in a survey?

A
  • Free-form
  • Fully free
  • Set input type (e.g. length of text)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What are listings in a survey?

A
  • “Name the 5 things you like the most about this product?”

- “Name the 5 things you like the least about this product?”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is the Likert scale in a survey?

A
  • Statement
  • Rating level of agreement
  • 5- or 7-point scale
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is a semantic differential scale in a survey?

A
  • Pairs of bipolar adjectives

- 5- or 7-point scale

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What are frequency scales in a survey?

A

How frequent do you use Microsoft Excel?

  • More than once a day
  • Once a day
  • Once a week
  • etc…
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is the paired comparison scale in a survey?

A

Of the two website you visited today, which did you prefer?

  • Enterprise
  • Budget
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is Single Ease Questions (SEQ) in a survey?

A

Overall how difficult or easy did you find this task

  1. Very difficult
  2. Very easy

(7 point Likert-scale dus)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is the System Usability score?

A

Standardized scale for perceived usability and learnability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

How do you interpret the System Usability Score?

A
  • <50: not acceptable
  • 50-70: marginal
  • > 70: acceptable
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

How do you calculate the SUS score?

A
  • Assign numeric values 0-4
  • Invert items, 2,4,6,8,10
  • Sum scores
  • Multiply by 2,5 for score on 100-point scale
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

When do you use diary studies?

A
  • Tracking everyday prolonged product usage
  • Following specific type of (long-term) experience
  • Remote testing of working prototypes or products
  • When context is important
  • Studying appropriation
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What are different entry schedules for diary studies?

A
  • Fixed (every day, every week, ..)
  • Variable (e.g. prompted by researcher or activity/incident)

–> Experience sampling

17
Q

How long and often do you conduct diary studies?

A

At least half a dozen incidents of your topic of interest

18
Q

What are different diary formats?

A
  • Classical: paper booklets
  • Voice messages
  • Dedicated online apps
19
Q

What are advantages and disadvantages of the classical diary format?

A
  • Easy to use, easy to bring anywhere
  • Cheap, no tech skills required
  • No way to monitor completion
20
Q

What are advantages and disadvantages of the voice messages diary format?

A
  • Expressive
  • Easy to use anywhere
  • Very limited possibilities, not always suitable
21
Q

What are advantages and disadvantages of the dedicated online apps diary format?

A
  • Easy monitoring, easy to remind
  • Multimedia exercises (= high expressiveness)
  • Requires technical skills to develop
22
Q

What is the UX curve?

A

It is a retrospective method (memory)

Participants draw one or more curves to describer how the experience about a product changed over time

23
Q

What should you present in your findings?

A

Types of data gathered

  1. Task performance
  2. Attitude (self-report, interview)
  3. Usability issues
24
Q

What should you present during task performance?

A
  • Task success
  • Time on task
  • Errors
25
Q

What should you present about errors?

A
  • Average number of errors per task (include SD)
  • Where errors happen
  • Common nature between errors
26
Q

What should you present when reporting quantitative data?

A
  • Ratings often traded as interval
  • Report means (+ SD)
  • Top-box scores (% of people who scored maximum)
  • Some validated scales (SUS, UEQ) also come with a benchmark
27
Q

What should you report with usability issues?

A
  • Number of unique issues (comparing between iterations)
  • Frequency of issues per participant (overall usability)
  • Frequency of participants per issue (severity of an issue)
28
Q

What are the columns in the findings summary table?

A
  1. Issue type
  2. Issues
  3. Page
  4. recommendations
  5. Ease of fixing

RS: Usability & User experience Evaluation (5 decks)

Brainscape helps you reach your goals faster, through stronger study habits.
© 2024 Bold Learning Solutions. Terms and Conditions