6.6.1: Quantitative User-Research Methodologies: An Overview

Question 1

Original Link

Answer 1

https://www.nngroup.com/articles/quantitative-user-research-methods/

Question 2

When you want to gather numerical data about your product’s user experience, what is the first step to take?

Question 3

What are benefits of Quant research (4 listed in this article)

Question 4

Understanding Statistical Significance

…statistically significant

Answer 4

https://www.nngroup.com/articles/understanding-statistical-significance/

Question 5

Design Tradeoffs and UX Decision Frameworks

Answer 5

https://www.nngroup.com/courses/design-tradeoffs/

Question 6

Return on Investment for Usability

Answer 6

https://www.nngroup.com/articles/return-on-investment-for-usability/

Question 7

Name popular types of quant research (9 types)

Question 8

1. Quantitative Usability Testing (Benchmarking)

Use:
Tracking usability over time
Comparing with competitors
Cost: Medium
Difficulty of Collection: Medium
Difficulty of Analysis: Medium
Type of Method: Behavioral (what people do)
Context of Use: Task-based

Question 9

Write Better Qualitative Usability Tasks: Top 10 Mistakes to Avoid
(…perform realistic tasks)

Answer 9

https://www.nngroup.com/articles/better-usability-tasks/

Question 10

Success Rate: The Simplest Usability Metric

…success

Answer 10

https://www.nngroup.com/articles/success-rate-the-simplest-usability-metric/

Question 11

Between-Subjects vs. Within-Subjects Study Design

…structure

Answer 11

https://www.nngroup.com/articles/between-within-subjects/

Question 12

Writing Tasks for Quantitative and Qualitative Usability Studies
(…tasks)

Answer 12

https://www.nngroup.com/articles/test-tasks-quant-qualitative/

Question 13

2. Web Analytics (or App Analytics)

Uses: 
Detecting or prioritizing problems
Monitoring performance
Cost: Low
Difficulty of Collection: Low
Difficulty of Analysis: High
Type of Method: Behavioral (what people do)
Context of Use: Live

Question 14

Three Uses for Analytics in User-Experience Practice

…analytics data

Answer 14

https://www.nngroup.com/articles/analytics-user-experience/

Question 15

VIDEO differences between analytics and quant usability testing

Answer 15

https://www.nngroup.com/videos/analytics-vs-quantitative-usability-testing/

Question 16

3. A/B Testing or Multivariate Testing

    Use: Comparing two design options
    Cost: Low
    Difficulty of Collection: Low
    Difficulty of Analysis: Low
    Type of Method: Behavioral (what people do)
    Context of Use: Live

Question 17

Multivariate vs. A/B Testing: Incremental vs. Radical Changes

Answer 17

https://www.nngroup.com/articles/multivariate-testing/

Question 18

Putting A/B Testing in Its Place

A/B Testing is often abused

Answer 18

https://www.nngroup.com/articles/putting-ab-testing-in-its-place/

Question 19

4. Card SortingUse: Determining information-architecture labels and structures
   Cost: Low
   Difficulty of Collection: Low
   Difficulty of Analysis: Medium
   Type of Method: Attitudinal (what people say)
   Context of Use: Not using product

Question 20

Terms

Answer 20

OptimalSort (card-sorting platform)

Question 21

Mental Models

Answer 21

https://www.nngroup.com/articles/mental-models/

Question 22

5. Tree TestingUse: Evaluating information-architecture hierarchies
   Cost: Low
   Difficulty of Collection: Low
   Difficulty of Analysis: Medium
   Type of Method: Behavioral (what people do)
   Context of Use: Task-based, not using product

Question 23

Tree Testing: Fast, Iterative Evaluation of Menu Labels and Categories

Answer 23

https://www.nngroup.com/articles/tree-testing/

Question 24

6. Surveys and QuestionnairesUse: Gather information about your users, their attitudes, and behaviors
   Cost: Low
   Difficulty of Collection: Low
   Difficulty of Analysis: Low
   Type of Method: Attitudinal (what people say)
   Context of Use: Any

Question 25

Beyond the NPS: Measuring Perceived Usability with the SUS, NASA-TLX, and the Single Ease Question After Tasks and Usability Tests
(…established questionnaires available)

Answer 25

https://www.nngroup.com/articles/measuring-perceived-usability/

Question 26

7. Clustering Qualitative DataUse: Identifying important themes in qualitative data
   Cost: Low
   Difficulty of Collection: Medium
   Difficulty of Analysis: Medium
   Type of Method: Attitudinal (what people say)
   Context of Use: Any

Question 27

Diary Studies: Understanding Long-Term User Behavior and Experiences
(…diary studies)

Answer 27

https://www.nngroup.com/articles/diary-studies/

Question 28

8. Desirability StudiesUse: Identifying attributes associated to your product or brand
   Cost: Low
   Difficulty of Collection: Low
   Difficulty of Analysis: Low
   Type of Method: Attitudinal (what people say)
   Context of Use: Task-based

Question 29

Desirability Studies: Measuring Aesthetic Response to Visual Designs
(…quantitative desirability studies)

Answer 29

https://www.xdstrategy.com/desirability-studies/

Question 30

Using the Microsoft Desirability Toolkit to Test Visual Appeal
(…list of descriptive words)

Answer 30

https://www.nngroup.com/articles/microsoft-desirability-toolkit/

Question 31

9. Eyetracking TestingUse: Determining which UI elements are distracting, findable, or discoverable
   Cost: High
   Difficulty of Collection: High
   Difficulty of Analysis: High
   Type of Method: Behavioral (what people do)
   Context of Use: Task-based

Question 32

How to Conduct Eyetracking Studies

Answer 32

https://www.nngroup.com/reports/how-to-conduct-eyetracking-studies/

Question 33

First Influential factor
Start with a (general vs specific) research question to determine…

Second Influential factor
But also consider…

Question 34

VIDEO: 6.6.2: Analytics vs. Quantitative Usability Testing

Answer 34

https://www.springboard.com/workshops/ui-ux-design-career-track/learn#/curriculum/32259

Question 35

What similarities do analytics and quantitative usability testing have? differences?