User Research: Methods and Best Practices Flashcards

1
Q

Aim of User Research

A

Place people – users – at the center of the design of your product (tangible or not tangible).

—To drive your design
—To assess the value of your solutions
—To assess the impact of your product

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is User Research?

A

Covers a wide range of methods!
—Ethnographic interviews with target group
—Classical usability studies
—Quantitative measurements of return on investment (ROI) on UX design

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

User Research Methods - Quantitative Research

A

—Surveys
—Formal Experiments
—Systematic Observation
Provide measures of user behaviour, in the form of statistics which can be analysed.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

User Research Methods - Qualitative Research

A

—Diary accounts
—In-depth interview
—Focus groups
—Ethnography
—Usability tests (to some degree)
Provide deep understanding of the experiences and daily routines of the users.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Which Research Methods to choose?

A
  • Identify your goal
  • What are you trying to identify?
  • What is the nature of your project?
  • What is your budget?
  • What is your time span?
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Meaningful Designs

A

Get to know who will be using your design
Design Thinking first rule is to empathise with your user
* Identify several users and conduct interviews and observations in their natural contexts
* In the beginning of the design… and validate ideas throughout project’s lifetime

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Easy and Enjoyable Designs

A

High Level of Usability
* Users have to LOVE to experience your design… otherwise they will love others’ product
* How…? User Tests

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is the ROI of your design?

A

Invisible effort until product is finished!
* Invest on user studies to show that the iterations with users returned on more sales!
* User studies: A/B testing or user patterns

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Timeline for Design (6)

A

Research - Research to develop understanding about your users
Define - Compile research and observe where user’s problems exist
Ideate - Generate wide range of ideas
Prototype - Build real tactile representation of ideas
Test - Return to users for feedback
Implement - Launch product and go back to step 1 for next release

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Design Development process

A

Project start
Define user requirements
Concept design
User testing of prototypes
Detailed design
Field trials (ROI)
Project launch

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

If there is no user? (new app?)

A

Integrate user research:
—As soon as possible
—Schedule enough time
—If there is not enough resources prioritise the things that you can apply user research
—Start with paper prototype!

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Searching for Users

A
  • Choose users that have the same characteristics that your aimed user
  • Target at all age groups involved
  • Recruit participants who represent your target group/end users
  • Be aware that recurring to colleagues to perform tests may come with some bias
  • Promote the inclusion of people with disabilities
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

User requirements and how to look for

A

Requirements
* Age
* Location
* Experience

How to look for?
* In your network
* Posting on social media
* In specialized forums

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Research Plan

A
  1. Purpose: what you want to find out and how you are going to get it?
  2. Method: Depends on time and budget constraints. For example, Direct observations with a user; online survey; qualitative interviews, etc.
  3. Participants
  4. Location
  5. Script
  6. Consent: What type of data is going to be collected; Who is going to have access to data; Participation is completely voluntary
  7. Communication
  8. Timeplan
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Movie streaming App - 1. Purpose

A

The purpose of this study is to find out how/when our target group watches movies. When, where and how does watching movies interleave with the other daily routines? There is the need to understand these issues in order to develop features that are most relevant to our group.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Movie streaming App - 2. Method

A

We will do 8-10 interviews to understand how and when they watch streamed movies

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Movie streaming App - 3. Participants

A

People aged 18-35, who use movies on-demand app and watch at least 1 movie per week. Due to time constraints we will recruit in the proximity through our network and social media.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Movie streaming App - Questions

A

How often do you watch a movie per week?
In what circumstances do you watch such movie?
Where do you watch?
Can you describe a typical situation?

19
Q

Movie streaming App - Data and Analysis

A

Interviews will be video recorded, using two cameras.
A thematic analysis to discover the main themes.

20
Q

Movie streaming App - 4. Location

A

Interview participations at home or in the park because they are places where watching movies occur.
Have the opportunity to see the kind of equipment used

21
Q

Movie streaming App - 5. Script

A

Introduce yourself and the study – make sure that every participant has the same information.

Ask permission to video record and establish privacy issues.

Questions may be posed in different order to engage the participants.

Possible tasks that participants have to perform.

22
Q

Movie streaming App - 6. Consent

A

Send an email with the explanation of the study and the on the day explain it again!

23
Q

Movie streaming App - 7. Communication

A

We plan to bring a designer to be present during the interview. A the end of the research we plan to do a workshop to brainstorm some ideas from the results. A document with all the research will be written.

24
Q

Movie streaming App - 8. Time plan

A

The recruit of participations occur on week X. The interviews on week X+2, followed by the analysis and the workshop should occur at week X+4.

25
Q

Ethics and User Research

A

Why? Humans
Responsible for participants welfare, being completely open about what we do with data, and keep them safe.

How:

  • Be honest
  • Be sensitive
  • Be truthful about your participants
  • Obtain Consent
  • Do no Harm
  • Be conscious about user data
  • Participants’ time is precious
26
Q

Be honest (Ethics and User Research)

A
  • Tell the truth about the purpose
  • Tell to whom you work for
  • Tell what are the results for

Imagine that your participants hate company X … what should you do? Be honest

27
Q

Be sensitive (Ethics and User Research)

A
  • Put yourself in the shoes of the participant
  • Reassure your participants that there are no correct behaviors
  • Be aware of cultural limitations!
28
Q

Be truthful about your participants (Ethics and User Research)

A
  • Represent what participants do or express honestly
  • Leave preconceived ideas out of the research
  • Do not think that you do know everything
  • Be truthful about how many ideas support your previous thoughts
  • Quoting is an excellent way of communicating results + number of opinions
29
Q

Obtain Consent (Ethics and User Research)

A
  • Inform about what you are doing, how you are doing and for what you are doing!
  • Be aware of local policies!
30
Q

Be conscious about user data (Ethics and User Research)

A
  • Guarantee the anonymity of the data, so take care of how you keep the data
  • When quoting find some fictional name
  • Think about how long do you need to store the data of the user research
31
Q

Usability Testing - Why?

A
  • Do we meet user expectations
  • Business decisions match user needs
  • Uncovering errors
  • Discover how users perform tasks
  • Are we doing the right things?
  • Get opinions!
  • Cheaper to stop and make changes to prevent a catastrophe!
32
Q

Types of Usability Tests

A

Low fidelity Tests (paper prototypes)

High fidelity tests (fully functional prototypes)

Down the hall tests

33
Q

4-step Process for Usability Tests

A
  1. Create a test plan
  2. Facilitate the test
  3. Analyze case data
  4. Create test report
34
Q
  1. Create a test plan (Process for Usability Tests)
A

Scope of work
Recruit users
Identify objectives

35
Q
  1. Facilitate the test (Process for Usability Tests)
A

Observe users
Identify issues
Identify solutions

36
Q
  1. Analyze case data (Process for Usability Tests)
A

Assess user behavior
Analyze user click path
Identify problem areas

37
Q
  1. Create test report (Process for Usability Tests)
A

Review video footage
Identify design issues
Identify best practices

38
Q

Core elements of Usability Testing

A

Facilitator - Guides participant through test
Tasks - Realistic activities participant might perform
Participant - Realistic user of product

39
Q

Usability Test Metrics - Objective Metrics

A

Time on task: How long did it take the participant to complete the task

Effort: E.g. count nr of clicks necessary to complete the task.

Nr. of confusions: Count the nr of times the participants express confusion or doubt.

Nr. of errors: Count the nr of times the participant makes an incorrect action when trying to complete their task.

Success rate: Count how many users were able to complete a task.

Failure rate: Count how many users where not able to complete a task.

Partial success: Measure if users are able to complete subsets of the task.

40
Q

Usability Test Metrics - Subjective Metrics

A

During the test:

  • Stress responses: Note when the user appears stressed.
  • Confusions: Note when the user appears confused or expresses confusion.

After the test:

Ask the participants to rate:
- Subjective Satisfaction
- Perceived effort or difficulty
- How the interface looks

Interview the participants about:
- Thoughts and opinions
- Confusions
- Did the interface meet their expectations

41
Q

Preparing an Usability Test Plan - Before

A

—Areas to Focus
—Potential usability issues
—What tasks will be tested
—How many users?
—Which groups of users? → Personas!
—Which groups are more important?
—What part of the product is going to be tested?
—Goals for testing each part

42
Q

Preparing an Usability Test Plan - Test Plan

A

Goal
Test tasks (scenarios)
End states (answers)
Equipment needed

43
Q

Preparing an Usability Test Plan - During

A

Introduce the users to the test
Purpose of the test (emphasise that there are no correct or wrong and that every answer is a help!)
Give a list of tasks to be completed with your product
Think Out Loud (researcher to follow!)
Move along tasks whenever you are ready!
I would be happy to answer your questions at the end

44
Q

What are Ethnographic Interviews

A

Ethnographic interviews are used by social scientists and educators today to get the informant’s or interviewee’s perspective on their beliefs, values, and understandings of life and other topics or cultural events.