Module 3

Question 1

What is a A test plan?

Answer 1

A test plan is a tool used to organize and structure an evaluation

Question 2

What is Experimental Design?

Answer 2

A way to structure the evaluation to answer the research questions.

Question 3

What are three main types of experimental design used in UX evaluation?

Answer 3

1. Between-Subjects Design,
2. Within-Subjects Design and
3. Correlational Design.

Question 4

What is a between subject design ?

Answer 4

A between subject design assigns participants
to a single experimental condition and compares the results between groups.

Question 5

What is Within-Subjects Design?

Answer 5

Each subject is consecutively and randomly exposed
to all of the different experimental manipulations.

It involves comparing two versions of the same application,
participants will perform the test tasks on both applications.

Question 6

How long should a usability test last?

Answer 6

A usability test should not last more than one hour
to avoid participant fatigue.

Question 7

What is a correlation study?

Answer 7

A correlational study is carried out
on a homogeneous sample of participants
who must perform a certain number of tasks with the evaluation object.

Question 8

How can you reduce bias in recruitment particpants?

Answer 8

with a pre-registration process

Question 9

How many participants are needed to test a hypothesis?

Answer 9

A minimum of 12 participants (14 incase of no show)

Question 10

What is the goal of the tasks?

Answer 10

The goal is to be able to evaluate if the participant completes the task
within these conditions of success.

Question 11

What is The task success rate?

Answer 11

The task success rate is a binary variable that represents the completion, or not, of a task by a participant

Question 12

How do we report the Task Success Rate?

Answer 12

Generally, the success rate is reported in the form of a ratio; and not a percentage. ( so as not to mislead the reader on the possibility of inferring the results to the general population.)

Question 13

What is the Task Completion Rate?

Answer 13

Completion time is the time it takes for participants to successfully complete the task or achieve a a goal and is usually linked to the success rate.

Question 14

How to report the Task Completion Time?

Answer 14

Generally, completion time is reported in minutes and seconds.