user studies

Question 1

framework

Answer 1

steps when designing an experiment

Question 2

objective

Answer 2

purpose and criteria

Question 3

variables

Answer 3

measurements and factors

Question 4

design

Answer 4

structure setup and tasks

Question 5

sampling

Answer 5

who is taking part and how many

Question 6

analysis

Answer 6

conclusions being drawn

Question 7

ethical guidelines

Answer 7

safety
voluntary and not coerced
informed about what the study entails

Question 8

informed consent

Answer 8

filling out a form before the study begins to state that you know what youre doing

Question 9

independant variables

Answer 9

what being controlled and manipulated

Question 10

factors and levels

Answer 10

factors are manipulated across multiple levels and each combination creates a different test

Question 11

dependant variables

Answer 11

what youre measuring
human behaviour and response

Question 12

performance measures

Answer 12

what users do whilst using the system

Question 13

user reported measures

Answer 13

how users feel about the system

Question 14

how do we prevent learning time from skewing results

Answer 14

dividing the study into blocks letting you see if users improve over time as they get used to the system

Question 15

design

Answer 15

structure of the experiment

Question 16

factorial design

Answer 16

number of factors * number of levels

Question 17

within subject design

Answer 17

every participant performs the same task

Question 18

learning effect

Answer 18

may be better the 2nd time as they got to practice the first

Question 19

fatigue effect

Answer 19

tired if the task is demanding
bored/ less attentive if the task is repetitive

Question 20

what are the two order effects

Answer 20

learning and fatigue effects

Question 21

between subject design

Answer 21

participants are put into groups and complete different tasks

Question 22

task

Answer 22

what participants do in the study

Question 23

typical tasks

Answer 23

represent the real application

Question 24

abstract tasks

Answer 24

more control and observes how performance depends on conditions

Question 25

how do we prevent order effect and what does that entail

Answer 25

counterbalancing; participants are divided into groups and are given the test conditions in different orders therefore the tasks are equally represented across participants

Question 26

procedure

Answer 26

specific instructions that guide in completing the tasks and conducting the study