Everything

Question 1

After performing an evaluation, what methods should always be reported?

Answer 1

1. Participants (always)
2. Procedure (always)
3. Materials (if applicable, or combined)
4. Measures (always, could be before procedure)
5. Data preparation & analysis (if relevant)

Question 2

After performing an evaluation, what should be reported about the participants?

Answer 2

Type of user group
Recruited where/how
Number of participants
Mean age + SD
Gender balance
Other relevant user data
How user data was measured

Question 3

After performing an evaluation, what should be reported about the procedure?

Answer 3

What is the physical set-up
What is the content of the tasks
How are tasks ordered/repeated
When are things measured
Other e.g.: language, length, etc

Question 4

After performing an evaluation, what should be reported about the materials?

Answer 4

What system did people use?
What did the prototype look like?
What hardware was used? (when relevant, e.g. robot/VR headset)

Question 5

After performing an evaluation, what should be reported about the measures?

Answer 5

What do you measure?
How do you measure it?
e.g.:
What questionnaire do you use?
What are the questions?
How do you analyze video?
How do you collect the data?
How do you transcribe the session?

Question 6

After gathering independent normally distributed data with more than 2 means, which test should be performed?

Answer 6

Independent Ancova

Question 7

After gathering normally distributed data with more than 2 paired means, which test should be performed?

Answer 7

Repeated sampled Ancova

Question 8

After gathering normally distributed data with 2 indepedent means, which test should be performed?

Answer 8

Independent T-test

Question 9

After gathering normally distributed data with 2 paired means, which test should be performed?

Answer 9

Paired T-test

Question 10

What are the 12 main usability heuristics?

Answer 10

1. Visibility
2. Consistency
3. Familiarity
4. Affordance
5. Navigation
6. Control
7. Feedback
8. Recovery
9. Constraints
10. Flexibility
11. Style
12. Conviviality

Question 10

What are the 7 main accesibility heuristics?

Answer 10

1. Equitable use
2. Flexibility in use
3. Simple and intiative use
4. Perceptible information
5. Tolerance for error
6. Low physical effort
7. Size and space for approach and use

Question 11

What are the 2 common models for emotion?

Answer 11

1. Arousal/Valence(/Dominance)
2. Discrete emotions (aka Basic emotions e.g. Plutchik (Emotion wheel), Ekman

Question 12

How many participants are necesarry in a focus group?

Answer 12

5-8. Smaller doesnt allow for synergy. Bigger is choatic.

Question 13

When do you want to use a focus group?

Answer 13

1. Market research: collect wish list and requirements
2. Design, i.e. how do people respond to logo, slogan.

Question 14

When do you not want to use a focus group?

Answer 14

1. When you need objective data (reliable detailed usability data)
2. Evaluation, individuals normally don’t have chance to explore or use system in earnest

Question 15

What are the 5 layers of an adaptive agent?

Answer 15

1. Collect input data
2. Interpret data
3. Model the current state of the world
4. Decide upon adaptation
5. Apply adaptation

Question 16

What are the strengths and weaknesses of the wizard of oz?

Answer 16

Strengths:
- Able to perform a evaluation without having the full system working
- Testing futuristic ideas
- Adding simulated and complex vertical functionality

Drawback:
- A human wizard will never fully function as the system would, unexpected changes in true system capability are not taken into account

Question 17

How do you create a wizard of oz?

Answer 17

Think about:
- what the wizard can observe (modalities
- action space: how can the wizard respond
- protocol: how does observation lead to action