Evaluation of datavis

Question 1

What are the possible purposes of a visualization? (5)

Answer 1

1. explore
2. explain
3. inform
4. plan
5. monitoring

Question 2

What makes a good visualization? (6)

Answer 2

1. Serve a purpose
2. Tailored to an audience
3. Tailored to the medium
4. Do a task/insight
5. Is memorable and makes an impact
6. illustrates a point

Question 3

What makes a bad visualization? (5)

Answer 3

1. Difficult to interpret
2. Misleading
3. Redundant
4. Much useless information
5. Cluttered

Question 4

What do you need to know before designing a visualization? (2)

Answer 4

1. Caracteristics of the data

2. Goals and tasks

Question 5

Define usability:

Answer 5

the extent to which a product can be used by specified users to achieve specified goals with
effectiveness, efficiency, and satisfaction in a specified context of
use

Question 6

Define effectiveness:

Answer 6

to what extent users achieve their objective

Question 7

Define efficiency:

Answer 7

The amount of effort users put into the task

Question 8

Define satisfaction:

Answer 8

Subjective opinions, attitudes, preferences

Question 9

Which are the categories empirical evaluations methods can belong to? (2)

Answer 9

1. Quantitative

2. Qualitative

Question 10

Which metrics do we measure in controlled experiments? (2)

Answer 10

1. Accuracy for effectiveness

2. Completion time for efficiency

Question 11

Which are the issues we may have in quantitative evaluations? (3)

Answer 11

1. Challenge to involve users
2. Reliability of the measure
3. Reproducibility of the measure

Question 12

Which are the issues we may have in qualitative evaluations? (3)

Answer 12

1. plenty of labor required
2. unclear sample size
3. Investigator’s dependent data quality

Question 13

Which is the goal of qualitative evaluation?

Answer 13

Gather information about subjective experience of users

Question 14

Does qualitative evaluation only collect subjective data?

Answer 14

False, it collects both objective and subjective data

Question 15

List some qualitative approaches: (7)

Answer 15

1. Think-Aloud protocol
2. Semi-structured interviews
3. Video and audio recordings
4. Computer logs
5. Artifacts (diagrams, drawings)
6. Focus groups
7. Questionnaires

Question 16

What are combined studies?

Answer 16

Studies using two or more evaluation methods (quantitative and qualitative)

Question 17

What is the pro of combined studies?

Answer 17

Robust results

Question 18

Which are the categories of heuristic evaluation?

Answer 18

1. Inspection techniques (principles)

2. Theoretical analysis (algorithms)