Lecture 4 - Evaluation Flashcards
1
Q
Formative Evaluation
A
Not public, just a draft with all the information that needs to be evaluated
- Exploratory
- Informs the design process
- Gives insight into design problem and solution
2
Q
Summative Evaluation
A
- Conclusive
- Assesses the success and quality of the design
3
Q
Quantitative
A
- About result of Human Robot Interaction
- Systematic
- Empirical/numerical data
4
Q
Qualitative
A
- About the process of HRI
- Meaning of / description of
- Non-numerical data
5
Q
Simulation Types
A
- Artificial interactions
- Mock-up interactions
6
Q
Simulation
A
They evaluate:
- Technical performance
- System behavior
7
Q
User Study
A
- Real people /End users
- Essential for user-centered design
8
Q
User study - In the lab
A
- More control
- Lower validity
9
Q
User study - In the wild
A
- Less Control
- More validity
10
Q
Types of evaluation
A
- Exploration
- Comparison
- RCT
- Pilot
- Hybrid
11
Q
Exploration Goals
A
- Gain insight into processes
- Generate research questions/hypotheses
12
Q
Exploration Characteristics
A
- Formative
- Qualitative
- One condition
- Less strict
- Low-medium # participants
13
Q
Comparison Goals
A
- Validate design
- Measure the effect of the design
14
Q
Comparison Characteristics
A
- Compares robot with and without designed behavior
- Summative
- Quantitative
- Strict procedure
- Medium-high # participants
15
Q
RCT Goals
A
- Validate Solution
- Measure effectiveness
