07 Physical & Body-based UIs Flashcards
Physical User Interface Definition
- computer controlled interactive physical device
- situated in a real-world setting
- extends interaction beyond a classical screen
physical embedding vs. physical interactions
Embedding: Make use of objects situated in everyday physical settings
Interactions: Make use of natural body movement (physical interactions)
Types of physical UIs
Gestural Interaction Multi-modal Interaction Tangible User Interfaces Topics Virtual and Augmented Reality Wearable Computing Brain-Computer Interfaces
Types of Gestures
Deictic gestures -> Pointing and selecting
Manipulative gestures -> Manipulating an object
Symbolic gestures -> Mapping a symbol to a function (e.g., drawing X to delete)
Co-verbal gestures -> Gesturing during speech communication
Static gestures -> Holding a pose (e.g., often used for free-hand gestures)
Dynamic gestures -> Involve movement (e.g., sequence of strokes, shaking, …)
Good Gestures should be
conflict-free
distinguishable
memorable
Midas Problem with Eye Tracking
The eyes are always on and constantly move all the time
We usually need to introduce clutch to engage/disengage gaze control!
Modality definition
- single independent channel of sensory input/output
- between a human and a computer.
Output modalities
Vision (see) Audition (hear) Taction (feel) Gustation (taste) Olfaction (smell)
AIP Cube
Autonomy: Computational model can act and react to simulated events and stimuli
Interaction: Users can interact with objects and environment
Presence: Users feel immersed through sensory input and output channels