Lecture 3 - Sensor Based Interaction Flashcards

1
Q

Some examples of sensors

A
  • accelerometer
  • gyroscope
  • magnetometer
  • temperature
  • humidity
  • moisture
  • ambient light
  • proximity
  • barometric pressure
  • GNSS location (GPS is part of this)
  • heart-rate
  • fingerprint
  • iris scanner
  • rader
  • LIDAR
    -depth
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is an accelerometer?

A

measure a moving object’s acceleration and can detect frequency and intensity of human movement

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is a gyroscope?

A

A gyroscope is a device used for measuring or maintaining orientation and angular velocity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is a magnetometer?

A

used to measure the strength and direction of the magnetic field in the vicinity of the instrument.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is the IMU

A

Inertial Measurement Unit
-> these are a group of sensors that sense intertial motion
-> includes accelerometer (speed), gyroscope (rotation),magnetometer(direction)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What sensors can be used to sense surroundings?

A
  • ambient light sensor (how light or dark it is)
  • proximity sensor (how close the nearest thing is)
    -> we typically use this sensor to tell when the user is trying to interact or about to interact
    -> typically an optical sensor of some sort
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Sensors for getting surroundings are usually on the

A

front of the device

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What sensors are used to sense position?

A
  • barometric pressure (level above sea level)
  • GNSS location (satellite systems that can be used to pinpoint location)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What kind of sensors can be used to sense 3D?

A
  • radar (using waves to scan for objects nearby)
  • LIDAR (Image result for LIDAR
    Lidar — Light Detection and Ranging — is a remote sensing method used to examine the surface of the Earth.)
  • depth
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Examples of 3D projects?

A
  • Google tango (map spaces onto phone via camera)
  • spatial for iphone (modelling objects via camera)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What are the fundamental components of our devices that we forget are sensors?

A
  • camera
  • microphone
  • touchscreens
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What can the camera be used for?

A

tracking objects / hands , object recognition

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What can the microphone be used for?

A
  • ambient audio
  • speech recognition
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What can the touchscreen be used for?

A

(main way to interact with devices in the modern day)
- touch gestures
- pre-touch sensing
- pressure sensing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Do touchscreens have potential to do more than what we are using them for now?

A

YES
- we can get the exact x,y coordinate of touch
- sensors can detect the full area of touch
- sensors can detect when fingers are above and not actually touching the screen

These abilities mean we can enrich the interaction currently available

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is sensor fusion?

A

Fusing different sensor data together?

17
Q

Why fuse sensors?

A

Data becomes less uncertain for what we are trying to infer (potentially, however some things only require one sensor in isolation)

18
Q

Example of sensor fusion?

A
  • activity tracking from accelerometer and gyroscope (where and how fast)
  • gaze detection from front camera and depth sensor
  • indoor mapping from gyroscope and depth camera (depth at different orientations)
19
Q

Can we use sensors to build new interactions?

A

Yes, this is called sensor-based interaction.

20
Q

Examples of some recent sensor-based interactions?

A
  • personal assistants e.g. alexa
  • mid air gesture input
  • 3D depth sensor input e.g. Google Tango
  • grasp pressure input e.g. Google Active Edge
  • touchscreen pressure input e.g. Apple 3D touch
21
Q

What can sensors be used for in computing?

A
  • context aware systems
  • sensor-based interaction techniques
22
Q

Different between inferring context and providing interaction from sensors.

A

Context helps us infer what the situation is of the user and adapt UI and funcionality, possibly adding special interaction.

Sensor based interaction is where we use a sensor to interact with a device in a certain way and this work regardless of context (unless combined with context awareness)

23
Q

Another name for sensor fusion?

A

Mutlimodal sensing

24
Q

Sensor fusion..

A

increases accuracy of action estimation and gives ability to have more expressive techniques

25
Q

What is mid air gesture swiping?

A

hand movements or poses in the air

26
Q

What are mid-air gestures for?

A
  • quick low effort interaction
  • interaction with less precision than a screen (as larger input space)
  • useful when one can’t reach or touch the screen
  • allows extra input states, as we can do more movements
  • can be more expressive and dextrous
27
Q

What sensors are required for mid-air gestures?

A
  • depth sensors (high battery usage)
  • cameras (2d sensing)
  • proximity sensors (low battery alternative to depth sensors)
  • radar sensing (another alternative)
28
Q

Problems with mid-air gestures?

A
  • do users know the gestures?
  • do users know where to perform the gestures?
  • how do we know the gestures are corect?
  • do users know what to do when they don’t work
  • how do we improve our gesture performance?

Mid-Air gestures are ambigous and unfamiliar compared to touch

29
Q

What is a gated interacion?

A

One, which has to be explicitly enabled by the user. The good thing about this is that when enabled system can show instructions, as to limit accidental input and unwanted resource usage

30
Q

With new interaction techniques we need to:

A

give as much feedback as possible, confirming that the system is responding to user action
-> visualisations are especially helpful

31
Q

What is pressure sensing (isometric force)?

A

Using pressure of touch for interaction

32
Q

How can we use pressure sensing

A
  • for grip pressure and touch pressure
33
Q

Why have pressure sensing?

A
  • adds extra interaction states
  • can be done on handed
  • doesn’t require looking at the device
  • passive to active input (e.g. pressure launches assistant)
34
Q

How can we measure pressure?

A
  • force sensitive sensors
  • strain gauges
  • barometric pressure sensors
35
Q

Are humans good at modulating pressure?

A

Yes, humans can use 10 levels of pressure (on average)