Final Flashcards

1
Q

2 different metric types

A

observable + quantifiable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

3 common questions with metrics

A
  1. “Which metric shall I (we) use?”
  2. “How shall I (we) obtain the components needed to calculate it?”
  3. “Is this metric reliable enough to give a realistic picture of the degree to which my (our) system is usable (or not)?
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

3 general metrics names

A

Performance Metrics
Issue-Based Metrics
Self-Reported Metrics

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

9 performance metrics names

A
  1. Completion rate (task success, effectiveness)
  2. Task time
  3. Errors
  4. Efficiency (Page views/clicks)
  5. Lostness
  6. Conversion rate
  7. Learnability
  8. Eye-tracking
  9. Biometric data
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

1 combined metric name

A

Single usability metric

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

3 self-reported metric names

A
  1. Task-level satisfaction (self-report)
  2. Expectations
  3. Test-level satisfaction (self-report)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

1 issue-based metric name

A

Usability problems

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Performance metrics (there ae six of them)

A
  1. Task Success (Completion Rates)
    - Binary Success
    - Levels of Success
  2. Time on Task
  3. Errors
  4. Effectiveness
  5. Efficiency
  6. Learnability
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Effectiveness formula explanation

A
  1. measure completion rate.
  2. fundamental usability metric/completion rate is calculated by assigning a binary value of ‘1’ if the test participant manages to complete a task and ‘0’ if he/she does not.
  3. average Task Completion Rate is 78%
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Effectiveness formula

A

(Number of tasks completed/Total number of tasks) X 100%

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Effectiveness example. 5 tasks and a user completes 3 of them.

A

3/5 X 100% = 60%

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

3 Levels of success

A

Complete Success
Partial Success
Failure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

How to resolve a task when a user is not successful

A

Tell the users at the beginning of the session that they should continue to work on each task until they either complete it or reach the point at which, in the real world, they would give up or seek assistance (from technical support, a colleague, etc.).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Time on task explanation

A

Time on task (sometimes referred to as task completion time or simply task time).

Caveat: Sometimes, slower is better
Ex: They are truly engaging with the website

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

4 steps to make efficiency quantible

A
  1. Identify the action(s) to be measured
  2. Define the Start and end of an action
  3. Count the actions
  4. Actions must be meaningful
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Lostness formula

A

N: # of DIFFERENT webpages visited
S: total # of webpages (duplicate included)
R: minimum # of pages required to visit

L = sqrt(N/S-1)^2 +(R/N-1)^2

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

2 types of rating scales

A

likert and semantic differential scales

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

4 types of self-reported metrics

A
  1. Post-Task ratings
  2. Post session ratings
  3. using sus to compare designs
  4. online services
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Likert scale definition

A

5 point rating scale following:
1. Strongly disagree
2. Disagree
3. Neither agree nor disagree
4. Agree
5. Strongly agree

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Semantic Differential scales definition

A

Will have a scale with two values on each side. These two values will be opposites such as: weak and strong, ugly and beautiful, cool and warm. example below

weak o o o o o o o strong

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

SUS meaning and definition

A

System Usability Scale - consists of a 10 item easy questionnaire with five response options for respondents; from Strongly agree to Strongly disagree

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

10 questions used in SUS

A
  1. I think that I would like to use this system frequently.
  2. I found the system unnecessarily complex.
  3. I thought the system was easy to use.
  4. I think that I would need the support of a technical person to be able to use this system.
  5. I found the various functions in this system were well integrated.
  6. I thought there was too much inconsistency in this system.
  7. I would imagine that most people would learn to use this system very quickly.
  8. I found the system very cumbersome to use.
  9. I felt very confident using the system.
  10. I needed to learn a lot of things before I could get going with this system.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

CSUQ meaning and definition

A

Computer System Usability Questionnaire - has 19 questions about usability; from strongly disagree to strongly agree

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

3 severity ratings

A

low, medium, high

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

low severity rating

A

Any issue that annoys or frustrates participants but does not play a role in task failure. These are the types Of issues that may lead someone of course, but he still recovers and completes the task. This issue may only reduce efficiency and/or satisfaction a small amount, if any.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

medium severity rating

A

Any issue that contributes to significant task difficulty but does not cause task failure. Participants often develop workarounds to get to what they need. These issues have an impact on effectiveness and most likely efficiency and satisfaction.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

high severity rating

A

Any issue that leads directly to task failure. Basically, there is no way to encounter this issue and still complete the task. This type of issue has a significant impact on effectiveness, efficiency, and satisfaction.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

Self-reported metrics definition

A

Self-reported data give you the most important information about users’ perception of the system and their interaction with it. At an emotional level, the data may tell you something about how the users feel about the system

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

tasks that can be measured

A

Time on task, errors, efficiency, lostness, conversion rate, learnability, eye tracking, emotion, stress, phycological measures

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

3 usability statistics

A
  1. effectiveness (can users successfully achieve their objectives)
  2. efficiency (how much effort and resource is expended in achieving those objectives)
  3. satisfaction (was the experience satisfactory)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

what do sensor data streams test on?

A

a person, an environment, such as an office
and the home

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

questions in sensor data streaming

A

Where do people travel over the course of a day?
With whom do they normally communicate or collaborate?
What tools or information resources do they use at various points during the day? When, where, and with whom?
What routines help to define a “typical” or “atypical” day?
How healthy are a person’s daily behaviors? Is he or she making good health choices?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

One advantage of using streams of data as a means of understanding people’s activities and behaviors is

A

that the technique can be used to answer research questions across a range of units of analysis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

The 3 data streams are

A

egocentric, group-centric, and space-centric

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

Egocentric Sensor Data Streams

A

Sensors focused on monitoring the movements, activities, and interactions of a single individual can answer questions at an egocentric unit of analysis.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
36
Q

Egocentric data stream questions

A

How do people allocate their time or attention?
How is a person ’ s mental state or mood affected by real - world stimuli ?
How do electronic communications or mobile computing interactions affect daily routines?
How do people ’ s own understanding or interpretations of their activities , colleagues , or environment differ from what a ubiquitous computing application or tool is able to automatically sense ?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
37
Q

Group-Centric Sensor Data Streams

A

This group - centric approach can involve simply capturing the same signals as for a single person, but across a group over the same window of time, or it might involve deploying a broader set of environmental or infrastructural sensors in a shared/community space or collecting data about more interpersonal types of interactions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
38
Q

Group-centric data stream questions

A

How often do members of this group interact with one another ?
What do these interactions entail ?
How do power relations manifest in different kinds of work environments or work teams ?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
39
Q

Space-Centric Sensor Data Streams

A

Answer questions about how spaces are used, irrespective of their particular inhabitants, given appropriate instrumentation of a space.

High information density sensors
Low density sensors

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
40
Q

Space-centric data stream questions

A

How are the occupants of a home spending their time throughout the day and night ?
Is a senior adult living by herself continuing to maintain healthy levels of physical activity ?
What is the impact of ambient feedback promoting environmental awareness on cooking , cleaning , and hygiene activities within different types of families ?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
41
Q

Sensor Data Streams and Context-Aware Computing

A

Context-aware computing is a form of interactive computing in which a user’s implicit behavior—that is, their location, their physical activity, or their interactions with other people—or the environment in which a system is being used can both serve as alternative or auxiliary inputs to the system.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
42
Q

limitations of sensor data streaming

A
  1. poor job of why things have happened in the real world
  2. The phenomena must be well understood
  3. quality of data limited by sensors capabilities
  4. select sensors to effectively capture quality data and minimize discomfort
  5. large streams of data over moderate-length deployment.
  6. sensors are technologically complex
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
43
Q

7 things to report when using sensors

A
  1. Hardware
  2. Experimental setup
  3. Participant knowledge
  4. Experimental execution
  5. Software infrastructure
  6. Analysis
  7. Why were these choices, and not others, made?
44
Q

Eye tracking definition

A

Eye tracking is the process of measuring either the point of gaze (“where we are looking”) or the movement of the RETINA relative to the head.

45
Q

What memory does eye tracking work in unison with?

A

working memory

46
Q

Saccadic movements in eye tracking are

A

rapid, ballistic (pre-programmed) movements of the eyes that abruptly change the point of fixation. Effectively blind during these movements

47
Q

Disadvantages of eye tracking?

A

Expensive

48
Q

eye tracking is represented in:

A

scanpaths, saccades, fixations, and heatmaps

49
Q

4 most important eye tracking methodologies

A

Accuracy
Reliability
Robustness
Non-intrusiveness

50
Q

What are gestures?

A

A form of non-verbal communication.
A movement of part of the body, especially a hand or the head, to express an idea or meaning.

51
Q

Implicit gestures

A

Non verbal
Used in place of or to augment speech

52
Q

Gesture recognition

A

Interpreting human gestures via mathematical algorithms.
Gestures as input to control devices or applications.

53
Q

Motivations for using gestures

A

Gesturing is a natural form of communication. Can be done while talking. Babies learn gestures before talking. Very innate in humans.

54
Q

3 types of human gestures

A
  1. Hand and arm gestures
  2. Head and face gestures
  3. Body gestures
55
Q

4 considerations for using gestures

A
  1. Environment
  2. Real-time
  3. Cost
  4. Usability
56
Q

2 types of computer recognized gestures

A

Offline gestures
Online gestures

57
Q

Offline gesture and example

A

Processed after the user’s interaction with the object
Ex:- gesture to activate a menu.

58
Q

Online gestures

A

Direct manipulations like scaling and rotating

59
Q

Most important gesture usage and why?

A

Sign Language Recognition - Just as speech recognition can transcribe speech to text, certain types of gesture recognition software can transcribe the symbols represented through sign language into text.

60
Q

General uses for gestures

A

sign language recognition, VR, aid to disabled

61
Q

Challenges with gestures

A
  1. Limited options
  2. gestures aren’t universal Ex: Peace sign here is a middle finger in England
  3. Robustness - gestures are read wrong due to low lightning, background noise, etc
62
Q

Gestures are heavily used in phones. What are some examples?

A

double tap, pinch, scroll, swipe, long press, etc

63
Q

UIs in the Pervasive Computing Era

A

Future computing devices won’t have the same UI as current PCs. Alexas, VRs, no screens, etc

64
Q

Motivations for using speech UI

A
  1. Unlimited commands
  2. Natural
  3. Freedom for the rest of the body
  4. people talk fast
  5. small devices
65
Q

4 scenarios when speech UI should be used?

A
  1. Mobile
  2. Hands-busy
  3. Eyes-busy
  4. Assistive Technologies
66
Q

Limitations to speech UI

A
  1. Not perfect -> 5-10% error rate
  2. No visible state (no visible log of whats been done)
  3. Can’t see effect of commands
  4. Hard to learn
  5. Can’t easily explore interface
  6. spelling (male vs mail)
  7. isolated words or segmentation
67
Q

2 things speech UI require

A

speech recognition, and speech production

68
Q

what to consider when designing speech UI

A
  • give feedback
  • simple hierarchies
  • simple, quick feedback
  • speech takes working memory
  • create real conversation (interruptions are okay)
  • include confirming commands
  • give short errors at first
69
Q

10 design guidelines for voice UI

A
  1. show system status
  2. real world concepts
  3. user control and freedom
  4. consistent standards
  5. prevent errors
  6. let users recognize not recall
  7. flexible but efficient
  8. minimal design
  9. error recovery
  10. help is given
70
Q

Common voice activated triggers

A

voice, tactile, motion, device self-trigger

71
Q

7 main parts to a leading cue (speech UI)

A
  1. immediate
  2. brief and transitory
  3. clear beginning
  4. consistent
  5. distinct
  6. supplementary cues
  7. initial prompt
72
Q

3 main parts to an ending cue (speech UI)

A
  1. adequate time
  2. adaptive time
  3. reasonable pause
73
Q

5 disadvantages of speech UIs

A
  1. Disruptive
  2. Privacy Concerns
  3. Recognition Errors
  4. Multiple Verbal Tasks (Interference)
  5. Context Errors
74
Q

7 Advantages of haptic UI

A
  1. Users have a lot of sensitive skin.
  2. Skin can map 2d display of environment continuously
  3. visual representations can be recognized tactilely
  4. inputs are simple and easy
  5. another input modality. useful for the blind and the sighted
  6. immersion
75
Q

Uses for haptic UIs

A

video games, personal computers, mobiles, VR, simulators, robotics, training doctors, art, aviation, cars,

76
Q

User studies inputs used in crowdsourcing

A
  1. Surveys
  2. rapid prototyping
  3. usability tests
  4. cognitive walkthroughs
  5. performance measures
  6. quantitative ratings
77
Q

What is crowd sourcing and why is it used?

A

Makes tasks available for anyone online to complete and can quickly access a large user pool, collect data, and compensate users.

78
Q

What is Amazon’s Mechanical Turk and how is it used?

A

Used for human intelligent tasks such as finding an image, webpage, or relevance on search results. Pays the testers pennies on each task.

79
Q

What is the best way to get amazon’s mechanical turk to work?

A

Add simple, verifiable questions so you can tell if someone just put all 5s or if they were actually engaged and reading. You want cognitive presence.

80
Q

Differences between traditional user studies and mechanical turk?

A

Traditional: complex, long, subjective opinions, targeted demographics, high interactivity

Turk: simple, short, object verifiable, unknown demographic, limited interactivity

81
Q

Considerations for crowd sourcing?

A
  1. Are the tasks suitable?
    * Tradeoffs between online vs laboratory?
    * Wages?
    * How to ensure good results?
82
Q

3 items to consider if crowdsourcing is appropriate:

A
  1. Task complexity, subjectivity, and information to be collected
  2. questions you want answered
  3. data needed
83
Q

Tradeoffs in crowdsourcing

A
  1. no supervision = cheating
  2. not much data collection
  3. low cost
  4. demogrpahics
  5. quality work considerations
84
Q

3 challenges of crowdsourcing

A
  1. cost - not free
  2. quality - cheating
  3. latency - not real-time
85
Q

Main factors in team performance

A

Teamwork, behavior, skills, attitudes, knowledge, leadership, performance monitoring, and adaptability/flexibility

86
Q

Factor of team performance definition - # of members on a team

A

Team size

87
Q

Factor of team performance definition - unique qualities possessed by a team

A

team competencies

88
Q

Factor of team performance definition - way members of a team are organized

A

team structure and composition

89
Q

Factor of team performance definition - distance between goals and motivations of any two team members

A

social distance

90
Q

Factor of team performance definition - geophysical distance between any two team members (time-zone)

A

spatial distance

91
Q

Factor of team performance definition - mechanism to maintain norms and coherence by minimizing expression of diverse characteristics of team members

A

Mutual support and surveillance

92
Q

Factor of team performance definition - perception of one’s leader and their authority

A

presence or absence of legitimate authority figures

93
Q

Factor of team performance definition - measurement of leader’s goals with team’s motivations

A

task attractiveness

94
Q

Factor of team performance definition - relationship between teams and tasks to be performed

A

team processes and tasks

95
Q

what is microsofts hololens and how does it work?

A

Microsoft HoloLens is a smart glass which is the first cordless, self-contained holographic computer running on Windows 10.

Microsoft HoloLens is made up of specialized components that together enable Holographic Computing.

96
Q

Virtual and augmented reality; what are they?

A

Virtual: Tricks eyes into being somewhere else
Augmented: changes the current scene to be changed by a dimensional layover

97
Q

6 features of hololens?

A
  1. camera
  2. cpu
  3. lenses
  4. cooling vents
  5. sensors
  6. buttons
98
Q

Hololens vs google glass

A

Google glass was design to perform the function of Smartphone. Google glass is VR not augmented reality

99
Q

Other augmented reality technologies

A

Taste+, pre-touch, paperID, skintrack, inForm, Materiable, HoloFlex, WatchMI, etc

100
Q

What is taste+?

A

changes the way things taste but using electrical charges in spoons or waterbottles

101
Q

What is skintrack?

A

ring that puts a smartphone onto your whole arm and can sense actions based on touching the skin

102
Q

5 stages of the gartner hype cycle

A
  1. innovation trigger
  2. peak of inflated expectations
  3. trough of disillusionment
  4. slope of elightenment
  5. plateau of productivity
103
Q

where is the HoloLens on gartner hype cycle?

A

I would say it is in the slope of enlightenment. Hololens 1.0 released and was a let down. But now HoloLens rumors have begun and how it will be improved to be productive.

104
Q

What are some keywords for the future of HCI?

A

Sensing and Mobility
Augmented Human
Advanced AI and Analytics
Hyperautomation
Multiexperience
Transparency and traceability
The distributed cloud
PracticalBlockchain
AI security
Autonomous things

105
Q

What are some examples of the augmented human?

A

Neurolink that uses electric brain waves to use technology.
Exo skeletons - think cyberpunk

106
Q

What are some examples of hyperautomation?

A

technology to automate tasks that once required humans.

Robotic process automation (RPA), intelligent business management software (iBPMS) and AI

107
Q

what are some examples of multiexperience?

A

includes multisensory and multitouchpoint interfaces like wearables and advanced computer sensors (VR AND AR)

Domino’s Pizza created an experience beyond app-based ordering that includes autonomous vehicles, a pizza tracker and smart speaker communications