Lecture two

Question 1

What is a markup language?

Answer 1

A way of describing content and structure of documents.

Question 2

What does usability measure?

Answer 2

Effectiveness: accuracy and completeness with which users achieve
specified goals.
2. Efficiency: resources used in relation to the results achieved.
3. Satisfaction: extent to which the user’s physical, cognitive and emotional
responses that result from the use of a system, product or service meet the
user’s needs and expectations.

Question 3

Usability User goals

Answer 3

Effectiveness: accuracy and completeness with which users achieve
specified goals.
2. Efficiency: resources used in relation to the results achieved.
3. Satisfaction: extent to which the user’s physical, cognitive and emotional
responses that result from the use of a system, product or service meet the
user’s needs and expectations.

Question 4

Usability metrics for effectiveness

Answer 4

1-Completion rate
2-Errors
3-Task time.
4-Overall relative efficiency.

Question 5

What is the completion rate?

Answer 5

One of the most fundamental of usability metrics, typically
binary. Participants are provided with a task/scenario with a clear success
criteria. If the task is completed successfully, this is recorded as ‘1’ and if the task
is not completed successfully this is recorded as ‘0’.

Question 6

What is “errors”?

Answer 6

Typically a ‘count’ of the number of errors, and type.

Question 7

What is task time?

Answer 7

Record of how long it takes a user to complete a task, typically
recorded in seconds and/or minutes.

Question 8

What is Overall relative efficiency?

Answer 8

The overall relative efficiency uses the ratio of the
time taken by the users who successfully completed the task in relation to the
total time taken by all users. “mean”

Question 9

Usability metrics for satisfaction

Answer 9

1-Task Level Satisfaction
2-Test Level Satisfaction

Question 10

What is Task Level Satisfaction?

Answer 10

1-ASQ
2-NASA-TLX
3-UME
4-SMEQ
5-SEQ

Question 11

ASQ*

Answer 11

After Scenario Questionnaire

Question 12

NASA-TLX

Answer 12

NASA’s task load index

Question 13

SMEQ
UME
SEQ *

Answer 13

Subjective Mental Effort Questionnaire Usability Magnitude Estimation
Single Ease Question

Question 14

What is Test Level Satisfaction?

Answer 14

1-SUS
2-SUPR-Q
3-CSUQ
4-QUIS
5-SUMI

Question 15

SUS *

Answer 15

System Usability Scale

Question 16

SUPR-Q

Answer 16

Standardized User Experience Percentile Rank Questionnaire

Question 17

CSUQ

Answer 17

Computer System Usability Questionnaire

Question 18

QUIS

Answer 18

Questionnaire For User Interaction Satisfaction

Question 19

SUMI

Answer 19

Software Usability Measurement Inventory

Question 20

There are two types of study goals:

Answer 20

formative usability testing
summative usability testing.

Question 21

User goals

Answer 21

performance and satisfaction

Question 22

Usability testing data can typically be measured using one of four types of data:

Answer 22

1. Nominal data
2. Ordinal data
3. Interval data
4. Ratio data

Question 23

Nominal data

Answer 23

Also called categorical data.
* A type of data that is used to label variables without providing any quantitative
value.
* Nominal data cannot be ordered and cannot be measured..
* A common way to analyse nominal data is looking at frequencies.

Question 24

Nominal data examples

Answer 24

operating system (Android, iOS),
geographic location,
task completion (yes, no, partial)

Question 25

Ordinal data

Answer 25

Ordinal data is classified into categories within a variable that have a natural rank
order.
* The distances between the categories are not meaningful
* A common way to analyse ordinal data is looking at frequencies.

Question 26

Ordinal data examples

Answer 26

participants being asked to rank
order four different designs according to which they prefer
self-reported metrics using Likert scales (strictly speaking, Likert scales are ordinal)

Question 27

Interval data

Answer 27

Continuous data where differences between the values are meaningful.
* There is no natural zero point.
* Common ways to analyse interval data include looking at a wide range of
descriptive statistics including averages and standard deviation.
* In usability testing, there are cases where Likert scales can be treated as interval
rather than ordinal data. See, for example,

Question 28

Interval data examples

Answer 28

System Usability Scale (SUS),
dates.

Question 29

What is Likert scale example (ordinal)
System Usability Scale (SUS) ?

Answer 29

A question like the doctors assesments
strongly agree agree neutral disagree strongly disagree

Question 30

How can Likert scale be interval data?

Answer 30

By making the question in a scale

Question 31

Scoring SUS for EVEN

Answer 31

For statements with odd number: subtract the user responses from 5
Add up the converted responses for each user and multiply that total by 2.5. This converts the range of possible values from 0 to 100 instead of from 0 to 40.

Question 32

Benchmark for SEQ “mean”

Answer 32

5.5

Question 33

How to calculate effieciency?

Answer 33

the ratio of the task completion rate to the mean time per task

Question 34

Ratio data

Answer 34

Same as interval data, but there is an absolute zero.
* Examples of ratio data in usability testing: time, number of clicks.
* Common ways to analyse interval data include looking at a wide range of
descriptive statistics including averages and standard deviation.

Question 35

What is SUS

Answer 35

the SUS is a 10 item questionnaire with 5 response options.

Question 36

Scoring SUS for ODD

Answer 36

For statements with odd number : subtract one from the user response.
Add up the converted responses for each user and multiply that total by 2.5. This converts the range of possible values from 0 to 100 instead of from 0 to 40.

Question 37

SUS benchmark

Answer 37

68%

Question 38

Completion rate

Answer 38

78%

Question 39

SEQ benchmark

Answer 39

5.5