System Design Flashcards

1
Q

Describe an example of a situation where human performance improvement is needed but training is arguably not a good solution. (2 points)

A

EPIPEN:
The problem is argued to be due to the EpiPen having a counter-intuitive design (people intuitively but incorrectly apply a “pen” analogy).

They tried to solve the problem through training (e.g. use of a training EpiPen simulator) – but this is a situation where training is arguably the wrong solution because:

  1. These events are rare – so patients are likely to have forgotten any training by the time they need it (training may have been decades earlier).
  2. The patient may not be able to self-administer – so the user may be an untrained bystander
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is the definition of human factors, according to Wickens et al. (1998)? (1 point)

A

The application of psychological and physiological principles to the design and engineering of products, processes, and systems

Human factors ≈ psychology + engineering, as applied to “systems”.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Describe four examples of the type of system that might be studied by human factors researchers. (1 point)

A

physical device (e.g., laparoscope),
computer system (e.g., electronic health records),
workplace (e.g., operating theatre), or
organisation (e.g., hospital).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is the key strategy employed by human factors to solve problems (according to Russ et all., 2013)? (1 point)

A

Human factors addresses problems by modifying the design of the system to better aid people

The idea is to take human capabilities and limitations into account as part of the design

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Describe two key goals of human factors. (1 point)

A

1 Reduce HUMAN ERROR
2 Improve SAFETY

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Describe the situations when training is likely to be an appropriate strategy for improving patient safety (according to Russ et al., 2013). (3 points)

A
  1. When the goal is to familiarise users with new technologies
  2. When they need to develop and test new techniques or practice techniques
  3. gain experience with specialised techniques that involve sensorimotor skills” (e.g., surgical skills)
  4. When used to practice or test knowledge in realistic scenarios
  5. When its as good as it can be:
    —–When “other system components are considered first, redesigned, and addressed using human factors expertise and principles and no other system changes can possibly be made
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Describe the situations when training is likely to be an inappropriate strategy for improving patient safety (according to Russ et al., 2013). (3 points)

A
  1. The goal is for individuals to stop using technologies, tools or devices in ‘the wrong way (The system itself could instead be changed)
  2. Similarly, if it is intended to address a type of error that is occurring across multiple people” (suggests the problem is with the system not the individuals using it).
  3. It is an attempt to change innate human characteristics or imperfections” (e.g. telling people to “pay more attention” or “be more careful” is unlikely to improve things)

3.Individuals have been previously trained about the safety issue(s) and the problem persists” (suggests training may not be an effective solution).

  1. Human factors or system design have not be considered and TRAINNG is the ONLY intervention used
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Describe the structure of a system design research program. (2 points)

A

Phase 1: Understand the task, its problems, and its context.

Phase 2: Design update the product or system, using feedback

Phase 3: Evaluate the new product.

(Same as behaviour support)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What research methods can we use to understand a system and its problems (as might be used as part of a human factors system design research program)? (2 points)

A

Task analysis and cognitive task analysis

heuristic evaluation of existing products

stakeholder surveys

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is a task analysis? (1 point)

A

A task analysis is a qualitative evaluation of a task in order to understand how it is accomplished.

QUALITATIVE

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is a cognitive task analysis? (1 point)

A

A cognitive task analysis is a type of task analysis that focusses on understanding the cognitive aspects of the task, such as situation assessment, decision making, response planning, and response execution.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What sort of methods that could be used as part of a task analysis? (2 points)

A

(COMMON SENSE) For example:

Review literature (maybe someone has already dissected the task – e.g. in a textbook).

Interviews with task experts and other relevant stakeholders (e.g. novices, supervisors, those affected by the task outcomes).

Observational studies (go and watch people doing the task for real).

Get people to do simulations of the task if appropriate.

(SAME AS WHAT WAS DONE TO EVALUTE PLAYGROUPS IN PAST)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is a heuristic evaluation? (1 point)

A

a team of experts trained in human factors conducting a qualitative evaluation of existing products against a pre-determined set of design criteria

Their goal is to identify as many design problems with the products as possible.

Design criteria could include:
Information layout.
Appropriateness of included information.
Methods of representing decision-making information.
Use of decision-support systems.
Effect on cognitive workload and memory.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Describe five examples of design criteria that might be evaluated in a heuristic evaluation. (2 points)

A

Information layout.
Appropriateness of included information.
Methods of representing decision-making information.
Use of decision-support systems.
Effect on cognitive workload and memory.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Why might it be important to know what key stakeholders think about a particular task – even if they’re incorrect? (1 point)

A
  1. FEAR OF CHANGE: They may not want to use a new product if they have attachment to the one they already have
    This might be for valid reasons (experience) or invalid reasons
  2. CLUES TO OVERCOMING THIS: These surveys might help us understand what we need to do to get people to use the product – and what training and support materials might be needed
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Describe how you might undertake the design phase of creating a new product in order to increase the chances that it will have good usability. (2 points)

A

Rapid prototyping:
Create a prototype product that can be easily modified.
Obtain “quick and dirty” feedback on the prototype – and modify it.
Obtain more feedback – and modify it again.
Be prepared to go through dozens of design iterations before moving on

17
Q

List three types of study that could be used to evaluate the usability of a product. (1 point)

A
  1. Objective controlled experiments, comparing performance with the product with other products
  2. Field studies – does the product lead to better outcomes in the real world
  3. Obtaining opinions of stakeholders on the product (does the product have face validity?), using survey