Auditory Display Flashcards
can communicate information redundant to
visual displays.
Auditory signals or displays
may allow offloading some visual workload to the auditory channel.
Auditory display
may be used in traditional alarms, in process
monitoring displays, in computer system interfaces, and even to present complex multivariate data
Sound
T or F. o sounds can unintentionally be part of a system, but still convey information to a listener
True
tend to elicit an alerting response, and can be detected more quickly than signals presented via other modalities.
Acoustic signals
is the use of non-speech audio to convey information or perceptualize data
Sonification
Percent change in audio frequeny that humans can detect
0.2%
have been used to monitor factory processes, signaling a change in one of several production parameters
auditory displays
two well-known successes. of uses of auditory signals
Geiger counter and sonar
establish a mapping between a sound and an intended meaning, with no intrinsic relationship existing.
Symbolic displays
is explicitly symbolic, as are most auditory warnings and alarms
speech
contain an immediate and intrinsic relationship between the display dimension and the information that is being conveyed.
Analogic displays
families of event notifications (indicating, for example, that a computer file was opened); slightly more analogic auditory icons, which are event notifiers that also reflect the details
of the events
earcons
is a generic term including all intentional, nonspeech audio that is designed to transmit information between a system and a user.
Auditory display
refers to a sound that alerts a user and conveys information about an
event.
Auditory alarm
are usually categorical and symbolic in nature
alarms
indicates the use of sound for part or all of the display of system variables and other information, usually including information about the details of the objects involved or the underlying process.
Auditory interface
is the use of nonspeech audio to present data.
Sonification
is the transformation of data relations into
auditory relations, for the purpose of studying and interpreting the data.
Sonification
can be used as a supplement to other (usually visual) displays, as an equal part of a multimodal display, or certainly as a complete display on its own
Sound/ auditory displays
recommended when multiple complex data sources need to be monitored or compared, and
when the information contains 3D aspects
Sound
Another downside to auditory displays in some cases which means that sounds are not continuously present for study and
comparison.
Absence of Persistence
Ensuring audibility without disrupting subsequent speech communication is the basic goal in this
situation.
Auditory alarms
The primary goal for an alarm
to alert, notify, time or status without disruption
may present information about the details of the event, by varying the sound parameters.
sophisticated alarms
recommends measuring the ambient noise levels during system operation, and plotting noise sound pressure level (SPL, measured in dB) against noise frequency (in Hz).
Patterson (1982, 1990)
The loudness of an alarm sound component at a given frequency should be set between ____ above the background noise at that frequency, but in no cases must it exceed ____ SPL
15 and 25 dB
90dB
is used increasingly in human–machine interfaces to communicate more information than simple
(symbolic) alarms, but still not as much as (analogic) data sonification.
Sound
sonic additions to widgets such as scroll bars and menus can assist users in making selections and choices more effectively than visual only interface elements.
graphical user interface (GUI)
describes small “languages” that can be made up of patterns of two or three musical notes
“earcon”
use sounds that in some way represent the actual features of objects involved in actions.
auditory icons
make a sound appear to originate in a specific
position in three-dimensional (3D) auditory space
spatialization of sound
an overwhelmingly visual medium, an increasingly important means of civics, communication and learning about the world
Social media
the standard of Web accessibility, and many
parts of the Web-browsing experience can be made accessible through semantics
Text-to-speech
transform low-level image data, like color, hue, saturation, or brightness, into auditory parameters, like timbre, pitch, or volume
sensory substitution devices (SSDs)
was used to generate an automatic description of the image, list objects in the image (“tags”), identify any celebrities, and determine the coordinates and gender of any faces in the image.
Computer Vision system
used to link the coordinates of each face generated by the Computer Vision system with a value for seven emotion categories
Emotion system
used to determine the sentiment of the text in each post.
Text Analytics system
used to read text on images
Optical Character Recognition (OCR)
was used to speak the text of the user name, main post, and automatically generated image
caption
speech
was used to signal the sentiment and impact using acoustic cues designed to
communicate emotion
Sonification
composed of short auditory icons and longer
“soundscapes” – was created from the high-level image content
auditory scenes
longer in duration and were used to represent recognized actions or environments in the scene
Soundscapes
Make use of pre-existing stimulus-response
relationships which may be natural, learned, or population stereotypes.
Compatibility
is a basic reflex to turn to the source of a sound
(stimulus), e.g. If you want an auditory sound as a warning for a pilot, don’t put the speaker behind the person!
Orienting reflex
Examples are sirens which are learned to be associated with an emergency; higher frequency = high value like a tea kettle whistle.
Learned
Auditory signal that captures attention
Attention Demanding Signal
Auditory signal with precise message information
Designation Signal
Auditory signal must be discernible from other
noise, especially multiple auditory signals, e.g. when several phones ring in an office it’s difficult to tell which is ringing.
Dissociability
Messages should be as short as possible
Parsimony
Same signal or message should designate the same information in all situations to avoid confusion like that between “priority” and “emergency” information.
Invariance
establish intensity relative to ambient noise levels to avoid masking.
Signal/noise ratio
works best to attract attention by minimizing perceptual adaptation to monotones and increasing the detectability of the signal, e.g. Beep! Beep! Beep! is better than “Beeeeeeep”!
Variable Signal -
Auditory displays are especially useful for
signaling alarms partially because noise will go around corners. “Yeows” and “Beeps” get a faster response time.
Warning Signals
