2.04 - Visual Aspects of Speech & Speech Reading Flashcards
Are the terms “Lipreading” vs. “Speechreading” used interchangeably by some in AR field?
Yes
What is the difference between Lipreading vs. Speechreading?
Lipreading: The process of using visual signal for recognizing speech
Speechreading: speech recognition using both auditory and visual cues
What is the process of using visual signals for recognizing speech: Lipreading vs. Speechreading?
Lipreading
What is the process of using only visual cues provided by talker’s face: Lipreading vs. Speechreading?
Lipreading
What is the process of speech recognition using both auditory and visual cues: Lipreading vs. Speechreading?
Speechreading
What uses any available cues: the speaker’s facial expressions and gestures, body postures, contextual cues: Lipreading vs. Speechreading?
Speechreading
What integrates what is heard with what is seen: Lipreading vs. Speechreading?
Speechreading
Which is Analytical: Lipreading vs. Speechreading?
Lipreading
Which is Synthetic: Lipreading vs. Speechreading?
Speechreading
What are the five factors that influence Lipreading?
- Visability
- Rapidity
- Coarticulation & Stress Effects
- Visemes & Homophenes (Sparse or dense lexical neighborhood)
- Talker Effects
____% of speech sounds are not visible on the mouth. Most people recognize ____% of words they see.
60%
20%
What places/types of articulation are the MOST visable?
3
Bilabials
Labiodentals
Interdentals
What places/types of articulation are the LEAST visable?
5
Voiced
Alveolars
Palatals
Velars
Vowels
What phonemes are MOST visible?
10
/p/, /b/, & /m/
/w/ & /ʍ/
/f/ & /v/
/ʃ/ & /ʧ/
/θ/
What phonemes are LEAST visible?
5
/k/ & /g/
/t/
/s/ & /z/
Rapidity:
Average speaker rate: ____ phonemes/s
15
Visual resolution
The eye is only capable of distinguishing _____ discrete mouth
movements/second.
9-10
Are word boundaries clear visually?
No
Difficult to tell where one word ends and another starts
Coarticulation & Stress
Can the same sound look different depending on its phonetic and linguistic context?
Yes
/b/ in beet looks different than in boot (coarticulation effect)
Talker’s stress pattern can change appearance of words (“How ARE you?” versus “How’re you?”)
What are Visemes?
A group of speech sounds that look identical on the lips
Example: /b/, /m/, & /p/
What are Homophenes?
Groups of words that look the same on the mouth
What percentage of English words are homophenes?
40‐60%
What are some Talker Effects that can affect intelligibility?
(3)
Regional accents
Mouth/Lip movement
Expressiveness
Does Speechreading use both auditory and visual cues?
Yes
What kind of information does auditory signals give?
Voicing (voice vs. voiceless)
Envelope (time‐intensity variations of the audio signal produced during speech)
Manner (stops, fricatives, nasals, affricates, glides)
What kind of cues are provided by visual information?
4
Place of articulation
Emotions
Message type
Etc.
What is Audio‐Visual Integration?
When information from the auditory and the visual signal combine to form a unified percept
What are the three distinct stages of Audio‐Visual Integration?
- Perceive auditory/visual signal
- Integrate the two signals (imperative!)
- Discrete phonetic/lexical decisions
What is the Neighborhood Activation Model?
Top‐down information used to narrow candidate choices
Uses concept of “Lexical Neighborhoods”
What are Lexical Neighborhoods?
Words that either sound or look alike and have a similar frequency of occurrence in everyday speech (so they “compete” as a match in everyday speech)
What are Acoustic Lexical Neighborhoods?
Words that have similar acoustic‐phonetic characteristics
What are Visual Lexical Neighborhoods?
Words that look similar to each other
What are Dense Lexical Neighborhoods?
Where there are many words w/similar characteristics and frequency of occurrence
Makes words harder to recognize
What are Sparse Lexical Neighborhoods?
Contain less similar words
Makes words easier to recognize
What are the four goals of Speechreading?
Discern speech sounds that cannot be distinguished by sound alone
Decrease dependence on listening by using the whole sensory system
Decode speech more rapidly by using additional cues
Increase ability to predict
Do we all rely on speechreading to some extent (though maybe not lipreading)?
Yes
What are the four factors that influence Speechreading Ability?
Speech Reader (Is that person visual aware?)
Environment (Can you see the speaker?)
Talker (Expressions,facial hair, how much their lips move,etc.)
Message (Is it clear, concise, and distinct?)
Do young adults lipread better than older adults (65+ yrs) for consonants, words, & sentences?
Yes
Do younger children recognize certain phonological contrasts as well as older children?
No
Do younger children have linguistic and world knowledge limits that prevent them from capitalizing on context cues?
Yes
Do congenital HL patients lipread better than normal hearing patients on correct phonemes?
Yes
Do congenital HL patients lipread better than normal hearing patients on correct words and/or correct sentences?
No
Do we tend to spend more time teaching children with HL the analytical stuff and less on the whole picture?
Yes
Do visual word decoding skills, working memory, phonologic processing skills, lexical identification speed, and verbal inference influence the ability of a speechreader?
Yes
Can the eyes scanning the face show phonetic and prosodic cues?
Yes
Can phonetic judgments be made about speech sounds by focusing on the lower face?
Yes
Can prosodic cues be gained by focusing on the upper face?
Yes
What is “Gestalt”?
The “art” of speechreading
Do effective speechreaders/lipreaders recognize that they need to follow the message but do not try to lipread every word?
Yes
Do individuals need to be assessed to see if they are a good candidate for speechreading?
Yes
What four areas are tested to see if an individual is a good candidate for speech reading?
Vision only
Auditory only
Vision and Auditory
Quiet and noise
What is Auditory Enhancement?
The improvement of speech understanding provided by auditory
signal
What is Visual Enhancement?
The improvement provided by visual signal
Do older adults show less visual enhancement than younger adults?
Yes
What is the Analytic Approach?
Focuses on perceiving the individual parts of a word (sounds and syllables) before perceiving the entire word.
What is the Synthetic Approach?
Emphasizes perception of the whole regardless of the parts perceived.
What is the Mimetic/Kinesthetic Approach?
Includes imitation of target syllables/words to help the student understand how they are made.
What are Analytic Speechreading Training objectives?
Directed towards developing vowel and consonant recognition
skills
Emphasizes recognition of single phonemes or words
What are Synthetic Speechreading Training objectives?
Directed towards understanding meaning
Does the IDA Institute offer free information on helping the hearing impaired?
Yes
Can Speechreading Be Taught?
It’s controversial
Can Self‐Advocacy be taught?
Yes
Does good communication involve attentiveness to situational clues?
Yes
Does good communication involve observing lip movements?
Yes
Does good communication involve listening skills?
Yes
Does good communication involve observing intonation, rhythm, and stress?
Yes
Does good communication involve observing contexual clues?
Yes
Does good communication involve observing gestures and body language?
Yes
Does good communication involve observing facial expressions?
Yes