Week 13 Flashcards
Open Face, & Combining Articulation
What data does OpenFace provide?
Provides real-time analysis of facial behaviour
Non-invasive
What are comprehensive features of OpenFace?
Facial landmark detection
Head pose estimation
Facial action unit recognition
Eye-gaze estimation
What is the purpose of head pose estimation?
Measures tilt, rotation, nodding
Enhances understanding of non-verbal cues
What is the purpose of facial action unit recognition?
Identifies and quantifies muscle movements for emotional analysis
Provides insight into emotional underpinnings of speech
What is the purpose of eye-gaze estimation?
Provides data on where and what people focus on during interaction
Crucial for understanding how infants associate visual cues with verbal information
What are the two model types for coordination of articulators?
Context sensitive (“look ahead”) models
Context-invariant
What is the key question for context-sensitive models?
How do my articulators usually coordinate the upcoming sequence?
What is the key feature of context-sensitive?
Sensitive to upcoming event
Movements are preplanned to anticipate future articulations
What are context-sensitive models built from?
Motor primitives: smallest planning units
Motor programs: combinations of motor primitives
Motor plans: larger structures (phrases, sentences)
What is the key question for context invariant models?
What is the fastest way to get articulators from here to there?
What are the key features for context-invariant?
No look-aheads
Articulators average together adjacent movements automatically
What are the task dynamics in context-invariant models?
Define a task as movement toward a physical target
Dynamics: calculate forces needed to get from to target state
Things are computed on the fly
Pseudoinverse solutions determine efficient paths
What is the inverse speech problem?
Inferring the cause from an observed event
Could take many different paths but we don’t know cause we only see the outcome
What is the pseudoinverse solution?
Mathematical way to find the best possible solution to an inverse problem
Finds the most efficient combination of articulatory commands
What are the two different levels in unifying the theories?
Motor program level
Motor system level
Describe the motor program level
Stores abstract, reusable motor patterns
Guides section and sequencing of articulatory targets
Responsible for higher level planning
Describe the motor system level
Handles real time execution of motor plans
Implements the physical dynamics needed to reach specified articulatory targets
Resolves biomechanical constraints and fine-tunes motion paths
What are complex sounds?
Sounds that involve simultaneous use of multiple articulators
E.g., liquids, clicks, nasalized and voiced sounds
What is anatomical coupling?
The degree to which two articulators influence each others movements
What are tightly coupled articulators?
Movements in one often affect the other
What are examples of tightly coupled articulators?
Tongue tip and tongue body - shared musculature leads to interdependence
Lips and jaw - jaw lowering often affects lip position
What are independent articulators?
Can move without significantly affecting each other
What are examples of independent articulators?
Velum - moves independently from most oral articulators
Larynx - voicing and glottal gestures can co-occur with almost any other articulation
What does anatomical coupling matter?
Ease of coordination: independent articulators are easier to coordinate, more combinations possible
Typological trends: sounds that combine independent articulators are more common across languages
Learning difficultly: sounds requiring tightly couple articulators are harder to learn (especially for second language learners)
What is articulatory overlap?
Simultaneous movement of different articulators
Common when articulators aren’t anatomically coupled
*soup vs seep
What is the problem with articulatory conflict?
When adjacent speech sounds require anatomically coupled articulators to move in opposite directions, conflict arises
What is the solution for articulatory conflict?
Deletion: delete one of the sounds
Transition: move the articulator from one position to the other
Compromise: pick a middle ground between them
