5 The Hearing Brain and Voice Perception Flashcards
what does voice reveal about you
Voice hints at how social you are - introverts and extroverts
Your trustworthiness - deep pitch at end of word in men
Higher pitch at end of word in woman
When saying hello
Trust worthy
Stressed - vocal cords tighten - disorganised speech
Speaking slowly - in control - indicator keep emotional in check
what is voice dependent on
Voice is dependent on vocal tract
Parameters of voice dependent on anatomy
Dependent on physical state - vocal tract vibrates differently
study about voice revealing a lot about you
N = 320 participants rated social traits on “hello” spoken by 64 people
High consistency
If voices convey no information, ratings on these social traits would be random.
But Cronbach Alpha (a measure for interrater agreeableness) suggests that people consistently agree on whether a voice sounds attractive or confident.
We seem to associate voices with social traits on a collective level.
Many social traits are related and can be mapped to two principle
components, what are they?
In both genders,
The 1st Principle Component is highly correlated with Trustworthiness;
The 2nd Principle Component is highly correlated with Dominance.
they are independent of eachother
what can a hello tell us
From a simple “hello” we can quickly assess the speaker’s personality and decide whether and how to approach them.
how are voices transmitted
• Voices are transmitted via vibrations of the air.
what are the 3 parameters voices can be decribed as
pitch
intensity
tempo
what is pitch
high or low
fundamental frequency
Female or male Stressed or sad Vibrations of energy Vibrates a lot - higher frequency - high pitch Vibrates slowly - low How fast energy oscillates
pitch - vibrates alot
high voice
pitch - vibrates slow
low voice
what is intensity
amplitude
How far the peaks and troughs are in the voice
Loud - high
intenisty- loud
high peaks low troughs
intensity - quiet
small peaks and troughs
what is tempo
speed
how fast you talk
when you enjoy something
pitch up
intensity down
tempo down
when you experience elation
pitch up
intensity up
tempo down
when experience sadness
pitch down
intensity down
tempo down
when experience grief
pitch up
intensity up
tempo up
different emotions are experiences differently
distinct acoustic profiles
Software to analyse voice
Different emotions have different acoustic profiles
Elations increase different amount in comparison to grievances
can all emotions be reliably dinstinguished from each other
no
german people speaking - can the vocal emotional expressions be recognised by people from a different culture?
Record saying pseudosentences in different emotions
Emotion is not very clearly distinguished from other emotions
Their performance in detecting German emotions are low in comparison to European counterparts
Measures how consistent they’ve judged these emotions between pps
Indonesia - confused by German emotions
Indonesian and german
Some vocal emotions are shared cross cultures
Others may be influenced by culture- and language-specific factors
joy is most ambiguous emotion
what do voices convey information
Voices convey important socio-emotional information
can information be accurately decoded by the brain
This information can be accurately decoded by the brain:
• There must be specialised neural architecture to process voice
• And different processing pathways for different aspects of voice
fMRI assumptions
Increased neural activity needs more oxygen and glucose
fMRI detects changes in blood oxygen levels, which indirectly reflects the changes in neural activity
fMRI allows us to study cognitive activity in vivo, without causing any harm to the brain
based on assumption when brain working hard need more oxygen and glucose
what does the temporal voice area (TVA) show in voice perception
Listening to voices vs. non-vocal sounds elicits increased bilateral neural activity in the temporal cortices
It provides objective evidence that there are brain regions dedicated for voice processing
what is neural adaptation in speaker adaptation
Neural Adaptation: a gradual decrease over time in the responsiveness of the sensory system to a constant stimulus
Some brain regions will adapt to repeating speaker identity in the voice
some brain areas will adapt to repeating syllable in the voice
belin, zatorre , 2003
how to undersrand which part of brain responds to speaker identity
Understands which part of brain area responds to speaker identity
Repeat over and over - brain gets adapted to it and it no longer bothers you - e.g. constant fan
Exhaust the responsiveness of sensory system
Speaker identity - respond less when same speaker
Repeat syllables - brain area that responds to syllables will adapt - different speakers but same syllables
which brain area adapts to the repeating speaker identity in the voice
Speaker identity
Right side of brain - anterior part of temporal lobe
Part of the brain that responds to the person
what did grandjean et al 2005 find
participants pay attention to the angry voices
and the left audio
right voice area selectivey responses to angry speech
Are the Voice Areas necessary for voice processing?
Correlation is not causation
cannot say whether brain area is causally libked to voice processing