Unit 4 Flashcards
Temporal patterns are informational ____
Substrate
What are the 2 aspects of temporal processing?
- Temporal resolutoin/acuity
- Temporal integration
What is temporal resolution/acuity?
- How to follow the temporal changes
- Ability to follow quick change, mostly the envelop of the sound
What is temporal integration?
- Increasing sensitivity by integrating information over a long duration
- Integrate information to improve hearing
Temporal patterns are very important which carry ____
Information
The temporal envelope of speech is resulted from ____, in addition to the amplitude changes of pronunciation of vowels, constants.
Speech on and off
Explain the temporal envelope
How we quickly follow change of signal in a time line (not in fine structure, but in an envelope)
What is the envelope frequency?
Range from few to several hundred Hz in speech
What is the spectrum of the envelope? What does it correspond to?
Peaked at 3-4 Hz, corresponding to the speed of words/sec.
What do vowels contain?
Vowels contains Fn (n=0, 1, 2, 3 for fundamental frequency (F0) and formants)
The interaction among the formants produces ____
Temporal fluctuation
Therefore, speech (esp. vowels) can be mimicked by ____
Amplitude/frequency modulation
How many peaks does speech have in frequency?
- 0-4 peaks
- 0 is the FF of speech
- F1, 2, 3 = formants (they are separated across the frequency range of speech); interaction among them creates modulation (amplifying signal over time = creates the temporal pattern; speech)
The ____ is more prominent than the ____ in speech
Envelope, fine structures
With music, the ____ is more prominent than the ____
Fine structure, envelope
The ____ and ____ are both important for sound
Envelope. fine structure
What are two types of temporal resolution?
Within- or cross-channel resolution (Within channel is closer to real life, but in some studies, we use cross channel)
What is an example of within or cross channel resolution?
Example, gap markers in the same (within) or different (cross-channel) frequency bands
Peripheral versus Central limitation
- Limitation from synaptic transmission, bottom-up
- Peripheral is bottom up
- Limitation due to the need of top-down process
- Central is top down
More ____ = more time delay and poor temporal resolution
Synapse
Simple Estimates of Within-Channel Acuity
- what numbers do you use
- what is the minimal click interval
- what does it give you a good estimation of
- Use a single number (index) to indicate temporal resolution
- Present clicks presented in sequence, Minimal click interval is ~ 6ms.
- This is a good estimation of auditory temporal resolution
Explain why the minimal click interval is ~6ms?
Equal intervals (decrease interval to find the points where subject cannot detect separation & hear continuous sound - around 6ms; we can hear the clicks larger than 6ms, 160 clicks/sec; above that we hear clicks)
Temporal resolution to click trains (6)
- how to present clicks
- how does the rate of the train change
- how long does the sense of separated clicks remain
- what is the approximate of temporal res with click trains
- what shows a similar result
- Clicks presented in train
- The rate of the train is increased from low to high
- The sense of separated clicks remains up to the rate of 150/s or 160/s
- Or 6 ms is the approximate of the temporal resolution with click trains.
- Similar result is seen using tone burst of 4 kHz, in which the resolution was evaluated as the minimal intervals between the tones.
What are the methods for evaluating temporal resolution? (5)
- Paired clicks
- Duration discrimination
- Gap detection
- Amplitude modulated noise
- Neural coding
What if we use paired clicks?
- Two pairs of clicks
- In first pair, the first click is louder/weaker than the second one
- The order is reversed in the second pair (or equal)
- Two pairs are identical in frequency spectrum (different in amplitude)
- Listeners differentiate them by detecting temporal order
- Resolution is indicated by the minimal interval upon which the order can be told correctly
If we use paired clicks, what does temporal resolution go down to?
2 ms
Each interval presents a pair of clicks
Using clicks, the temporal resolution is in the range of ____
2-6ms
Binaural testing, ____ is much smaller
Temporal resolution
Effect of overall duration on Discrimination of signal duration (WF)
- The Weber’s fraction should be constant (or Weber’s law is well followed).
- No difference related to bandwidth of signals
How does duration discrimination work?
- Ask the subject to tell which signal is longer or shorter (only changing with duration, same signal)
- The duration threshold is presented against the baseline duration (linear scale)
- From this data we can predict that WL is largely followed in duration discrimination test
What is gap detection?
Ability to identify a (silent) gap between two sounds or an interruption of a sound by varied formats
What is the gap?
Gap can be a silent period or one in which sound intensity is largely reduced
What is the gap threshold?
- Gap threshold (_t) is defined as minimal period of gap that can be identified.
- Below that, the subject tells the sound to be continuous
How is gap detection measured?
Gap detection can be measured in behavior test, or in objective test like evoked potential
Explain the gap markers
- Before the gap you have a pre-gap marker (first signal) and after the gap there is a post-gap marker (second signal)
- The signal can be a tone burst or a noise burst (noise burst is better)
Explain gap markers
- what noise is used
- what type of noise can contaminate frequency cues?
- Can use broadband noise and narrow band signals
- Contamination of Frequency cues (if narrow band signal is used)
- An issue when using narrow band signal and sudden on/off
How to overcome the frequency cues? (3)
- Masking with notch noise: can also splatter when turning masker on and off
- Bandpass filter to get rig of contamination: cannot always eliminate contamination
- Ramping: making it difficult to define gap duration - causes the gap to be unclear
Can notch noise have frequency splattering?
Sometimes the notch noise can have frequency splattering
What sound has splattering?
When you use tone burst, you need to think about the frequency splattering at onset and offset (provides frequency cues, not temporal cues), so you are unable to tell the temporal resolution as it is contaminated
Can bandpass filter always eliminate contamination?
No
Gap detection is based upon sensation change around gap
- what can the pre and post gap marker be different in and what does this cause
- Pre- and post-gap marker can be different in terms of amplitude, duration and frequency.
- If different in frequency, then tests cross-channel
- If both are same in frequency, within channel test.
Explain how we detect a gap (and how that happens)
- The sensation change is due to the onset and offset of signal
- When the signal turns on, our sensation takes time
- When the signal turns off, our sensation of sound gradually goes down (it takes time)
- If the gap is short enough, the sensation will not start from zero, but from the declined curve (whatever has not disappeared from the pre gap off)
- Then, the sensation takes time to reach plateau
Explain delta s and delta t with gap detection
- Delta s depends upon the gap
- If delta s is smaller, the off-set marker (in the second tone), will continue to to get higher up on the first tone
- Shorter delta t, delta s is reduced (and eventually become 0) and the second tone will not be sensed (sensed as only one tone)
Effect of intensity: equal marker intensity
- The impact of sound level is seen near hearing threshold
- Not changed by sound level well above threshold
Examining the effect of gap marker bandwidth
- Gap marked with equal sounds
- Markers: broadband signals and narrow signals
- broader the masker BW, the better the gap detection threshold (smaller)
Our system can integrate information across broad frequency region to improve ____
Temporal resolution
What is a very influential aspect of gap detection?
Gap marker BW
smaller thresholds with broader ____
Bandwidth
The broader the bandwidth of a gap marker, the lower the ____
Threshold
The impact of hearing loss on gap threshold
- High-fre HL: deteriorated gap threshold when using broadband markers
- Attributed to the reduced audibility
- Evidence: When high-pass masking is used in normal hearing subjects, similar changes were seen
- High frequency channels have better temporal resolution
Gap detection threshold goes down with ____
Hearing loss (especially SNHL)
SNHL and fake HL
- High pass filter just masks high frequency region, creating a fake hearing loss (if you compare artificial hearing loss and real hearing loss, there is no difference)
- When you have HF HL, you naturally reduce the bandwidth of gap marker (if you use a broadband signal, the HFs will be useless due to HL)
- This is why individuals with HF HL have poor temporal resolution
Gap detection in different setting (3)
(a): within channel (same frequency band)
(b) /(c) between channels (different)
(c): diff in onset (must be “between channels”)
Detection of Sinusoidally Amplitude Modulated Noise - modulation depth
- % modulation:
- Average amplitude/p-p% (peak to peak);
- or p(peak)-t(trough)/average%
dB: 20log(%), e.g., 10%~ 20log(0.1) = -20 dB
Detection of Sinusoidally Amplitude Modulated Noise - minimal depth of modulation
Minimal depth of modulation (that subject can detect)—detection threshold with modulation frequency—Modulation transfer function (MTF)
What are the 3 different ways to modulate noise?
- modulated vs. unmodulated
- modulation with different MF
- modulation with different depth
What is the modulation transfer function (MTF)?
The MTF addresses the ability to detect the presence of amplitude modulation in a sound
Explain what type of function MTF is
- normal
- temporal processing deficits
- The MTF is typically low-pass function: larger modulation depth threshold at larger modulation frequency (MF).
- In subjects with temporal processing deficits, larger modulation depth threshold is seen at high MF.
Neural Coding for ____ Analysis
time
Temporal Processing in Cochlea
- Phase locking or synchronization
- Envelope coding
Demonstration of envelope coding
- PSTH
- ISIH
- PRH
- These require repeated stimulation
How are neurons really coded in your brain?
Image the real neuronal envelope coding by Volley principle (this is what really happens in your brain)
Example of ISIH
- Inter spike interval histogram
- If phase locking is perfect, each individual auditory nerve will produce 1 spike per period
- When the frequency of signal is high, the auditory nerve cannot follow that (can’t see a clear interval or period)
- By chance, we are likely to see the interval the same as 1 period (1 spike per period)
If the AN skips one period, you will see interval of 2 or 3 period - This is how we show periodicity of response
Synchronization in AN firing
- Increasing sound level causes better sound locking (the spikes are more likely to occur at a certain phase)
- Distribution becomes narrower and narrower with better phase locking
Summary of temporal coding by auditory nerve
- how do ANs encode temporal information of sound?
- how is phase locking established?
- Auditory nerves encode temporal information of sound by phase locking
- Phase-locking is established by integration of responses from many neurons.
In reality, do we need to repeat stimuli many times to detect sound?
In reality, we don’t need to repeat stimuli many times to detect sound (volley principle)
Modulation Transfer function of Single Neurons
- Modulation transfer function typically shows low pass function
- However, by a single neuron, this is different (bandpass transfer function)
MTFs of IC single neurons: different best MF
- Results show a very sharp MTF for each individual neurons
- The peak points are the best modulation frequency
- For each neuron, there is a typical best modulation frequency (can detect temporal modulation better at a specific frequency)
Majority of neurons have best modulation between ____ (results from IC)
30-100 Hz
Behaviour modulation transfer function is ____ pattern, single neuron modulation transfer function is ____
Low pass, band pass
Place code for best modulation frequency
- Concentric distribution of neurons with the same BMF
- The neurons on the surface of the cone show the same BMF
The iso-BMF surface is in a cone shape taping to dorsal side (low frequency) - Another example of place code in auditory processing
In the central auditory cortex, neurons with the same CF are distributed on a ____
Flat plane
Neurons with the same best modulation frequency in the IC are distributed in a ____
Cone shape
Neurons response follows the ____ of the signal
Envelope
Masking Pure Tones with White Noise: increased masked threshold with frequency
- 10 dB/decode = 3 dB/octave
- Masking with white noise is more effective on the high frequency side due to white noise density (it will mask more)
Signal(energy)/Noise (spectrum) level required for detection
- For a higher fre. signal, we need a larger SNR to hear.
- Higher masking effect.
- Remember the spectrum of the noise is flat.
Concept of Sound Density
- White noise has equal density across frequency
- Density = power in unit frequency range.
Total power in a frequency range = density * delta f - The energy/power effective for masking exists in critical band: P = density*CB
Concept of Critical Band (CB)
- For a particular signal, only the energy in a certain band around the frequency of this signal impacts the hearing of this signal. This band is called as critical band
- It can also be defined as the frequency spectrum that one neuron will respond to.
- Therefore, in a broad band masker, only the energy in CB will produce masking.
Effective masking and critical band
- Noise energy beyond CB is not useful
- Only energy inside CB will produce masking
The width of Critical band changes with ____
CF
Effective masking increases with frequency because the CB increases with ____
Frequency
Higher the frequency, larger the ____
CB
Effective Masker: bandwidth consideration
- Only energy within CB is effective
- CB increases with CF in linear scale
- But keep constant in ratio scale: 20% or 1/3 octave around CF
- Therefore, the masker for pure tone should be narrowband noise of 1/3 octave.
What type of masker is used in clinic?
Narrowband masker (to reduce the total level of masking so it is more acceptable by client)
When ____ is used, the effective masker level actually increases with ____
white noise, CF
Therefore masked threshold increases with ____
CF
Measuring CB with masking
- Keep the total intensity of the masker the same
- Increase bandwidth of the masker from zero
- Within CB, masked threshold should be? Maintained
- When beyond CB, masked threshold will be? Decreased (because some energy gets lost, and threshold goes down)
- The turning point tells CB.
What happens to the masked threshold within the CB?
Threshold won’t change
What happens to the masked threshold beyond CB?
- Beyond CB, the masked threshold will decrease, because some masker energy got into other channel so that is not effective.
- Outside the CB, energy from the masker is useless (only energy inside the CB is useful)
How do we need to change the level of the masker to have the signal just masked?
-within CB
-beyond CB
- Within CB: masker level should not be changed.
- Beyond CB: masker level should be increased
Test hearing threshold while increasing signal bandwidth within CB. What will happen?
The threshold will not change, energy is in the CB
However, if the signal frequency range is beyond CB, then what will happen?
Beyond CB, the power thins out so there is not enough energy to evoke a response within CB. Need to boost up the total sound level to increase threshold.
Co-modulation masking release
-signal band vs. flanking band
- Signal band: band around signal
- Flanking band: band far apart from the signal band
- Flanking bands does not change masked threshold because they are far away from CB
Comodulated vs. Uncomodulated
- Comodulated: see release or decrease in masked threshold
- Uncomodulated: no change in masked threshold
Does co-modulation change the CB?
Does not change the CB
Adding of more maskers in flanking band reduces ____, if co-modulated
Masking in the signal band
Overshoot
- Masking effect depends on the time relationship for signal in masker
- Larger masking when the signal is close to the onset of masker
- Up to 10-15 dB
- Disappeared when delay (onset of masker-onset of signal)> 200 ms
Masking effect is larger when signal is closer to the ____ of the masker
Onset
When the signal moves away from onset, masking effect ____
Reduces and plateaus (>200ms)
Temporal masking
The masker can be presented after signal (backward masking) or before (forward masking), or combined
Monotic, dichotic, and diotic
- Monotic = signal and masker go to the same ear
- Dichotic = signal goes to one ear, masker goes to other ear (no interaction between masker and signal in cochlea)
- Masking occurs in the brain
- Diotic = real life
What hypothesis does forward masking use?
Forward masking uses the line busy hypothesis (the vibration produced by the masker makes the cochlear partially occupied (this occupance declines with time after offset); this is why masking effect goes down with time (this doesn’t happen in backward masking because the signal occurs earlier`
Where does the largest masking occur in forward masking?
Forward masking = largest masking occurs closer to the offset of the masker
- Masking effect reduces with time as the cochlea occupation goes down
Where does the largest masking occur in backward masking?
Backward masking = largest masking occurs closer to the onset of the masker
Mechanisms for temporal masking
- Forward masking is relatively clear:
- Overlap in BM vibration,
- Neural adaptation,
- Central masking (indicated by cochlear implant)
- Backward masking: not sure if there is a central role
Similarities between central and peripheral masking
Difference
- Masker to contralateral ear
- Similarities between central and peripheral masking:
- Frequency relationship
- The masking effect and time-relationship between masker and signal
- Difference: much smaller threshold shift in central masking
Is there interaction between the masker and cochlea in central masking?
No
Closer the masker and signal = larger the ____
Masking effect
Is the central masking a large effect?
Central masking causes a smaller threshold shift (the masking effect is not as larger for central masking as it is for peripheral masking)
Central masking is ____
Dichotic
Peripheral masking ____
Monotic
Masking effect is stronger at the ____ of the masker
Onset or offset
Informational masking
- Interaction between masker and signal at higher level of auditory pathway
- No overlap between masker and signal
- Opposite to peripheral masking (in cochlea), which is also called energetic masking
- Depends upon the overlap of the masker and the signal
- Targeted tone (or speech) in the presence of multi-frequency masker (similarity and uncertainty impacts performance)
- Test masked threshold in 2IFC
- Subject chooses which one contains a signal
- There is a central component because it relies on context
- Frequencies of the masker randomized
- CB around targeted signal is “protected”—to avoid energetic masking
Central masking = max masking effect of ____ dB
15
Informational masking = max masking effect is ____ dB
30
Informational masking is used in ____
2IFC
The informational masking of ____dB is typically larger than the effect of central masking (in dichotic presentation)
30
____ has a smaller masking effect than ____
Informational masking, energetic masking
Informational masking by uncertainty
- The effect due to randomization
- Larger the randomization, larger the effect
- Difference becomes smaller with increasing number of components in the masker
More uncertainty with ____
Less components (harder to hear the signal)
More certainty with ____
More components (easier to hear the signal)
Larger the randomization, larger the effect of ____
Masker (harder to hear the tone)
Why do we need to know the masking and the mechanisms? (4)
- To understand how masking changes our hearing.
- To use masking as research tools.
- Notice the gaps between what we have discussed and what we need for the signal detection under masking.
- Further learning is required.
How do we detect signals in noisy background? (4)
- Spatial filtering: Detect signals by differentiating the source from noise—depending on binaural process.
- Spectral filtering/frequency selectivity: selectively filter out noise—but won’t work if the spectrum of noise is largely overlapped with that of signals.
- Temporal filtering: distinguish signals based upon the time difference, e.g., signals in the trough of noise.
- Cognitive processing: Detect signals by using experiences (familiarity to the signals)—depending on top-down process. This is shown in part of “attentional filtering”.
- At a party you recognize familiar voices
The neuro-mechanisms contributing to signal detection in noise
- The function of binaural processing—related to temporal processing, inhibition, efferent etc; to spatial filtering.
- The role of inhibition to spectral filtering and other process.
- The role and the mechanisms of high temporal resolution in the auditory system.
- The role of low-SR ANFs and efferent control of them on noise resistance in hearing.
- The interaction between ascending and descending pathways.
- The role of cochlear efferent control—the masking release effect.
- Cognition and selective attention
- This changes with HL and age
Two methods considerations for frequency and pitch
Pulsed signals and frequency modulation (FM)
How to reduce frequency splattering at on/off for a pulsed signals (gated pedestal)?
- Use (slow) ramp
- Masking (such as notch noise)
Cannot present two tones simultaneously for frequency discrimination, because of ____. Therefore, ____ is not useful.
pitch fusion, continuous pedestal