Lecture 3 - memory temporal binding Flashcards
What is visual binding?
The visual cortex has many retinotopic mans, each representing a specific feature (colour, orientation, motion, form)
The process of putting together all of this information to generate integrated percept is called visual binding
What is binding in hearing?
- Complex sounds are presented as one
- Auditory cortex doesn’t represent sound features separately
- It is called temporal binding
What happens with short snippets of sound?
- The word hello is played and we can understand the whole thing
- When first 50 ms is played we cannot understand
What happens with short snippets of vision?
- The power of the human mind
- As long as the first and last letters are presented in the right place, we can read . the sentence.
What is serial processing?
The temporal ordering of sound . events is crucial for speech to make sense.
What are the fundamental differences in processing strategies for hearing and vision?
Visual processing seems to be parallel and auditory seems to be serial.
What is the problem of temporal binding?
- The brain’s task is to map this time-evolving structure to meaning
- The auditory system never ‘sees’ . the spectrogram equivalent, only a small fraction at a time.
- This is a limitation that can only be overcome with memory
What is a spectogram?
An image of how the frequency structure of sound evolves over time.
What are saccadic eye movements?
- When the eye darts around the visual scene in fast saccadic movements (20-30ms) up to 5 times per second
- It stays put for 50-200 ms before the next saccade occurs.
- High acuity only in the centre of the visual field (foveation) - the rest is blurred.
- During saccade, no visual info is passed to the cortex. We are blind about 20% of time .
What are the challenges of visual perception?
- The info arriving in cortex comes in short discontinuous bursts of up to 200 ms .
- Between the bursts there is no info coming in
- Yet, we perceive . the visual world as populated by steady objects in full focus
What does perception of a steady visual world involve?
- Feature binding
2. Temporal binding across saccades - the time order of the saccades does not matter in this binding
What are the challenges of auditory perception?
- Information arrives in a continuous stream to the ear, with no periods of temporary deafness .
- Info from different sources is mixed but sounds are perceived as unmixed.
What processes does auditory perception involve?
- Unmixing of sources
2. Temporal binding of each source - in this kind of temporal binding, time order is essential
What are the fundamental differences in Binding for VISION?
- Temporal binding works by integrating randomly sampled images (mostly out of focus) into percepts, with continuity and stability
- The brain controls the time order of the sampling
- The time order is filtered out from the representation
What are the fundamental differences in binding for AUDITION ?
- In hearing, temporal binding works by integrating auditory information in the order in which it arrives
- The brain has no control over the order of this
- The time order is maintained in the representation