Multimodal integration Flashcards
True or False: It is important for an organism to be able to bring to gather information from the different sensor system
True
What is Multimodal integration?
Integration of information different sensory modalities
Multimodal integration is important for a wide variety of activities
An example is __________.
Motor Control
_________ behaviors response should be able to activated not only a single type of sensory stimulus but for example either the sound or the sight (or both) of a predator
Escape
__________ –> requires information from our vestibular system –> helps us to know which way is up
and
from the __________________ –> sensory in our joint tell us the positions of our legs
and
even helped from our ______________ –> helps us to know whether our heads are straight or learning
Posture
Somatosensory system
visual system
Multimodal integration is important for a wide variety of activities
Another example is __________.
Commiucation
____ greeting each other uses many modalities of sensory information.
When they meet they will
bark providing _____________
wag their tails providing ____________
sniff each other providing _________________
Dogs
Auditory information
Visual information
Olfactory information
__________ also use information of several modalities for communication
Although much of our communication is through
having speech –> ___________
replying on seeing people’s expression to know the emotional content of what they are saying –> _______________
(important to know if somebody is serious or just kidding)
Humans
Auditory
Visual
We also use visual information during communication by ________________.
reading people’s lips
What is the McGurk effect?
How to demonstrate the effect?
Illustrates our ability to read lips
To demonstrates the effect –> scientist took a videotape of someone’s face as they were saying GA GA GA
On a soundtrack of video –> they put the person’s voice saying BA BA BA
In this case, the visual information (GA) is in conflict with the auditory information (BA)
Most adults (98%) think they are hearing DA –> so-called _____________ where the D is a result of _______________.
In reality, you are hearing the sound BA while you seeing the lip movements GA
Most adults (98%) think they are hearing DA –> so-called Fused response where the D is a result of audio-visual illusion
In reality, you are hearing the sound BA while you seeing the lip movements GA
Neurons located in _____________ regions increase their firing rates when they receive stimuli from multiple modalties.
Multimodal integration
Such cells can detect _________________ as long as low intensity stimuli from two or more modalities are present at the same time and place.
very low intensity stimuli
Which species have shown a very good ability to locate objects in auditory space, in fact, localize prey even better if they combine auditory and visual information?
Owls
Where does the integration of information occur in the owl’s equivalent of the superior colliculus?
(hint: midbrain)
Optic tectum
What is the major problem in multimodal integration?
What two sensory systems are difficult to combine?
There is a major problem in how to combine
the visual
and
auditory information in the tectum.
Why are the visual and auditory systems hard to combine in the optic tectum?
The two sensory systems use different coordinate systems to map where objects are located
What kind of systems does the auditory system uses?
(Hint: ear is attached to the head)
Head-center coordinate system
True or False: The owl’s auditory tectum is a multimodal area.
False
It is not a multimodal area