Multimodal integration Flashcards

1
Q

True or False: It is important for an organism to be able to bring to gather information from the different sensor system

A

True

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is Multimodal integration?

A

Integration of information different sensory modalities

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Multimodal integration is important for a wide variety of activities

An example is __________.

A

Motor Control

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

_________ behaviors response should be able to activated not only a single type of sensory stimulus but for example either the sound or the sight (or both) of a predator

A

Escape

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

__________ –> requires information from our vestibular system –> helps us to know which way is up

and

from the __________________ –> sensory in our joint tell us the positions of our legs

and

even helped from our ______________ –> helps us to know whether our heads are straight or learning

A

Posture

Somatosensory system

visual system

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Multimodal integration is important for a wide variety of activities

Another example is __________.

A

Commiucation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

____ greeting each other uses many modalities of sensory information.

When they meet they will

bark providing _____________

wag their tails providing ____________

sniff each other providing _________________

A

Dogs

Auditory information

Visual information

Olfactory information

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

__________ also use information of several modalities for communication

Although much of our communication is through

having speech –> ___________

replying on seeing people’s expression to know the emotional content of what they are saying –> _______________

(important to know if somebody is serious or just kidding)

A

Humans

Auditory

Visual

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

We also use visual information during communication by ________________.

A

reading people’s lips

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is the McGurk effect?

How to demonstrate the effect?

A

Illustrates our ability to read lips

To demonstrates the effect –> scientist took a videotape of someone’s face as they were saying GA GA GA

On a soundtrack of video –> they put the person’s voice saying BA BA BA

In this case, the visual information (GA) is in conflict with the auditory information (BA)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Most adults (98%) think they are hearing DA –> so-called _____________ where the D is a result of _______________.

In reality, you are hearing the sound BA while you seeing the lip movements GA

A

Most adults (98%) think they are hearing DA –> so-called Fused response where the D is a result of audio-visual illusion

In reality, you are hearing the sound BA while you seeing the lip movements GA

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Neurons located in _____________ regions increase their firing rates when they receive stimuli from multiple modalties.

A

Multimodal integration

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Such cells can detect _________________ as long as low intensity stimuli from two or more modalities are present at the same time and place.

A

very low intensity stimuli

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Which species have shown a very good ability to locate objects in auditory space, in fact, localize prey even better if they combine auditory and visual information?

A

Owls

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Where does the integration of information occur in the owl’s equivalent of the superior colliculus?

(hint: midbrain)

A

Optic tectum

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is the major problem in multimodal integration?

What two sensory systems are difficult to combine?

A

There is a major problem in how to combine

the visual

and

auditory information in the tectum.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Why are the visual and auditory systems hard to combine in the optic tectum?

A

The two sensory systems use different coordinate systems to map where objects are located

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What kind of systems does the auditory system uses?

(Hint: ear is attached to the head)

A

Head-center coordinate system

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

True or False: The owl’s auditory tectum is a multimodal area.

A

False

It is not a multimodal area

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

True or False: Owl’s auditory tectum will see a sound straight ahead of us in the real world (at 0 elevations, 0 azimuths) will excite cells at the location in the auditory map where the zero is azimuth line crosses the zero isoelevation line.

A

True

21
Q

What happens when we turn our heads?

(Hint: The information about IID and ITD that are used by the brain to localize sounds in space depending on the location of the sound with respect to our ears.)

A

The sound has not changed its location in the world, but it has changed its location with respect to our ears.

22
Q

If we turn our head 10 degrees to the right wherein the auditory tectum will cell respond?

A

10 degree to the left

23
Q

Now with our head turned, where in the real world would we have to place the stimulus (for example, speaker) in order to get cells at 0,0 points in the tectum to respond?

A

10 degrees to the right in the real world

24
Q

Summary of the auditory system

So the locations on the map in the auditory tectum do not correspond to places in the real world but rather to __________________.

A

places with respect to where our head is

25
Q

What system does the visual system use?

A

An eye-centered or retinotopic coordinate system

26
Q

If we are looking straight ahead and our head is pointed straight ahead, wherein the tectum map will cell respond to an object located straight ahead?

(0 azimuth, 0 elevation)

A

At 0, 0

Shown as A in the figure

27
Q

If we turn our heads but keep our eyes looking at the object where will cells respond to the object?

(side-eye)

A

At 0 elevation and 0 azimuth

Point A on the image

(eye does not move)

28
Q

If we keep our head stationary but turn our eyes 10 degrees to the right where will cells respond?

A

-10, 0 –> 10 degree to the left

Shown as point B in the figure

(eye moves)

29
Q

Summary of the visual system

So cells in retinotopic map do not care where objects are in real-world or where they are with respect to our heads but rather where an ________________________.

A

the object is with respect to where our eyes are looking

30
Q

True or False: The different coordinate systems used by the visual and the auditory systems we have a problem combing information from the two systems into one coherent map.

A

True

31
Q

If an object is directly in front of us and our eyes and head are facing straight ahead where will cells be activated in the two maps?

A

Visual A; Auditory A

32
Q

If we turn our eyes 10 degrees to the right without moving our head where will cells be activated in the two maps?

A

Visual: B, Auditory: A

33
Q

This creates a problem in our brain because our _________ is now telling us that the object is in a different place from where our _____________ is telling us the object is located.

A

Visual system

Auditory System

34
Q

The _______________ is the brain location which has to solve this problem between the auditory and visual system in the brain.

(Hint: the midbrain)

A

Superior colliculus

(optic tectum)

35
Q

Superior colliculus receive information about ______________________

and

needs to __________________.

Also receives information about ______ and ________ positions

Superior colliculus controls motor behavior called ________, which is the behavior of turning our eyes and head toward the location of auditory or visual or multimodal stimuli.

A

locations of both auditory and visual stimuli

integrate that information

eye and head

orienting

36
Q

Recap of the problem

The visual maps in superior colliculus are in _______________ like visual maps in other brain areas.

A

retinotopic or eye-coordinate coordinates

37
Q

In order to match this map, we would expect to find that the auditory map would also be in __________________ and the auditory receptive fields would have to move when we move our eyes in order to keep the two maps in the register.

A

Eye coordinate

38
Q

A _________ between auditory and visual information occurs in the superior colliculus

A

mismatch

39
Q

When the eyes move, the auditory receptive fields in the superior colliculus (do/do not) move, but they _____ about 1/2 as far as the visual receptive field move.

Therefore there remains a mismatch between auditory and visual information.

A

do

move

40
Q

True or False: This mismatch is probably the reason that the orienting behavior controlled by the superior colliculus is so strong.

A

True

41
Q

When we ______to a stimulus, we move our head and eyes toward it so that it is now straight ahead of both our head and our eyes.

A

orient

42
Q

True or False: A normal adult owl with prism glasses shift everything it looks at 23 degrees to the right, the adult animal show changes in behavior adjusting to this situation and when the glasses are removed from an adult animal it can’t orient correctly to visual cues.

A

False:

Adult animals show no changes in behavior

and

when glasses are removed it can orient correctly to visual cues.

43
Q

In young animals, plasticity can occur during the _________.

A

critical period

44
Q

True or False: In the Critical period, When they a young, Over time, the auditory map in the optic tectum adjusts to being in register with the visual maps.

A

True

45
Q

True or False: Young owl makes auditory mistakes 23 degrees to the right as well as visual mistakes. This is an example of the McGurk effect, which shows the primary role played by the visual system.

A

True

46
Q

_____ shows that the visual system is primary even in animals with the good auditory system.

A

Bats

47
Q

Bats use a system called ___________ to find their preys.

A

Echolocation

48
Q

To use echolocation, the bate _______________ when it hunts and listens for the _________- of it noices bounchng off of it prey.

A

continually makes sounds

echos