PSYC2020 Practice Questions - Wk7 Multi-Sensory Integration Flashcards

1
Q

What is an example where vision helps to resolve a perceptual ambiguity?

A

When in a noisy, crowded space (eg bar) and its difficult to hear people, looking at their face can improve understanding of speech.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What 2 effects do multimodal stimuli tend to have? 1ex

A

Perceived faster & more reliably

A flash with beep in a cockpit pulls more attention than isolated flashes or beeps

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What senses combine to give flavour perception? 3

A

Taste, smell, somatosensory

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What factors further modulate flavour experience? 4

A

Sight, sounds, smells, expectation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What are 3 things multimodal stimuli can do?

A
  1. Resolve ambiguity
  2. Faster responses
  3. Create novelperceptual experiences (flavour)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is the primary role of the brain? 2

A

Determine what is out there in the world, then decide on the best action/behaviour

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What decision guides the behaviour and survival?

A

Approach or avoid?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What factors make an organism more likely to survive? 2

A

Speed and accuracy of evaluate external info and reacting to it.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What types of information can be gathered about the world? 4

A

Light
Sound
Mechanical
Chemicals

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

How can the experience of flavour be modulated by non-taste factors? 4

A

Sight, sounds, smells, expectations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What are the most fundamental behaviours that perception helps guide? 2

A

Approach and avoid

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What ways do we gain information about the world? 4

A

Light, sound, mechanical, chemicals

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

When do different modalities substitute for each other?

A

When one is comprised. Eg

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What are the different fields of operation for senses?

A

Close (touch, smell, taste) and far/distant (vision, hearing)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Why is it important to resolve ambiguities?

A

Helps the brain boost signal to noise and understand the world better.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

How does MSI help us understand the environment?

A
  1. Improve stimulus detection and discrimination (speed & accuracy)
  2. Resolve perceptual ambiguities
  3. Create novel representations (eg flavour)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What are 2 models for explaining redundant targets effect?

A

Statistical facilitation (independent processing) & neural coactivation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What is the redundant targets effect?

A

Responses get faster for multisensory input rather than unisensory input, even though there is no additional info from more inputs.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

what are 2 models which attempt to explain the redundant targets effect?

A
  1. Statistical facilitation

2. Neural coactivation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Which model of the redundant targets effect presumes parallel (or independent) processing?

A

Statistical facilitation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What is statistical facilitation?

A

Faster times are just the result of parallel channels averaging to be faster

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What is neural coactivation?

A

the combination of different sensory channels combine and lead to faster activation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Why is the statistical facilitation incorrect and how was it tested?

A

reaction times were faster than the predicted limit of SF.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

what are the two things that integration needs to deal with?

A

What to bind

What to keep apart

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

what are 3 bottom up factors influencing MSI?

A

Temporal coincidence
Spatial coincidence
Temporal patterning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

What is temporal patterning?

A

How well correlated things are over time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

What are 5 top-down factors influencing MSI?

A
Stored knowledge
 Context
 Recent experience
 Expectation
 Attention
28
Q

Which MSI factors are objective and subjective?

A

Bottom-up; top-down

29
Q

How has context been shown to change interpretation in the stream-bounce display?

A

When there is sound the changes are continued even in the no sound trials.

30
Q

How has recent experience been shown to affect CMI in the stream-bounce task?

A

The previous response influenced the way current responses are formed.

31
Q

How do we know that recent experience is influencing the construction of a response, and doesn’t just mimic previous stimuli presence?

A

The effect of previous response is not related to sound in the stream-bounce display. It is just related to previous decision (ie how the problem was solved)

32
Q

What does the effect of recent experience show us about MSI?

A

How we solved a problem before helps us solve it again in the same way

33
Q

How did a modified stream-bounce reveal that expectations are influencing perception?

A

In objective conditions tracking speed diverges 300ms after.
In subjective: speed diverges 500ms BEFORE point of coincidence. So: percept was informed by what people expected/prepared for.

34
Q

Where do you find multisensory neurons in the CNS?

A

At nearly every level, no single MSI area!

35
Q

what 3 key areas are involved in MSI?

A

Colliculi, intraparietal sulcus, superior temporal sulcus

36
Q

Where do visceral senses come together?

A

Insular cortex (deep in the lateral fissure)

37
Q

What is reflexive orienting?

A

we automatically orient to sudden stimuli

38
Q

What does the superior colliculus produce or output?

A

Motor actions which are guided by sensory stimuli. Control of eyes, ears and head

39
Q

What happens to visual, auditory and somatosensory information in the superior colliculus?

A

They converge

40
Q

What are the inputs of the Superior Colliculus? 4

A

Retina, cortex, IC, spinal cord

41
Q

Which layers of the SC are multisensory?

A

Deeper layers

42
Q

What are 4 characteristics of multisensory cells?

A

Input from 2 or more sense systems
Overlapping RFs
Respond to single input - but weakly
Prefers multiple inputs for a stronger response

43
Q

where do early single cell recordings of the SC come from?

A

Cats (Stein et al)

44
Q

What is super-additivity?

A

Combined MS info can be greater than the sum of unisensory inputs (super boosted signal)

45
Q

What is sub-additivity?

A

Neuronal suppression of inappropriate signals

46
Q

What are the three drivers of MS enchancement in MS Neuron RFs?

A
  1. Spatial rule
  2. Temporal rule
  3. Principle of Inverse effectiveness
47
Q

What is the principle of inverse effectiveness?

A

Enhancement is larger for weak stimuli, vs strong

48
Q

What can be suppressed in a MS neuron obeying the spatial rule?

A

Spatial incongruence

49
Q

what happens to asynchronous stimuli, under the temporal rule?

A

The response resembles the unimodal response for the FIRST signal. Because they are too far apart in time.

50
Q

For weak congruent stimuli, how is inverse effectiveness shown?

A

When congruent, weak stimuli produce a response which is equal to the combined response of strong unimodal stimuli. So the RF treats weak signals as being stronger than they are.

51
Q

What is the superior temporal sulcus in a good position to determine?

A

What stuff is (ventral stream).

52
Q

What processing is the STS involved in? What does it do?

A

Audio-visual speech. It helps bind A/V input, regardless of speech or biological motion

53
Q

Where is the MCgurk illusion area? How do we know?

A

Left posterior STS. TMS reduces the illusion which shows that auditory/visual binding is reduced.

54
Q

What 2 controls were used by Beauchamp et al. (2010) when using TMS on McGurk illusion?

A
  1. Auditory only - make sure its not just speech perception (A & V!)
  2. Second site control
55
Q

What happened to a stroke patient who lost left posterior STS?

A

They regained the McGurk effect, because the function had migrated to right STS. Practice and neuroplasticity.

56
Q

What is the posterior parietal cortex in a good position to process for MSI?

A

Dorsal stream

57
Q

How does anodal tDCS on the PPC affect overall detection of A/V and bimodal targets?

A

Speeds reaction times for detection - when applied over right PPC

58
Q

What did Kamke et al 2012 find about the flash/beep illusion? What does this show?

A

TMS for left and right angular gyrus reduced the illusion. There was less binding of signals, even though both were still perceived.

59
Q

What happens when you TMS the right posterior parietal cortex in stream-bounce display?

A

There is a lower % of bounce responses for the sound condition. Ie people are not binding the stimuli together, so less illusion

60
Q

Is there MSI in unisensory cortex?

A

Yes, there is modulation of even low-level sensory cortex by other modalities.

61
Q

What did Calvert et al find about MSI speech perception using fMRI?

A

Auditory speech perception was improved when the speakers face was visible. This produced enhanced activity in the auditory cortex.

62
Q

What is direct evidence that auditory information can affect activity in the visual cortex?

A

Paired with a beep, less TMS is required to induce a phosphene (flash). Because auditory stimulation decreased threshold for effect.

63
Q

What happens to brain activity in the flash/beep illusion?

A

The illusion changes the activity in unisensory cortex areas:
Single flash perceived as 2 with 2 beeps = enhanced V1 activity (even though only one flash)
Double flash fused with a single beep = decreased V1 activity

Info is put together at a very low level

64
Q

How fast do ERPs show auditory and visual stimuli interact with each other? What does this suggest?

A

46ms to 150ms. This suggests direct connections between areas.

65
Q

What does MSI do in general? 3

A

Increase precision, amplifies weak signals, and resolve ambiguities