Multisensory integration - cue combination Flashcards

1
Q

tactile info when engaging/touching/manipulating an object =

A

haptic feedback

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

different senses might provide conflicting information about a sensory stimulus =

A

sensory conflicts

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

sensory conflicts need to be resolved. How?

A

we need to make a choice to resolve the conflict

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

does vision or touch dominate judgement of object size?

A

vision dominates perceived object size

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

what is it called when visual input dominates to provide a more accurate judgement of object size?

A

visual capture > this is the VISUAL CAPTURE EFFECT

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

does touch have any influence on the visual capture effect?

A

yes but only small but consistent influence

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

what were the 3 ways Rock and victor assessed visual capture?

A

pointing, feeling, drawing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

is there a strict sensory hierarchy?

A

no, audition can dominate vision

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

who conducted a study to show that audition can dominate vision by testing for sensory conflict?

A

Shams et al, 2000

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

what were the results from Shams et al, 2000 study?

A

number of auditory beeps determined the number of reported visual flashes, sound was followed more closely than sight e.g. 1 flash + 2 beeps = 2 beeps reported. SHOWS WE TRUST AUDITION MORE THAN VISUAL SENSE

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

what is the modality precision hypothesis?

A

modality with highest precision and lowest uncertainty is chosen depending on the task type

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

following the modality precision hypothesis > spatial task uses _____, temporal task uses ______

A

vision, audition

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

what 3 things is sensory uncertainty due to?

A

perceptual limits, neural noise, cognitive resource limits

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

communication between neurons at the synapse doesn’t work > leads to uncertainty. this is due to?

A

neural noise

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

different senses have different levels of ______ uncertainty

A

noise

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

how did Ernst and Banks (2002) shift ppts attention to different senses?

A

by manipulating the level of sensory uncertainty

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

what does MLE stand for?

A

Maximum Likelihood Estimation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

what is a normative model?

A

optimal solution to how a problem should be solved

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

what is a normative model based on?

A

theory

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

what is a process model?

A

how a problem is actually solved

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

what is a process model based on?

A

data

22
Q

how should we solve problem of sensory integration?

A

pick integration method that minimises sensory uncertainty > maximum likelihood estimator

23
Q

when making an estimate based on haptic and visual inputs what is the best way to get a maximum likelihood estimation?

A

combine senses and their uncertainty to get an INTEGRATED SIGNAL with the smallest possible combined uncertainty

24
Q

a large distribution means high ______ which means high sensory _______ and a lower _______

A

variance, uncertainty, probability

25
Q

a ______ distribution means low variance which means ___ sensory uncertainty and a _____ probability

A

small, low, higher

26
Q

different senses have different amounts of what?

A

sensory noise

27
Q

when there are 2 different sense inputs (visual and haptic) there are 2 distributions produced because of 2 different estimates. why are 2 estimates produced?

A

because sensory conflict is created

28
Q

how are 2 probabilities integrated if both estimates have the same amount of variance and uncertainty level?

A

place the integrated estimate exactly in the middle

29
Q

does a combined estimate of 2 sense inputs have lower or higher uncertainty?

A

lower! smaller variance = lower uncertainty > higher probability

30
Q

when integrating probabilities, if visual uncertainty is lower than haptic uncertainty what does theory suggest we should trust?

A

vision

31
Q

if visual uncertainty is smaller than haptic how are the estimates combined?

A

biased towards the visual estimate

32
Q

visual weight of 1 and haptic weight of 0 = only trust ____ input

A

visual

33
Q

visual weight of 0 and haptic weight of 1 = only trust _____ input

A

haptic

34
Q

according to MLE what can be calculated from the variance (sensory uncertainty) of the visual and haptic distribution?

A

optimal weights

35
Q

integrating info from multiple sources always causes uncertainty to _______

A

decrease (as variance is decreased when combining)

36
Q

combining variance leads to a ______ in variance (minimal variance)

A

decrease

37
Q

after converting sensory inputs from different senses into a coherent reference frame, info needs to be _______ and sensory conflicts need to be _______

A

integrated, resolved

38
Q

MLE is a ________ model that allows us to calculate the _______ way to integrate info

A

normative, optimal

39
Q

what is shown with perceived bar length when no visual noise is added? (Ernst & Banks, 2002)

A

biased towards visual input. shows visual dominance > visual capture (we trust visual over haptic input)

40
Q

what happens when we add visual noise? (Ernst & Banks, 2002)

A

perception of bar length moves more towards haptic estimate and becomes determined by both visual and haptic inputs

41
Q

explain why adding visual noise means theres a shift in our estimate towards haptic estimate

A

visual input is more noisy > we have more uncertainty and can’t trust it > shift estimate towards haptic feedback as can’t fully rely on visual

42
Q

what happens when even more (high) visual noise is added?

A

perception of bar length is determined by haptic inputs and we rely on haptic over visual

43
Q

as visual noise increases we move toward haptic capture as visual weight _______ and haptic weight ________

A

decreases, increases

44
Q

more visual noise = more ________ which means we can’t trust its estimate

A

uncertainty

45
Q

do we always integrate info optimally?

A

idea that we don’t integrate it optimally as heuristics aren’t optimal (but still work well enough)

46
Q

is it easier to know the uncertainty for optimal integration in sensory perception or cognitive reasoning?

A

sensory perception! can generally estimate noise and uncertainty levels

47
Q

why is it hard we always calculate uncertainty levels in our brains?

A

calculations are intractable and take a long time

48
Q

what do we use instead of integrating info optimally and why?

A

use HEURISTICS! suboptimal but fast and provide good enough solutions

49
Q

we are good at estimating ______ noise but bad at estimating _______ noise

A

sensory, cognitive

50
Q

are probabilities encoded in the brain? discuss.

A

little direct electrophysiological evidence but several plausible theories > may be down to neurons to tell us the variance? different neurons may encode different probability values? different neurons may have different estimates? (active research area with lots of debate)