PSY2002 W5 Multisensory integration 1 (L) Flashcards

1
Q

What is body schema ?

A

“a representation of the positions of body parts in space, which is updated during body movement”
Sensorimotor representation that guides action
Does not require awareness

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What are disorders of body schema?

A

Alice in Wonderland syndrome, Autopagnosia, phantom limbs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is reference frame?

A

Player perspective: Coordinates of snake in the world, e.g. upper left corner
Snake perspective: Sees world through its eyes, can turn left or right
Problem: Sensory input in player perspective and Controls in snake perspective

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is coordinate transformation?

A

Eye-to-head: need to know orientation of eyes.
Head-to-body: need to know orientation of head.

→ Converting between reference frames requires us to know the position and orientation of body parts. In other words, we need a body schema

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is eye-/head-centred reference frames?

A

Head-centred frame is where you head is directed towards ()–a
Eye-centred frame is where your eyes are looking no matter the head is (¤) –

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is body image?

A

how do you imagine your body
how do you feel about your body
conscious (mostly visual) representation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is alice in wonerland syndrome?

A

Distortion in size perception. Body parts might appear smaller (microsomatognosia) or larger than their true size (macrosomatognosia). Can affect whole body. Associated with childhood and migraines.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is Autotopagnosia?

A

Inability to locate body parts. Loss of spatial unity of body. Patients can name body parts but relative order lost. Finger agnosia: Fused percept of fingers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is Phantom limbs?

A

After limb loss, presence of limb is still felt. Can include agency over limb (movement). Often associated with pain. Phantom limb can change size over time (e.g. shrink: telescoping)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is temporal-order judgements?

Heed & Azañón, Front Psychol, 2014

A

Does body posture affect perception?

Setup: stimulate both hands in random order
Task: Indicate which hand was stimulated first
Conditions: Arms uncrossed/crossed

Participants mix up which hand was stimulated when arms are crossed. Solving the task does not need input from body schema
-> Body schema affecting basic perception

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is peripersonal space?

A

The space immediately surrounding our bodies. Objects within peripersonal space can be grasped and manipulated immediately. Extent not fixed: can contract and expand.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is the moravec’s paradox?

A

“It is comparatively easy to make computers exhibit adult level performance on intelligence tests or playing checkers, and difficult or impossible to give them the skills of a one-year-old when it comes to perception and mobility.” - Moravec, 1998

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What are computers good at?

A

Computers are good at “hard” task – like playing chess, but are bad at seemingly “easy” tasks such as walking

Reasoning (high-level cognitive) ==> relatively easy to reproduce into a machine
Perception, Action (low-level) ==> surprisingly hard to reproduce into a machine

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Does blocking the sensations from the fingers affect motor control?

Johansson, 2005

A

Blocked sensations from the fingers: anesthetize the fingers. Block all touch sensation from the fingers, does not affect motor control. After doing so the participant had to pick a match up and light it, in a normal condition it only takes a few seconds but after losing sensation in fingers it took around 25 seconds.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is multisensory perception?

A

“I see and feel that I am touching this object.” – coordination of vision and touch. What robots have a difficulty integrating is the multisensory integration.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What are challenges in multisensory integration?

A
  1. How to transform representations from different senses into a common representational space? [W5 Lecture]
  2. How to integrate information from different senses into a coherent percept? [W6 Lecture]
17
Q

Where are sensory percepts located?

A

Vision → eye-centered/retinal: location of visual stimulus on the retina

Audition → head-centered: location of sound source with respect to the ears

Touch → body-centered: location of tactile stimulus on skin

Need to convert between these reference frames and to external space (world coordinates)!

18
Q

What characterise body schema?

A

1- Spatially coded
2- Modular
3- Updated with movement
4- Adaptable
5- Supramodal
6- Coherent
7- Interpersonal

19
Q

What is spatially coded?

Body Schema

A

position of each body part in external space

20
Q

What is modular?

Body schema

A

different body parts processed separately

21
Q

What is adaptability ?

Body schema

A

Changes when the body changes

22
Q

What is supramodal?

BOdy schema

A

Combines input from multiple senses, e.g. proprioception, touch, vision, audition

23
Q

How are body schema’s coherent?

Body schema

A

patial continuity when resolving perceptual conflicts

24
Q

How are body schema’s interpersonal?

A

observed actions are represented within the same body schema

25
Q

How are body schema’s Updated with movement?

Body schema

A

automated and “always on”

26
Q

What are some bodily illusions?

A

Pinocchio illusion, rubber hand illusion

27
Q

What is the pinocchio illusion?

A

If arm is extended, but we are grasping our nose:
-> nose must be really long
Vibrating the biceps will make arm feel extended

28
Q

What is rubber hand illusion ?

A

Setup
* Participant’s real hand hidden from view
* Experimenter strokes real and rubber hand simultaneously
* Participant sees and FEELS rubber hand being stroked
* Participant starts to feel as if rubber hand is real hand
-> Vision and touch: multisensory integration

29
Q

How does the body schema develop?

A

At 6 months old, the body schema starts to interfere with tactile orienting.

30
Q

What is the cross-modal integration and body schema?

Maravita et al. 2003

A

Participants receive a tactile stimulus and respond with the location (up or down).

Visual distractor (up or down) is presented nearby on the same hand or the other hand.

A Congruency effect exists for both hands – evidence for cross-modal integration and visual interference.
But: effect greater for same hand

31
Q

Is the grater interference based on hand location (body schema) or visual field?

Body schema - cross model integration

A

Arm-crossing
Changing the mapping of the body schema:
-tactile stimulus on same side of the body
-visual stimulus on different side of body
Effect of visual distractor moves with the hand during arm-crossing
The body schema (not visual representation of external space) mediates the integration between vision and tactile stimulation.
==> Cross-modal interactions are mediated by body schema.

32
Q

How are neurons incorporating tools?

A

Expansion of peripersonal space during tool use reflected in neural responses

33
Q

Tools are used for what?

A

Extending the body

Tools are incorporated into the body schema during use.
Cross-modal congruency effects apply during tool use
● No crossing of body parts, only tools are crossed
● Same delay effects as seen during arm crossing
→ Tools become part of body schema