How Vision Guides Action Flashcards
ROBOTS VS AI?
ROBOTS:
- programmable; specific aim
- sensors & actuators to interact w/physical world
- autonomous/semi-autonomous
AI:
- algorithms that tackle range of issues ie. perception/navigation/logical reasoning
AI ROBOTS:
- ie. drone using autonomous navigation system to travel to goal location
BEETZ ET AL. (2011)
- robotic roommates making pancakes
- making sense of world (task/context) & making decisions (planning in robotics)
- action sequence = interacting w/world (actuation & motion)
- learning concepts from nature & applying them to AI systems & designs aka. bioinspired engineering
- taking autonomous robot control from pick/place tasks to everyday object manipulation
EWERT (1987)
- neuroethology of releasing mechanisms: prey-catching in toads
- simplest hypothesis = sensorimotor pathways for each action
- each beh segment is mediated by separate releasing mechanism (RM)
- motivation can modulate each RM
SIMMONS & YOUNG (1999)
- toads respond to simple artificial stimuli
- toad sits in glass vessel (prevents feedback from interacting w/stimulus); presented w/1/3 shapes (worm; antiworm; square)
- prey model (P) = moved around it
- response = number of turns to follow model in 1min
CAREW (2000)
- invariant prey recognition by toad
- configural stimulus properties elicit prey-catching response
- stimulus variations don’t affect response
- movement direction doesn’t affect response
- velocity = crucial for worm stimuli BUT not for antiworm (dashed line)
TOAD VISUAL PATHWAYS
- typical vertebrate eye w/retina containing ganglion cells sensitive to edges; have centre-surround receptive fields
- ganglion cells project retinotopically to optic tectum
- optic tectum contains layers w/T5 cells which respond to moving stimuli
- some ganglion cells project to thalamic-pretectal (TP) area
SUPERIOR COLLICULUS IN MAMMALIAN MIDBRAIN
- homologous to optic tectum in vertebrate midbrain
- tectal systems directs egocentric behavioural responses
- neurons receive retinotopic visual input
MAIN SENSORI-MOTOR PROJECTIONS INVOLVED IN TOAD PREY-CATCHING BEH
- sensory pathway = retina to thalamic-pretectal area (TP) & tectum (feature coding & identification of prey items)
- motor pathway = tectum & TP to hindbrain (execution of beh response if prey = identified)
SIMMONS & YOUNG (1999)
- feature detectors in TP
- TH3 cells in thalamic-pretectal area (TP) respond to moving visual stimuli
- T5 cells in tectum belong to several cell classes; some respond to moving stimuli
- T5(2) neurons exhibit stimulus invariant responses
- T5(2) cells receive inhibitory input from T3 cells
- experiments w/2 electrodes; 1 recording in T5(2); other stimulating TP neurons (T3 cells)
- T3 cells not stimulated = T5(2) responded to stimulus; T3 cells excited = T5(2) cells became inactive
- excitatory input = received by T3 cells from tectal cells; toads would either move towards/away stimulus
TOAD MODEL SUMMARY
- T5(1) excited T5(2)
- TH3 inhibits T5(2)
- proof of causality = lesions in TP area change T5(2) activity & beh responses
- control: worm > square > anti-worm
FINGERLING, EWERT, MENZEL & PFEIFFER (1993)
- from toad -> robot; implementation of neurobiological principles of object discrimination in neural engineering
- aka. pick-and-place robot w/toad’s prey-recognition system
- alternative solutions can be found when considering how/why brains & nervous systems have evolved in dif ways in nature
BEH ORGANISATION: TRADITIONAL THEORIES
- presume central controllers for beh organisation aka:
1. NS structure (neuroreductionist view)
2. internal representations (cognitivists view)
3. contingencies presented by environment (behaviourists view)
BEH ORGANISATION: GIBSON (1979)
- critique & alternative conceptual approaches
- locomotion & manipulation controlled not by brain but by info; control lies in animal environment system
- rules governing beh aren’t like laws enforced by authority/decisions made by commander; beh = regular w/o being regulated
BEH ORGANISATION: WARREN (2006)
- perception & action
- dynamic systems coupled & independent
BEH ORGANISATION: LOBO ET AL. (2018)
- ecological psychology
- aka. perception & developmental psychology
- “embodied, situated, non-representationalist approach to cognition”