Brains and Computers Flashcards

1
Q

KEY POINT - IT’S NOT USEFUL TO THINK ABOUT THE BRAIN ONLY IN TERMS OF AREAS

It is useful to know the different areas of the brain, but this doesn’t tell you, on a smaller scale, how these brain areas are getting things ______. We need to know how they are _______ to understand how it all _____ (similar to knowing the parts of a car and not knowing how they go together). Knowing the areas is only useful _______.

KEY POINT - WE CAN UNDERSTAND THINGS IN TERMS OF THE NEURONAL LEVEL
Eg: Justin Harris - monosynaptic reflex (few synapses needed for this bx)
Eg: Justin Harris - neurons can learn associations to trigger a bx (only a few synapses needed for conditioned response bx)

IF YOU REALLY WANT TO KNOW HOW NEURONS WORK YOU CAN GO DOWN TO THE ION CHANNEL LEVEL

BUT SOME THINGS CANNOT BE EXPLAINED SIMPLY BY LOOKING AT A FEW NEURONS

A

done
connected
runs/works
superficially

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

A question to reflect on…what has given you the most understanding of how our brains make us smart?

A

From these lectures….overlaps….connecting things together…storing them via the item itself, not the location.

Also, perception of the world, movement, planning of movements using sensory information.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

KEY POINT - OFTEN WE HAVE TO SIMPLIFY SOMETHING TO UNDERSTAND IT - if we can create a model or simulation for the brain we can understand it better - we’ve built it, so hopefully we understand it well.

Science can use modelling and stimulation to ______ something that it is trying to understand. If we can _____ it, it means we understand it. This does not mean we ________ it though. We don’t need _______ details.

We can also use something that is more familiar to us to understand the brain, aka a ________, such as the ________.

What TWO examples does Alex give?

A

mimic

build
duplicate
irrelevant

Modelling aeroplane aerodynamics - strength and wind simulation. We don’t have to have the correct size plane, what matters is how the wind interacts with it.

In electronic circuit, all we need to know is what the circuit does, and being able to predict what it does. The spatial arrangement of the wires doesn’t matter. What matters in the connectivity. Then we can draw a schematic as well.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

We can also use something that is more familiar to us to understand the brain, aka a ________, such as the ________.

Computers are a useful model/simulation/metaphor to understand the brain. By looking at _______ and _______ (even by looking at how computers are NOT like the brain is really useful)

A

metaphor
computer

similarities and differences

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

KEY POINT - CARBON IS NOT WHAT MAKES US SMART. IT’S NOT WHAT WE’RE MADE OF, BUT THE CONNECTIONS THAT MATTER

When we model the brain, does it matter that it’s made of silicon and not carbon?

How is this related to the simplification of our brain as computers - the connectionist model (neural network model)?

A

Not really. Most people think it’s more about the connections than the ion channels. In any case the model is helping us understand the brain better.

Models represent the ability of how one neuron makes the next one fire, without the details of neurotransmitters, etc.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

KEY POINT - WE DO NEED TO UNDERSTAND SOME THINGS AT THE LEVEL OF INDIVIDUAL NEURONS TO EXPLAIN BEHAVIOUR. WE HAVE TO UNDERSTAND THIS AS THESE ARE THE BUILDING BLOCKS

What can ONE or TWO neurons do? What are some examples of behaviour we know can come about from only a few neurons?

A
  • decide whether to transmit AP (or activity) to the next neuron (can be +ve or -ve)
  • the weight/strength of the vote incoming from other synapses determines this. If threshold is reached - activity is transmitted
  • Reflexes
  • Pavlovian learning
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

A simplified simulation of neurons is called a…

A

connectionist neural network

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

WHY IS THE CONNECTIONIST NETWORK IMPORTANT?

We can use the connectionist neural network to understand the brain because…

A

although stuff is happening at the level of the dendrites, the connection of different neurons is the important thing…

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

FROM THE CONNECTIONIST NEURAL NETWORK PERSPECTIVE…

Neurons have _______. Each synapsing cell has a different number of “_____”, either excitatory or inhibitory. Neurons add up the weighting from different inputs and then make a ______ about whether to fire or not.

So this model represents the ability of one neuron to make the next neuron active, ignoring _______ and action _______. It is enough to worry only about the ________ in the right learning ___________ to accomplish what we have to do.

Eg: Irina has already spoken about this in the ____ _______ Model to shown how knowledge is organised in the brain. You don’t have a list of a magpie or a list of canary features. Instead, you have the features represented as ______ and the ______ of connections between these nodes is what tells you what you know about the bird (does it fly? is it yellow).

A

thresholds
votes
decision

neurotransmitters
action potentials
connectivity
environment

PDP Network
nodes
pattern

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

WHAT MAKES INTELLIGENCE?

There are ______ ways to accomplish intelligent behaviour. We can use our knowledge of ______ to help us theorise how our brain does things. We already know we only need a _____ neurons to do something smart (eg: hebbian synapse)

A

multiple
neurons
few

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

KEY POINT - IN SIMPLIFIED NEURAL NETWORK THRESHOLDS ARE IMPORTANT TO GET THINGS DONE

The linear activation rule is when you simply pass on overall votes/simulation but this is not enough for…

For this, we need…

A

decisions

on/off switch OR threshold level of activation
–> so the weights of neural inputs are summed and ONLY if they reach the threshold for that neuron does it fire.

Eg: you either think about something, or you don’t. You don’t think 30% about one thing, 20% about another, etc

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

THERE ARE MANY WAYS TO ACCOMPLISH INTELLIGENT BEHAVIOUR

Eg: alphabetising a list

It is not obvious how a being (eg: humans, computer) accomplishes a task. It helps to have an understanding of it’s _________. We can use our knowledge of neurons to help ________ about how the brain completes tasks.

An algorithm is simply a series of _____ followed to achieve a _____.

A

capabilities
theorise

steps
goal

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

A NAIVE THEORY OF HOW THE BRAIN ACCOMPLISHES INTELLIGENT BEHAVIOUR IS THAT….

Different parts of the brain are dedicated to different functions (eg: run, bark, pant, etc) and that these areas are…

A

segregated

We know this this not true - often the same neurons are involved in both! Lots of overlap.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

NOW LETS START TO SEE HOW SYSTEM CAN BE DESIGNED IN BRAINS VS COMPUTERS - NAIVE THEORIES

BRAIN
Attention can:
- ______ the representation of one voice compared to another.
- ______ rustling in the room
- Engage
- ______ (from the lecturer if there’s a loud noise)
- motivate ______ (to see what the noise is)

  1. THE INITIAL BOX-AND_ARROW PSYCHOLOGICAL THEORY OF ATTENTION, initial theories by psychologists summised that there are different _____ of attention (eg: interrupt function, moving functioning, alert function, etc) in different parts of the ______, that are organised in a ____ - and - ______ diagram. If you were designing a computer program or software, this might be how you do it (have different parts do different parts of attention), and you would set up _____ to have it happen in the right order.

BUT the brain doesn’t work this way. There are many neurons involved in each of the different aspects.

A

enhance
inhibit
disengage
movement

parts
brain
box-and-arrow
rules

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

NOW LETS START TO SEE HOW SYSTEM CAN BE DESIGNED IN BRAINS VS COMPUTERS

  1. If there is not one bit of the brain that does one function, this means functions are _________. There is not just one bit that does one particular _______.

Attention doesn’t happen because you’re running a particular set of ______, but rather, it’s because of the summation of ______ and ______ on the retinal layer and _______ activity rules. Then, in layers further up, there are neurons responsible for certain things (eg: orientation, colour, etc).

  • Neurons representing the same location ______ excite each other.
  • Neurons representing different locations ______ each other.
  • Neurons involved in recognition also are involved in lateral _______.
  • lateral inhibition causes units on all _____ that represent a single object to become ______.
  • _______ cuing - this cue _______ the location, helping subsequent target to win the competition sooner
A
distributed
function
rules
excitation
inhibition
threshold
mutually
inhibit
inhibition 
layers
active
Posner
pre-activates
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

BRAIN vs COMPUTERS - HOW KNOWLEDGE IS REPRESENTED

Irina Harris’ memory slide describing parallel distributed processing demonstrates that information about bird is ______ across networks, and the “bird category emerges from the _______ of all instances. Alternatively, the “emu” representation doesn’t overlap as much as the representations of other birds, and can cause a _____ response.

A computer does not do this. It would have ______ of emu features, magpie features, etc. The _______ of features do not help computers get the response ______.

–> MAJOR DIFFERENCE BETWEEN COMPUTERS AND BRAINS - COMMON ELEMENTS HELP THE BRAIN (reuses the neurons). BUT THIS DOES NOT HELP COMPUTERS.

A
shared
overlap
lists
overlap
slower

lists
overlap
faster.

17
Q

COMPUTERS AS A METAPHOR OF THE BRAIN

The default way to model the brain is to think about how ________ do it. This is because computers are the only thing we have (or can make) that does similar things to us. We don’t really have a good sense of the brain from this, but we can look at the _______ between brains and computers, and this can also help us understand the brain.

The computer can be a good metaphor, but can also be _______.

Eg: brains never really get “____”. But a computer memory can…

A

computers
computers
difference

misleading

full

18
Q

BRAIN VS COMPUTER - KNOWLEDGE AND MEMORY

In network memory (brain) the same _____ (neurons) are used for many lists (eg: tofu, chicken, etc), as each of the units are connected to each other

  • PROS - less ______, Generalisation makes it work _______ (can get things done ______) due to overlap. This generalisation happens ______.
    eg: faster at writing down cheese once you write milk
  • -> extracting common elements/associations
  • CON - these are more susceptible to _______.
    eg: parts of the network might become activated that you don’t want to become activated simply because they are connected to each other.

Computers - separate lists with each of the units
PROS - separate lists for things means less _________.
CONS - doesn’t matter how many lists are remembered…common elements doesn’t make it any ______ (no generalisation)
eg: no faster at writing down cheese once you have written milk

A

units

space
faster
faster
automatically
interference

interference
faster

19
Q

BRAINS vs COMPUTERS

MEMORY AND INFORMATION PROCESSING

Recognition, memory, and computing power in the brain are _______ - they are made up of the _____ units (neurons). But in the computer these are _______ (the memory is separate from the computing power). All information processing has to go through the CPU.

A

intertwined
same
separate

20
Q

CONNECTIONIST BRAIN VS COMPUTER

CONNECTIONIST

  • individual concepts are widely ______
    eg: there are lots of neurons representing lentils and they’re various elements (including their ______ with similar things like black beans).
  • content-_________ (you identify items by the items themselves and their features, not by location AND once you activate one aspect of it, it activates various elements of that _______ that are related to it (activation spreads).
  • Naturally/automatically _________ (WISDOM?)
  • Some capacity _______ (there can be interference as memories accumulate)
  • -> BUT
  • Prone to _________ (esp. when retrieving memories)

COMPUTERS

  • memories _________ (in one area) and completely _______ from everything else.
  • no _________
  • -> BUT
  • _____-consuming (looks though list in a serial manner - can’t look up things via the item itself)
  • no __________
  • capacity ________ (once it’s full, that’s it!)
A
distributed
overlap
addressable
network 
generalises
limitations
interference
localised
separate
interference
time
generalisation 
limited
21
Q

Why is it that our brain never seems full like a computers?

A

Network memory is distributed across thousands/millions of synapses

New memories can degrade old ones, but it can also build on them, strengthening elements in common while degrading others (interference)

So you never hit a limit. Instead, you constantly degrading old memories and making new ones (and making new synapses in the process).

When things have elements in common we remember them more. When things are not in common they degrade (eg: playing an instrument - continuously refined)

22
Q

COMPUTER VS BRAIN

  • basic unit
  • communication between units
  • number of units (which has more?)
  • speed of messages (which is faster?)
  • time for single computation (which is faster?)
  • storage
  • robustness
  • energy required
A
  • transistor (CPUs) vs neuron
  • electrical wires vs synapses and neurotransmitters
  • computer sends things quicker
  • brain has more neurons than the computer has transistors (CPUs)
  • computer is faster (1 GHz vs 200 Hz)
  • localised (manipulation separate) vs distributed memory (manipulation integrated)
  • minor injury = catastrophic failure vs continually adaptive, graceful degradation
  • 45 watts vs 20 watts
23
Q

Early computer scientists trying to prove how _______ computers were would try and set them up against humans in doing maths or chess.

Computers win a chess game by computing all possible moves in ______. It makes many, many calculations on each position on by one. Computer uses a lot more energy to do this.

Whereas a brain does this in _______. We suspect the brain is able to ______ something about patterns, situations, and what things have in common. Over your lifetime it assesses things in a content-addressable way and uses memory from previous chess experiences.

During chess matches, a computer would evaluate hundreds of ______ of chess positions per second, but the human was only thinking about a ____…and it barely beat a human.

  • But what about _______? Even if they can beat them they can’t do this…
  • conclusion is work ______, not _____
A

intelligent

serial

parallel
learn

millions
few

generalisation
smarter
harder

24
Q

Rodney Brooks worked out that getting computers to do math and chess is not the most important and difficult thing…what’s important is how they interact with the ________.

A

environment

25
Q

Why don’t you have robots serving your every whim?

A
  • vision is hard - working out where things are
  • working out where you are based on what you see
  • object recognition is hard
  • controlling movement is hard - how to move joints in order to walk
  • behaviour - what decisions to make with the information that you have
26
Q

What is Moravec’s paradox?

A

Researcher’s realised that doing math and chess is NOT the amazing thing that we do. High level reasoning is ok. Sensory-motor skills is hard (it has developed environmentally over thousands of years). We had to evolve movement perfectly to be here today.

The discovery by artificial intelligence and robotics researchers that, contrary to traditional assumptions, high-level reasoning requires very little computation. BUT low-level sensorimotor skills require enormous computational resources.

–> we can not make computers exhibit adult level performance on intelligence tasks, but very hard to give them perception and mobility of a one year old

27
Q

Under what conditions are robots better than humans in movement?

A

Controlled environments

  • limited numbers of possible objects/events occurring
  • walls, floor and ceilings painted to make visualisation easy - or something like following a red strip on floor
  • Doesn’t have to go somewhere (walking/locomotion)
28
Q

Even if we could get robots to do the things we wanted, we would still need even ______ people to fix them when things go wrong.

A

smarter

29
Q

Perception historically is a total ____ for computers. Animals are massive _______ processors. In computers recently they have done this, but computers still fail at other areas of ________.

Movement is _____ for computers because it requires __________ as well as _______ aspects. There are various ________ and dynamic interactions among units which are activated in ______ which explain how humans do i.

So we clearly don’t know much about how the brain does these things, otherwise we could _____ it.

A

fail
parallel
perception

hard
perception
motor
oscillations
parallel

copy

30
Q

So while computers can do lots of fast _____ and easily store and access thousands of books (humans kind of suck at this)….BUT it can’t write ______ novels, or even trashy ones, it can’t walk down the ______ (humans can hop, run, jump, etc) and has bad object ________ (brain can recognise objects and people).

A

maths
good
stairs
recognition

31
Q

NY Times article - Korean Robot Makers Walk Off With 2 Million dollar Prize - Robotics challenge

A
  • prize offered by pentagon research agency
  • can operate in hazardous environments (driving, opening a door, operating a drill, turning a valve, climbing stairs and surprise task in ONE HOUR)
  • Teams spent YEARS building robots
  • Some take up to SEVEN hours to complete the task…AND they’re operated by humans
  • difference between a robot that can perform a simple task and a robot that can perform a lot of things really well (general purpose robots)
  • people are good at DECIDING which valve to turn or which door to open
  • robots have sensors to create 360 degree view of the environment which can be used by the people controlling them
32
Q

The Tesla Car Factory video demonstrated…

A

That robots are better than humans in particular environments…

BUT there are many issues with using robots - they break, then you have to get people to fix them, etc.

33
Q

f

A

f

34
Q

Robotics soccer challenge…

A
  • like watching toddlers play!

- these robots are fully AUTONOMOUS - not controlled

35
Q

Guest post: Dirty Rant About The Human Brain Project…

A
  • We can’t even simulate the brain of a 302 neuron roundworm - we know the wiring, how it behaves, including when you kill off various neurons. BUT this data does not equal understanding. There are theories on how 6-8 neurons function in these animals, but that’s it.
  • Diffusion Tensor Imaging (DTI) is an MRI-based neuroimaging technique which displays an overview of the brain’s main white matter bundles. Even though we have this….1 cubic mm of brain required a supercomputer to generate it, and 1 cubic mm is VERY course for the brain
  • SO we don’t have a good idea of the finer connectivity…especially with human brains
  • We also don’t know much about the parameters…eg: what is the rate of voltage leak across an ion channel? We have no idea…and this is different for different cells…so how can we make a simulation about it?
  • If the voltage in a cell reaches a certain threshold, a spike will occur. But now, what do these spikes mean? Is it the number of spikes per second that matters? Or is it the precise timing of the spikes? Who the fuck knows. For certain types of cells in certain areas, we see that they are active (producing a lot of spikes) under certain conditions. For example, in the primary visual cortex of a cat, a cell will be active when the eye sees a line at a certain position and a certain orientation moving in a certain direction. Is the timing of these spikes important? We don’t know! Some experts believe one way, some experts believe the other, and the rest admit they don’t know.
  • We have no clue about what principles allow the real machine to operate. We can only create pretty things that are superficially similar in the ways that we currently understand, which an enlightened being (who has some vague idea how the thing actually works) would just laugh at.

–> Rebuttal - To simulate a brain you do not need to know how a brain works! It is enough that you can copy the design closely enough. This still means you need to get all the neurons and connections correct (which is no mean feat) but you do not need to know how the interaction of the neurons give rise higher level brain functions. In fact, simulations of the brain can be very good tool to help figure out how the brain actually works.

36
Q

Key assumptions about the inevitability of AI in Sam Harris TED Talk

  1. Information processing is a matter of _______ ______ in physical systems. It’s the _____ of intelligence. We’re made up of atoms…so why couldn’t we build general intelligence into our machines?
  2. We will _______ to improve our intelligent machines…unless there’s a mass wipe out of the population
  3. We are not near the ______ of possible intelligence…it will explore and ______ the spectrum of intelligence in ways we cannot imagine.
A
information processing
source
continue
summit
exceed
37
Q

WHY AND HOW to do the modelling

HOW computers and the brain are different

See what can be done when connecting the perception
units nearly directly to the action units, without worrying about cognition

– Know what is a connectionist neural network
• J. Harris: How neurons can mediate conditioning, motor plans, map
memory
• Holcombe: esp. first two lectures
• I. Harris: semantic connectionist memory
– Understand how a single model neuron works
– Understand how connecting these dumb units can
yield somewhat-smart behavior
• How they can learn a new memory
– No new ‘files’ created. Instead a new pattern of activity
• How they can retrieve a learned pattern
– “Content addressable”: if partial content provided, network activates related
• How they can mediate approach behavior
• How they can accomplish XOR (if A or B, do it. But if A and B, don’t do it)

Connectionist Neural Networks
- what can ONE or TWO neurons do?
• simple enough to understand fully - reflex, Pavlovian learning
• How connectionist networks are a simplification of real neural functioning
- what can several neurons do?
• connectionist network for word recognition and memory (birds). Understand how they work
- compare to computer
• naive computer-style box-and-arrow psychological theory. Understand how network functioning differs

Metaphors, Theories,
Models
• More than one way to skin a cat
• Knowledge of brain needed for
good theories of how it would
do something
• Understand role of metaphor in
understanding brain
• Understand what computational
modeling is
A

f