Week 2: deep learning in biological neurons and networks Flashcards

1
Q

What does the cell membrane of a neuron do?

A

The cell membrane of neurons are specialised for electrical computations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What are ions?

A

Atoms with electrical charges

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

How do ions pass through the cell membrane?

A

Call membranes do not allow ions through. Ions must move through the ion channel or a pump

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

How is an imbalance of ions across the cell membrane achieved?

A

Sodium/potassium pumps establish an imbalance of ions across the membrane

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is the concentration of sodium and potassium around the neuron cell?

A
  • much more sodium (Na+) on the outside of the cell

- a little more potassium (K+) inside the sell

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

How do ions move towards balance?

A

Opening ion channels allows ions to pass though towards balance. There are different ions for sodium and potassium ions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is the resting state of the cell membrane?

A

Voltage of -70mV

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Is the inside or outside of the cell more positively/negatively charged?

A

The inside of the cell is negatively charged compared to the outside

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What do neurotransmitters do to a post-synaptic neuron?

A

Neurotransmitters released from a pre-synaptic cell can excite or inhibit activity in the post-synaptic neuron

  • glutamate excites activity by opening the ion channel, causing the cell membrane to depolarise
  • gamma-amino butyrate acid (GABA) inhibits activity by causing chloride to enter the cell, making the cell hyperpolarised
  • when a neurotransmitter binds, the ligand-gated ion channels open
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What are two ways that an ion channel can open?

A
  1. When a neurotransmitter binds to the ion channel, the ion channel changes (ligand-gated channels) shape and opens
  2. The ion channel opens due to a change in membrane voltage (voltage-gated channels)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What causes voltage-gated ion channels to open?

A

If the membrane polarisation reaches a threshold (due to many excitatory inputs), the voltage-gated ion channels will open

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What happens when the cell membrane reaches a certain threshold?

A

Causes an extreme depolarisation of the cell and the voltage-gated ion channels will open. This causes the action potential to “fire” meaning the cell passes on an electrical signal in the form of neurotransmitters to other cells. Passes down the axon to the next layer of neurons

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is the strength of the firing rate of the neuron?

A

The firing rate increases as the strength of the inputs increases, at some point there is a maximum firing rate

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is the threshold in biological neurons?

A

Around -15mV

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What happens to the cells once the action potential membrane has passed?

A

The ion channels are closed by their outer segment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

How are neurotransmitters released?

A

The arriving action potential causes voltage-gated ion channels to open, calcium ions flow into the cell and cause proteins in the axon terminal to change shape, releasing the neurotransmitter

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What is Hebb’s postulate and what does it mean?

A

“cells that fire together, wire together”

-when neurons fire together over and over, the brain strengthens responses to these patterns and learns to trigger these neurons together. humans learn by an unsupervised process by recognising patterns of activity we have seen before

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What is long term potentiation?

A

The lasting enhancement of synaptic connection by co-activation of presynaptic and postsynaptic neurons

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What do the network layers of an artificial network represent?

A

Layers of neurons at different levels of synapses

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What does the filter of an artificial network represent?

A

The integration of excitatory post-synaptic potentials and inhibitory post-synaptic potentials across the dendrite tree

21
Q

What does the threshold of an artificial network represent?

A

The activation of voltage-gated sodium channels by above-threshold depolarisations by summation of EPSPs and IPSPs

22
Q

What four sensors does the eye have for light? where are they all located?

A

Three types of colour-sensitive cones sensors (red, green, blue light intensity) and one type of rod sensor (overall light intensity), called photoreceptors. In central vision we find only cones, further out mostly rods. density drops off with distance from central vision

23
Q

What is a cortical map representation?

A

Where the visual image is “mapped” onto the cortical surface

24
Q

What is important when the eyes map an image onto the cortex?

A

Neighbouring locations must be represented next to each other so that the spatial extent of a filter represents a continuous piece of image

25
Q

Why is it important that spatial relationships are maintained when mapping an image onto the cortex?

A
  • allows analysis of spatially-restricted patterns

- the dendrites of the next layer will sample from this layer and they have a limited extent

26
Q

How does the brain sample an image?

A

It magnifies the representation of important parts of the space: central vision, hands and face

27
Q

Why does the brain magnify some parts of an image?

A

To balance detailed analysis with computational load

-and because we can change what we sample in detail by moving our hands and eyes

28
Q

How does an artificial network sample an image differently to the brain?

A

Artificial network processes the whole image in detail, a human decides where to point the camera

29
Q

What is the receptive field in the biological system?

A

The part of the input image (the spatial extent of the image) that produces a positive response in a biological neuron

30
Q

What is the suppressive surround?

A

The part of the image that suppresses a response in a biological neuron

31
Q

How is an image first transformed in the brain?

A

The brain converts the amount of light at each location to the amount of contrast. An all white image would produce zero response but a bright point in the middle would have a positive response in the middle surrounded by a negative response`

32
Q

What does the receptive field refer to in an artificial network?

A

The spatial extent of a convolutional filter in the input image or previous feature map. this is a programmed parameter

33
Q

What is a limitation of knowledge of the biological receptive field?

A

It is hard to determine the spatial spread of a cells input.

34
Q

How does the activation of cones tell us about the image’s colour?

A

The relative activation of different cones must be compared to determine the colour

35
Q

What do retinal ganglion cells do?

A

Acts as filters, breaks down the image into different components at different spatial frequencies, different spatial scales, redness, greenness, blueness, yellowness, lightness, darkness and many combinations of these attributes

36
Q

What are the properties of bistratified retinal ganglion cells?

A

No suppressive surround around the activating centre, but limited spatial spread

37
Q

What are the properties of midget ganglion cells?

A

Small receptive fields and small suppressive surrounds with different colour inputs to the receptive field and the surround

38
Q

How are retinal ganglion cells as filters different from artificial network filters?

A

As we go from central to peripheral vision, the spatial extent of these filters increases, so the filters are not the same over the whole visual field. there can also be multiple receptive field sizes at the same location

39
Q

Why are there different sized receptive fields in the biological system?

A

The retina can break down any image into different components at different spatial frequencies and spatial scales, and can use them to see different things but put them back together to recreate the original image

40
Q

What is normalisation in the biological system?

A

The inhibition of activity by average nearby activity

41
Q

What is pooling in the biological system?

A

There is no distinct problem of computational overload in the biological system. progressive layers have smaller representations and more feature maps, so fewer neurons are used to sample the previous layer

42
Q

How can filters sometimes end up with similar weights in the biological system?

A

If a filter structure develops at one part of the feature map to compute something useful, similar filter structures are likely to develop elsewhere

43
Q

How do weights develop in the biological system?

A

Weights at each synapse develop independently from other neurons. so different synapses have different weights

44
Q

What is the main difference between artificial and biological networks in terms of feature maps?

A

Biological: feature maps don’t represent the whole image with the same detail, strong bias towards sensitive/important parts. hands and eyes can move to sample relevant information

45
Q

What is the main difference between artificial and biological networks in terms of filters?

A

Biological: filters have a limited spatial extent but not a fixed extent. multiple scales analysed at the same brain area ‘layer’. image layout is maintained in later stages, allowing analysis of spatial relationships at many levels

46
Q

What is the main difference between artificial and biological networks in terms of filter weights?

A

Biological: filter weights are not shared across each layer, but similar filters are likely to emerge in many places.

47
Q

What is the main difference between artificial and biological networks in terms of threshold?

A

Biological: maximum response is always part of the threshold

48
Q

What is the main difference between artificial and biological networks in terms of normalisation?

A

Biological: activity is normalised by local mean activity rather than global mean activity

49
Q

What is the main difference between artificial and biological networks in terms of learning?

A

Biological: learning is generally unsupervised