|
Free C++ source code for the firing rate neuron model is available.
Introduction
So far there has been a good deal of discussion about the properties and behaviors
of the different neuron types. However, unless there is a way to connect
these different neurons together into a network, then they are useless.
It is only through the complex, dynamic interactions of the entire
neural network that the biomechanical organism can generate survival behaviors. This section
attempts to explain the types of synapses that are used to connect the
model neurons into networks. There are three basic types of synapses,
but the first one will be looked at in two different ways. The first is
the regular synapse as it is used to excite other neurons. The other
aspect of the regular synapse is when it is used to inhibit other
neurons. The second major type of synapse is the gated synapse. And
finally there is the modulatory synapse.
Excitatory Synapse |
|
 |
|
 |
|
 |
| Figure 2. This is a graph of the output from a normal neuron with externally applied
input currents of -4 na, 2 na, 4 na, 6 na, and
8 na in 100 ms intervals with the following neuron properties:
Cm = 1 nf, Gm = 100 nS,
Vth = 0 mv, Fmin = 0 Hz,
Gain = 10 V^-1 |
The excitatory synapse is a regular synapse. It causes the post-synaptic neuron to be depolarized by injecting a positive current into
it. The strength of the synapse is given below the synapse line as
5 na. This means that if neuron 1 is firing at its peak value of 1 Hz then it will
be injecting 5 na of current into neuron 2. Lower values for the
firing frequency will inject proportionally less current. So if the
firing rate is 0.5 Hz then it will be injecting 2.5 na.
In figure 2 the first two axis of this graph show the currents for neuron 1 and then
the currents for neuron 2. On the voltage and firing frequency axis,
neuron 1's output is in red, and neuron 2's output is in green.
The graph shows that current is injected into neuron 1 causing it to fire.
This is transmitted through the axon and injects current into neuron B.
Neuron 2's firing frequency lags slightly behind the
firing frequency for 1. This is because it takes time to for current injected into
neuron 1 to begin having an effect. Once it does this is propogated to neuron 2. This is not
due to any synaptic transmission delay. Synaptic delays are not modeled in this system.
Inhibitory Synapse |
|
 |
|
 |
|
 |
| Figure 3. This is a graph of the output from a normal neuron with externally applied
input currents of -4 na, 2 na, 4 na, 6 na, and
8 na in 100 ms intervals with the following neuron properties:
Cm = 1 nf, Gm = 100 nS,
Vth = 0 mv, Fmin = 0 Hz,
Gain = 10 V^-1 |
The inhibitory synapse is also a regular synapse. However, it causes other neurons
to be less likely to fire. It uses a filled circle on the target neuron to tell which direction the
current will flow. For the example above the negative current will go from neuron 3 to neuron 4.
This synapse works exactly like the excitatory synapse except it
injects negative currents instead of positive currents.
In figure 3 the first two axis of this graph show the currents for neuron 3 and then
the currents for neuron 4. On the voltage and firing frequency axis,
neuron 3's output is in red, and neuron 4's output is in green.
Neuron 4 is a tonic neuron that maintians a constant firing frequency.
Neuron 3 is then injected with a series of different currents that cause
it to fire. This is transmitted through the axon and negative current is injected into neuron 4.
The negative current pulls the membrane potential down and reduces the
firing frequency of neuron 4. The thing to notice here is that as the
firing frequency of 3 increases the firing rate of 4 decreases.
Regular Synapse Properties
All the synapses in this module are derived from the Link object and share the properties of that item.
For a description of these properties please see the text that
discusses the Link properties.
If this is true then this synapse functions. If it is false then it is as if this synapse does not exist. This
provides a convenient means of disabling individual synapses without having to delete and re-add them or set their weight to 0 and back.
Default value: True.
A read-only description of the type of this synapse.
Additional text that will be displayed next to the synaptic weight.
Default value: Blank
Acceptable range:Any string
The strength of this synapse in amps. This model does not use changes in conductances. Instead,
the synapse specifies the maximum current that will be injected into the post-synaptic neuron.
The amount of current that is actually injected is proportional to the firing frequency of the
pre-synaptic neuron. To make a synapse excitatory you need to have a positive weight and to make
a synapse inhibitory you should have a negative weight.
Default value: 1 na
Acceptable range:Any value
Gated Synapse |
|
 |
|
 |
|
 |
| Figure 4. This is a graph of the output from a normal neuron with externally applied
input currents of -4 na, 2 na, 4 na, 6 na, and
8 na in 100 ms intervals with the following neuron properties:
Cm = 1 nf, Gm = 100 nS,
Vth = 0 mv, Fmin = 0 Hz,
Gain = 10 V^-1 |
The gated synapse works like a basic switch or transistor. A gated synapse is always associated with one or more other
synapses that are entering the target neuron. In the example above, the gated synapses are between neuron 6 and 7 and neuron 8 and 9.
They are symbolized using a triangle with an attached line.
The synapse that is actually gated is associated with the other synapse that goes from
neuron 5 to neuron 6 and 8. The gate can either be on by default or off by default. If it is on by default
then when neuron 9 fires it will block the current of neuron 5 from entering neuron 8. But if neuron 9 is
silent then the current from neuron 5 is free to enter neuron 8. If the gated synapse is off by default then
the above works in just the opposite manner. The first example uses a gated synapse that is off by default and the second example uses a gated synapses that is on by default.
In figure 4 The first two axis are for neurons 5,6, and 7. The second two axis are for neuron 5, 8, and 9.
The first axis in each pair shows relevant currents and the second axis shows firing frequencies.
A series of currents are applied to neuron 5 to stimulate it. The important thing to see in this graph is
what happens when neurons 7 and 9 are on. In axis 2 you should notice that neuron 6 does not fire until neuron
7 is firing strongly. When 7 is firing the gate between neurons 5 and 6 is open allowing synaptic current to flow.
When neuron 7 is not firing this gate is closed and synaptic current is blocked even though neuron 5 is firing.
The important thing to notice for the second portion of the graph is that when neuron 9 fires the synaptic current
from 5 to 8 dries up and neuron 8 quits firing. When 9 begins firing it closes its gate and stops the current from flowing.
Once it quits firing the gate is reopened and current can flow between 5 and 8 again.
If there were another neuron 20 that was firing and injecting
current into 6 it would cause 6 to fire regardless of whether neuron 7 was firing or not. The gated synapse
simply works like a water faucet to turn on and off some of the other synapses. The equation that
describes the behavior for the gated synapses is I = (U + Sign(IG)) * IS . Where
U is the un-gated state of the synapse, IG is the synaptic current of
the gating synapse, and IS is the current of the gated synapse. So in the synapse above
U is one. When neuron A is not firing then I = (1 + 0) * IC = IC, and the
current from neuron C is passed through to B. But since the weight of the gated synapse is
negative one, when neuron A is firing then I = (1 - 1) * IC = 0, and the
current from neuron C is blocked.
Gated Synapse Properties
All the synapses in this module are derived from the Link object and share the properties of that item.
For a description of these properties please see the text that
discusses the Link properties.
If this is true then this synapse functions. If it is false then it is as if this synapse does not exist. This
provides a convenient means of disabling individual synapses without having to delete and re-add them or set their weight to 0 and back.
Default value: True.
If this is true then the gate is on by default and if it is not then it is off by default. If the gate is on then the
weight on the synapse should be negative so that when pre-synaptic neuron fires it will close the gate. If the gate is
off the weight should be positive.
Default value: Gate off by default
This tells which synapse on the post-synaptic neuron is actually being gated. When you click on this property in the
editor it will display a drop-down box with all the regular synaptic connections to the post-synaptic neuron. You
need to choose one of these connections. If you do not then this synapse will not actually be gating anything.
A read-only description of the type of this synapse.
Additional text that will be displayed next to the synaptic weight.
Default value: Blank
Acceptable range:Any string
This determines whether activation of the pre-synaptic neuron attempts to open or close the gated synapse.
This must be coordinated with the "Gate Initially On" parameter. If they are not configured correclty then
you will not get the expected results. For example, if the gate is initially on then this value should be negative
to attempt to close the gate. The weight does not have to be 1 or -1. If you enter a fractional value between -1 and 1
it will only open or close that fractional value. So you could have a gated synapse that varies betweeen 50 and 100% open.
Default value: 1
Acceptable range:Between -1 and 1
Modulatory Synapse |
|
 |
|
 |
|
 |
| Figure 5. This is a graph of the output from a normal neuron with externally applied
input currents of -4 na, 2 na, 4 na, 6 na, and
8 na in 100 ms intervals with the following neuron properties:
Cm = 1 nf, Gm = 100 nS,
Vth = 0 mv, Fmin = 0 Hz,
Gain = 10 V^-1 |
The modulatory synapse works more like a dimmer switch or an amplifier.
Like the gated synapse, it is always associated with one or more other
synapses that are entering the target neuron. In the example above, the
modulatory synapse is symbolized using a diamond. The equation for the modulated synapse is:
(1 + IM) * IS if IM > 0
IS / (1+ |IM|) if IM < 0
So if the modulating current is greater than zero then it amplifies
the synaptic current. And if the modulating current is less than zero then it
reduces the synaptic current. In the example network from above the
weight of the modulating synapse is -2 between neuron 13 and 14. If neuron 10 is firing at a rate of 1
Hz then IM = -2 for neuron 14. Since IM < 0, I = IC / (1
+ 2) = IC / 3. So the current going into neuron 13 from 10 is reduced by a third.
It is important to understand that the modulatory synapse is not
inhibiting neuron 13 and causing it not to fire. It is simply amplifying
or reducing the amount of current that is being injected from other neurons.
Modulatory Synapse Properties
All the synapses in this module are derived from the Link object and share the properties of that item.
For a description of these properties please see the text that
discusses the Link properties.
If this is true then this synapse functions. If it is false then it is as if this synapse does not exist. This
provides a convenient means of disabling individual synapses without having to delete and re-add them or set their weight to 0 and back.
Default value: True.
This tells which synapse on the post-synaptic neuron is actually being modulated. When you click on this property in the
editor it will display a drop-down box with all the regular synaptic connections to the post-synaptic neuron. You
need to choose one of these connections. If you do not then this synapse will not actually be modulating anything.
A read-only description of the type of this synapse.
Additional text that will be displayed next to the synaptic weight.
Default value: Blank
Acceptable range:Any string
This determines whether activation of the pre-synaptic neuron attempts to amplify or reduce the current in the synapse.
If the weight is greater than 0 then the current is amplified. If the weight is less than 0 then the current is reduced.
Default value: 1
Acceptable range:Any value
Synapse Overview
Real neurons in living organisms are capable of
a wide diversity of actions on other neurons. At their simplest, they
just depolarize or hyperpolarize other neurons. These types of interactions are
modeled nicely with a regular excitatory or inhibitory synapse connection.
However, real neurons are also capable of modulating other connections to the
neuron they are synapsed with. This is where the gated and modulatory synapse
types come into play. Their main purpose is to allow one neuron to manipulate
the connection between two other neurons. This is very important later on
because it allows the higher decision functions to shut off or modulate other
subsystems.
|