Synthetic nervous system

Synthetic Nervous System (SNS) is a computational neuroscience model that may be developed with the Functional Subnetwork Approach (FSA) to create biologically plausible models of circuits in a nervous system.[1] The FSA enables the direct analytical tuning of dynamical networks that perform specific operations within the nervous system without the need for global optimization methods like genetic algorithms and reinforcement learning. The primary use case for a SNS is system control, where the system is most often a simulated biomechanical model or a physical robotic platform.[2][3][4][5][6][7][8] An SNS is a form of a neural network much like artificial neural networks (ANNs), convolutional neural networks (CNN), and recurrent neural networks (RNN). The building blocks for each of these neural networks is a series of nodes and connections denoted as neurons and synapses. More conventional artificial neural networks rely on training phases where they use large data sets to form correlations and thus “learn” to identify a given object or pattern. When done properly this training results in systems that can produce a desired result, sometimes with impressive accuracy. However, the systems themselves are typically “black boxes” meaning there is no readily distinguishable mapping between structure and function of the network. This makes it difficult to alter the function, without simply starting over, or extract biological meaning except in specialized cases.[9][10] The SNS method differentiates itself by using details of both structure and function of biological nervous systems. The neurons and synapse connections are intentionally designed rather than iteratively changed as part of a learning algorithm.

An example of a Synthetic Nervous System composed of functional subnetworks. This network controls one joint of a Praying Mantis inspired robot (Figure 7 of Szczecinski et al.[1])

As in many other computational neuroscience models (Rybak,[11] Eliasmith[12]), the details of a neural model are informed by experimental data wherever possible. Not every study can measure every parameter of the network under investigation, requiring the modeler to make assumptions regarding plausible parameter values. Rybak uses a sampling method where each node is composed of many neurons and each particular neuron’s parameters are pulled from a probability distribution.[11] Eliasmith uses what they call the Neural Engineering Framework (NEF) in which the user specifies the functions of the network and the synaptic and neural properties are learned over time.[12] SNS follows a similar approach via the Functional Subnetwork Approach (FSA). FSA allows parameters within the network (e.g., membrane conductances, synaptic conductances) to be designed analytically based on their intended function. As a result, it is possible to use this approach to directly assemble networks that perform basic functions, like addition or subtraction, as well as dynamical operations like differentiation and integration.

Background and History of Synthetic Nervous Systems

edit

Background

edit

The details of the underlying control networks for many biological systems are not very well understood. However, recent advancements in neuroscience tools and techniques have clarified the cellular and biophysical mechanisms of these networks, and their operation during behavior in complex environments.[13][14][15][16] Although there is a long-standing interest in biologically-inspired robots and robotic platforms, there is a recent interest in incorporating features of biomechanics and neural control, e.g., biomimicry. The SNS method uses data from neuroscience in control systems for neuromechanical simulations and robots. Designing both a robot’s mechanics and controller to capture key aspects of a particular animal may lead to more flexible functionality while suggesting new hypotheses for how the animal’s nervous system works.[1][17][18]

Keeping neural models simple facilitates analysis, real time operation, and tuning. To this end, SNSs primarily model neurons as leaky integrators, which are reasonable approximations of sub-threshold passive membrane dynamics. The leaky integrator also models non-spiking interneurons which contribute to motor control in some invertebrates (locust,[19] stick insect,[20] C. elegans [21]). If spiking needs to be incorporated into the model, nodes may be represented using the leaky integrate-and-fire models.[2][22] In addition, other conductances like those of the Hodgkin-Huxley model can be incorporated into the model.[3] A model may be initialized with simple components (e.g., leaky integrators), and then details added to incorporate additional biological details. The modeler may then increase or decrease the level of biological detail depending upon the intended application. Keeping models simple in this way offers:

  • The ability to use dynamical systems analysis by way of balancing biological detail with analytical tractability.
  • Fast and computationally inexpensive network dynamic simulations to work effectively in a robotic controller. Thus, complex traditional models, like the cable equation or the full Hodgkin-Huxley action potential model, are typically avoided or simplified for the sake of computational efficiency.
  • Sparse function-dependent connectivity via the Functional Subnetwork (FSA) instead of fully connected (i.e., all-to-all connected) topologies, common in machine learning.

While the neuroscientific models are typically simplified for SNS, the method is flexible enough that more features can be incorporated. Consequently, the SNS method can accommodate demand driven complexity, only adding features specifically where they are needed. For example, persistent sodium channels can be added to just two neurons in a neural circuit to create a half- center oscillator pattern generator without changing the other neurons in the circuit. While these additions may increase computational cost, they grant the system the ability to perform a wider array of interesting behaviors.

History

edit

The term “synthetic nervous system” (SNS) has appeared in the literature since the year 2000 to describe several different computational frameworks for mimicking the functionality of biological nervous systems.

Cynthia Breazeal developed a social robot named “Kismet” while at MIT in the early 2000s.[23] She used the term SNS to refer to her biologically-inspired hierarchical model of cognition, which included systems for low-level sensory feature extraction, attention, perception, motivation, behavior, and motor output. Using this framework, Kismet could respond to people by abstracting its sensory information into motivation for responsive behaviors and the corresponding motor output.

In 2005, Inman Harvey used the term in a review article on his field, Evolutionary Robotics.[24] In his article, Harvey uses the term SNS to refer to the evolved neural controller for a simulated agent. He does not explicitly define the term SNS; instead, he uses the term to differentiate the evolved neural controller from one created via alternative approaches, e.g., multi-layer perceptron (MLP) networks.

In 2008, Thomas R. Insel, MD, the director of the National Institute of Mental Health, was quoted in an American Academy of Neurology interview calling for a “clear moon shot…[to motivate] a decade of new discovery [and] basic research on brain anatomy”.[25] As part of that interview, Dr. Insel suggested building a “synthetic nervous system” as one such motivational moon shot to drive ongoing and future research. The technical details of what such a SNS would entail were not described.

An article published as part of the International Work-Conference on Artificial Neural Networks (IWANN) proposes a “synthetic nervous system” as an alternative to artificial neural networks (ANNs) based in machine learning. In particular, SNS should be able to include or learn new information without forgetting what it has already learned.[26] However, the authors do not propose a computational neuroscience framework for constructing such networks. Instead, they propose a homeostatic network of the robot’s “needs”, in which the robot takes actions to satisfy its needs and return to homeostasis. Over time, the robot learns which actions to take in response to its needs.

A dissertation from Prof. Joseph Ayer’s lab at Northeastern University uses a similar term in its title but never explicitly defines it. The topic of the dissertation is “RoboLobster, a biomimetic robot controlled by an electronic nervous system simulation”.[27] Other publications from Prof. Ayers use the term “electronic nervous system” (ENS) to describe similar work.[28][29][30] In each of these studies, Prof. Ayers uses a robot that is controlled by a network of simplified dynamical neural models whose structure mimic specific networks from the model organism.[31] The choice of neural model reflects a balance between simulating the dynamics of the nervous system, which motivates mathematical complexity, while ensuring the simulation runs in real time, which motivates mathematical simplicity.

A 2017 research article from Prof. Alexander Hunt, Dr. Nicholas Szczecinski, and Prof. Roger Quinn use the term SNS and implicitly define it as “neural [or] neuro-mechanical models…composed of non-spiking leaky integrator neuron models”.[5] Similar to work by Ayers et al., Hunt et al. apply the term SNS to refer to a simplified dynamical simulation of neurons and synapses used in the closed-loop control of robotic hardware. Subsequent articles by these authors present the Functional Subnetwork Approach for tuning SNS constructed from these and other simplified dynamical neural models [1][2] (i.e., leaky integrate-and-fire), as well as further SNS models of the nervous system [7][32][33][34]

Comparing the diversity of works that use the term SNS produces an implicit definition of SNS:

  • Their Network’s structure and behavioral goals are grounded in biology
  • Their priority is to learn more about nervous system function, with the secondary goal of creating a more effective robot control system
  • They are typically posed as an alternative to more abstracted neural networks with simplified (e.g., all-to-all) network structure (e.g., multi-layer perceptron networks, deep neural networks)
  • They are computational models of the nervous system meant for closed-loop control of the behavior of simulated or robotic agent within an environment.

Comparison to Other Neural Networks

edit

SNSs share some features with machine learning networks like Artificial Neural Networks (ANN), Convolutional Neural Networks (CNN), and Recurrent Neural Networks (RNN). All of these networks are composed of neurons and synapses inspired in some way by biological nervous systems. These components are used to build neural circuits with the express purpose of accomplishing a specific task. ANN simply refers to a collection of nodes (neurons) connected such that they loosely model a biological brain. This is a rather broad definition and as a consequence there are many subcategories of ANN, two of which are CNN and RNN. CNNs are primarily used for image recognition and classification. Their layer-to-layer connections implement convolutional kernels across small areas of the image, which map the input to the system (typically an image) onto a collection of features. ANNs and CNNs are only loosely associated with SNS in that they share the same general building blocks of neurons and synapses, though the methods used to model each component varies between the networks. Of the three, RNNs are the most closely related to SNS. SNSs use the same leaky-integrator neuron models utilized in RNNs. This is advantageous as neurons inherently act as low pass filters, which is useful for robotic applications where such filtering is often applied to reduce noise for both sensing and control purposes. Both models also exhibit dynamic responses to inputs. While predicting the responses of a complicated network can be difficult, the dynamics of each node are relatively simple in that each is a system of first order differential equations (as opposed to fractional derivatives). The key difference that distinguishes SNS from these neural networks are the synaptic connections and the general architecture of the neural circuit.

RNN structures generally present as large, highly connected or even all-to- all connected layers of neurons. Instead of these layers, SNS relies on functional subnetworks which are tuned to perform specific operations and then assembled into larger networks with explainable functions. These are significantly more tractable than a typical machine learning network. The tradeoff of SNS is that it typically takes more time to design and tune the network but it does not require a training phase involving large amounts of computing power and training data. The other key difference is that SNS synapses are conductance based rather than current based which makes the dynamics non-linear, unlike an RNN. This allows for the modelling of modulatory neural pathways since the synapses can alter the net membrane conductance of a postsynaptic neuron without injecting current. It also enables the functional subnetwork approach to encompass addition, subtraction, multiplication, division, differentiation, and integration operations using the same family of functions.

Neuron and Synapse Models

edit

Non-spiking Neuron

edit

SNS networks are composed mainly of non-spiking leaky integrator nodes to which complexity may be added if needed. Such dynamics model non-spiking neurons like those studied extensively in invertebrates (e.g., nematode,[35] locust,[19] cockroach [36]) or may represent the mean activity of a population of spiking neurons.[37] The dynamics of the membrane voltage   of a non-spiking neuron are governed by the differential equation

 

where   is the membrane capacitance,   is an arbitrary current injected into the cell e.g., via a current clamp, and   and   are the leak and synaptic currents, respectively. The leak current

 

where   is the conductance of the cell membrane and   is the rest potential across the cell membrane. The synaptic current

 

where   is the number of synapses that impinge on the cell,   is the instantaneous synaptic conductance of the   incoming synapse, and   is the reversal potential of the   incoming synapse.

Graded Chemical Synapse

edit
 
Visual representation of a single synaptic connection between two neurons and the corresponding synaptic conduction dynamics (Figure 1A of Szczecinski et al.[1])

Non-spiking neurons communicate via graded chemical synapses:.[38] Typically, synaptic conductances are modeled with a continuous function like a sigmoid but in an SNS this conductance is approximated by the following piecewise-linear function [1]

 

As shown in the corresponding figure this allows the conductance to vary between 0 and a prescribed or designed maximum value ( ) depending on the presynaptic potential ( ). A piecewise approach is used to ensure exactly 0 conductance, and therefore current, at low activation potentials. This approximates a feature of spiking neuron activity in that no information is transmitted when the neuron isn’t spiking/active. Furthermore, this approximation eliminates transcendental functions enabling analytical calculations of dynamical properties. While this does prevent the network activity from being differentiable, since no gradient-based learning methods are employed (like backpropagation) this is not a drawback.

Persistent Sodium Current

edit

It was previously mentioned that additional ion channels could be incorporated to elicit more interesting behaviors from non-spiking neuron models. The persistent sodium current is one such addition. A persistent sodium current can depolarize a membrane enough to induce action potential firings at sub-threshold membrane potentials while also being slow to inactivate. In the context of neuroscientific models, this is useful for applications such as pattern generators where it is desired that a neuron’s potential can be rapidly increased and remain elevated until inhibited by another neural signal or applied current.[3][4]

The model for the behavior of this channel is based on the m and h gating present in the full Hodgkin-Huxley model. The main difference is that this model only uses one m gate instead of three. The equations governing this behavior can be found here and in this paper.[3]

Integrate-and-Fire

edit

Unless explicitly studying or utilizing the Hodgkin-Huxley model for action potentials, spiking neurons can be modeled via the integrate-and-fire method. This is significantly more computationally efficient than Hodgkin-Huxley making it easier to simulate much larger networks. In particular, leaky integrate-and-fire (LIF) neurons are used for SNS.[2] As the name suggests, this model accounts for membrane potential leak behavior representing ion diffusion across the membrane. This integrate-and-fire model is very similar to the non-spiking neuron described above with the key addition of a firing threshold parameter. When the neuron potential depolarizes to this threshold the neuron “spikes” by instantaneously resetting to its resting potential[2]

While these do not provide the same diversity of dynamical responses as Hodgkin-Huxley, they are usually sufficient for SNS applications and can be analyzed mathematically which is crucial for network tractability. Please refer to the linked Wikipedia article and paper for the equations associated with the LIF neuron model.

Izhikevich Model

edit

Spiking neurons can also be modeled in a computationally efficient manner without sacrificing the rich behaviors exhibited in biological neural activity.[39] The Izhikevich model can produce spiking behaviors approximately as plausible as Hodgkin-Huxley but with comparable computational efficiency to the integrate-and-fire method. To accomplish this, Izhikevich reduces the Hodgkin-Huxley model to a two-dimensional set of ordinary differential equations via bifurcation methods.[40] These can be seen here:

 

 

Where the membrane potential resets after spiking as described by:

 

  is a dimensionless variable representing the membrane potential.   is a dimensionless variable representing membrane recovery which accounts for the ion current behaviors, specifically those of   and  .  ,  ,  , and   are dimensionless parameters that can be altered to shape the signal into different neuronal response patterns. This enables chattering, bursting, and continuous spiking with frequency adaptation which constitute a richer array of behaviors than the basic integrate-and-fire method can produce.

The coefficients in the   equation were acquired via data fitting to a particular neuron’s spiking patterns (a cortical neuron in this case) to get the potentials in the mV range and time on the scale of ms. It is possible to use other neurons to fit the spike initiation dynamics, they will simply produce different coefficients.

For more information on the Izhikevich model and the bifurcation methods used to develop it please read the following.[39][40]

Rulkov Map

edit

The Rulkov map forgoes complex ion channel-based models composed of many non-linear differential equations in favor of a two-dimensional map.[31] This map expresses slow and fast dynamics which is vital for representing both slow oscillations and fast spikes and bursts. The model is shown below:

 

 

  is the fast dynamical variable and represents the membrane potential while   is the slow dynamical variable and does not have explicit biological meaning.   and   are used to describe external influences and help model the dynamics of stimuli like injected/synaptic and tonic/bias currents. Small values of   result in slow changes in   that account for its slower behavior. Assuming a constant external influence ( ) the function   can be written as the following discontinuous function:

 

In this case   is the map control parameter and can be used, along with  , to shape the output behavior of the neuron.

You can read more about the Rulkov map on the Wikipedia page hyperlinked here and in.[31]

Functional Subnetwork Approach (FSA)

edit

Functional Subnetworks are the building blocks of SNSs.[1] They are composed of neurons and synapses modeled from the equations described above as well as other neuroscience models. When tuned properly, as shown in the following section, they are capable of performing mathematical calculations as well as dynamical operations. This process is different from other artificial neural networks in that the tuning exploits the network structure. The artificial neural networks mentioned previously utilize all-to-all connectivity between layers but in a SNS there are no distinct layers. Rather the synaptic connections are methodically designed with an express function in mind. This results in fewer synaptic connections without sacrificing network effectiveness. Tuned subnetworks can be assembled into larger networks to form the SNS itself. Assembly can be done in series or in parallel, much like adding components to an electrical circuit. The resulting neural network is reminiscent of a peripheral nervous system, rather than a brain-like network (ANN).

Tuning with the Functional Subnetwork Approach (FSA)

edit

The leaky-integrator model above can be converted into a tuning-friendly equation by normalizing the membrane potential to read 0 when at rest ( ) and by introducing the   parameter.   is the potential operating range of the graded chemical synapse and is equal to  . Making these changes and then solving for the steady-state activation ( ) of the neuron (when  ) gives the following equation:[1]

 

  is determined by the difference between cell resting potential ( ) and the synaptic reversal potential ( ). This equation can be used to tune synapse conductances for specific points in the network’s operation where the neurons are in a steady state or have a known/designed membrane potential ( ). In this way it is possible to intentionally and directly set the state of the network during key moments in its operation sequence so that it produces a desired action or behavior.

Tuning a subnetwork requires the use of signal transmission and/or modulation pathways. Signal transmission pathways make a postsynaptic neuron’s potential proportional to that of the presynaptic neuron(s). The ratio of the synaptic proportionality is referred to as  . This can be used to calculate the maximum conductance value for a synapse ( ) via the equation:[1]

 

  is used in the graded chemical synapse model discussed previously. Tuning a synapse using   instead of the steady-state activation equation is practical when a specific relationship between a small subset of neurons is desired. For example, if a network requires that the postsynaptic neuron membrane potential be half that of the presynaptic neuron,   can be set to   and plugged into the equation.

The signal modulation pathway is used to modulate neuron sensitivity This allows for adaptive responses to various inputs. In this pathway   is used instead of  . Technically both are defined as the steady state postsynaptic potential ( ) divided by the presynaptic potential ( ), the ratio mentioned above, for a given applied current. The letter   is used for modulation to indicate that the neuron sensitivity is changing and is therefore not the same as   which represents a static relationship. For a modulation pathway,   can be calculated as:[1]

 

In order to minimize hyperpolarization of the postsynaptic neuron   should be kept negative and as close to 0 as possible (or zeroed entirely).

Arithmetic Networks

edit
 
Arithmetic subnetworks for addition (A), subtraction (B), division (C), and multiplication (D), and their corresponding contour plots for a visual representation of their behavior (Figure 2 of Szczecinski et al.[1])

All arithmetic subnetwork tuning methods were taken from.[1]

Addition

edit

Addition subnetworks are composed of one postsynaptic neuron connected to presynaptic neurons via excitatory transmission pathways. The purpose of the network is to enable an approximation of linear addition of the incoming presynaptic signals. The subnetwork can be tuned using either of the methods outlined previously. The addition behavior can be weighted using  . This type of network may represent positive feedback mechanisms in biology. To capture the addition properly   must be small but it cannot be 0 or the synapse will effectively be severed. Instead,   is maximized which results in small values of  .

Subtraction

edit

Subtraction subnetworks are similar to addition networks except the presynaptic potentials being subtracted travel to the postsynaptic cell via inhibitory transmission pathways. This may approximate negative feedback mechanisms in the nervous system. Unlike with depolarizing ions, hyperpolarizing ion potentials tend to be much closer to the membrane resting potential. This results in smaller   values so it is difficult to minimize   like in the addition subnetwork. The easiest way to properly tune a subtraction network is to design the parameters to fit a specific scenario. This process was already described using the steady state activation equation.   can also be used as in the addition subnetwork but since   cannot be minimized to the same degree the effect is not as precise. The equation to solve the inhibitory pathway in this manner is as follows:

 

The excitation pathway synaptic potential difference ( ) must first be determined. It is vital that   for the inhibitory pathway be negative or solving the equation will produce a negative conductance which is biologically impossible.

Division

edit

The physical structure of a division subnetwork is the same as a subtraction subnetwork except the inhibitory synapse is modulatory, rather than transmission. The division performed in this network follows the form below where the transmitted signal   is divided by the modulating signal  :

 

The excitatory transmission synapse is tuned as described previously. The modulatory reversal potential is right around 0 so the   from before is cancelled out (set to 0). Setting   equal to   and applying these to the steady-state activation equation gives the division equation above once simplified. From here the equation can be used as before and   can be set such that the network produces the desired division behavior. For example, if it were desired that   when   then   could be set to   (example from [1]).   values closer to 0 more strongly reduce the postsynaptic neuron’s sensitivity to inputs.

Multiplication

edit

Multiplication networks are somewhat similar to division networks but rather than having the modulatory synaptic connection directly between the presynaptic and postsynaptic neuron there is an interneuron in the way. The presynaptic neuron connects to the interneuron via a modulatory pathway and the interneuron connects to the postsynaptic neuron with another modulatory synapse (please see the figure in this section for clarification). This modulation in series results in a network that essentially divides by the inverse which turns out to be multiplication. The   parameter between the interneuron and the postsynaptic neuron is 0. This ensures that when its potential ( ) is at the maximum value allowed ( ) the postsynaptic neuron potential ( ) is 0 regardless of the applied current. This makes sense since dividing by a maximum allowed number for a system should result in the lowest possible output. Plugging this into the steady-state activation equation gives the following solution for the synaptic conductance:

 

  cannot be greater than or equal to 0 here as division by zero is undefined and dividing by a positive number gives a negative conductance which is impossible. The less negative   is, the larger   is. This means   must determine   so as to stay within the confines of biological plausibility. With this synapse designed the rest can be determined using the methods outlined in.[1] The process is rather involved and better suited for an in-depth reading.

Dynamic networks

edit

All dynamic subnetwork tuning methods were taken from.[1]

Differentiation

edit
 
Differentiator subnetwork and corresponding example plot of its behavior in the time domain. (Figure 3A,B of Szczecinski et al.[1])

Differentiation networks are nearly the same as subtraction networks with an added dynamical component. The presynaptic neuron that inhibits the postsynaptic neuron is modelled as a physically larger neuron which means it has a greater capacitance than the excitatory synapsing neuron. This increased capacitance results in a neuron that is slower to reach its fully excited state (ie.  ). Subtracting the slow responding neuron signal (with the inhibitory synapse) from the fast responding signal is basically a biological version of numerical differentiation whereby a previous time-“step” is subtracted from the current time-“step”. This network is good for identifying changes in applied current to a network or applied stimulus to a sensory neuron. The equations that detail this behavior are presented in.[1]

Integration

edit
 
Integrator subnetwork and corresponding example plot of its behavior in the time domain. (Figure 5A,B of Szczecinski et al.[1])

The neuron model used for SNS has leak dynamics meaning a current is always leaking out of the neuron to return it to resting potential. This means a single neuron modelled in this fashion is incapable of storing data. A system of two neurons, however, are capable of this if linked via mutually inhibitory transmission synapses with a marginally stable equilibrium curve. The mutual inhibition means that the activation levels are maintained instead of leaking away and the system state changes continuously for the duration of an applied stimulus (integration). Integration subnetworks, while not necessarily complicated in structure, are the most complex to define and prove. As such the derivation and proof of marginal stability are worth an in-depth read here [1] as a cursory overview would be insufficient.

Applications

edit

Robotic Leg Control

edit

As mentioned previously, the primary application of the Synthetic Nervous System method is robotic control. Within this field, SNSs have largely been used to control the locomotion of legged robots. Many examples of both simulated and physical robots which incorporate SNSs exist in the literature:

RoboLobster

edit
  • Ayers et al. constructed and tuned SNS controllers whose structure and function incorporated findings from many experimental studies to control the motions of the lobster-inspired robot, RoboLobster.[41] This work stands out as an early example of quintessential SNS robot control because of its depth of neural circuitry detail (e.g., command networks, coordination networks, and pattern generation networks) and breadth of bioinspiration (e.g., nervous system-like controller organization, animal-like body plan, neuromorphic sensors and encoding strategies, and myomorphic actuators).
  • Subsequent work from the Ayers lab has increased the biological detail of the neural and synaptic models used in their SNS controllers.[27] Once tuned by hand, the SNS produces coordinated output for controlling RoboLobster. As a consequence, this work demonstrates the robustness of neural circuits that coordinate crustacean leg movements

Neural controller for the hind leg walking in a dog robot based on mouse spinal circuitry

edit
  • This study proposed a novel systematic, offline method by which to tune the parameter values within the SNS. The tuning method was systematic in that derivative-free optimization programs selected parameter values that minimized loss functions related to network performance, e.g., the phasing between leg movement and pattern generating network activity, without human intervention. This eliminated time-consuming manual parameter tuning. The tuning method was offline in that all parameter selection took place before the robot began operation, eliminating the complex process of operating the robot to select parameter values.[5]

Design process and tools for dynamic neuromechanical models and robot controllers

edit
  • This study quantified the stability and phase response of a half-center oscillator model used in prior and subsequent SNS studies. The quantity “delta”, that is, the equilibrium voltage of the inhibited half-center relative to its synaptic conductance threshold  , was introduced as a means to predict the stability and phase-response characteristics of the oscillator model. This study relates “delta” to the synaptic conductance and reversal potential within the network.[3]
  • A mechanism underlying post-inhibitory rebound (PIR) within the half-center oscillator model was identified. Quantifying this mechanism facilitated the design of subsequent networks in which phase-altering sensory feedback should induce PIR (e.g., activation of swing networks after stance phase-signaling feedback ends [42]) or should not induce PIR (e.g., load feedback from one leg inhibiting the swing networks of the anterior leg [7]).
  • Design programs for tuning SNS parameters to achieve particular oscillation frequencies or phase response curves were described. These programs were applied to the control of a two-jointed simulated leg.[3]

Directed stepping neural control for the legs of a praying mantis robot known as MantisBot

edit
  • This study was the first to apply the Functional Subnetwork Approach (FSA) to the design of an SNS that controlled the motion of a robot. The SNS of over 400 neurons and over 800 synapses controlled the stepping of the robot’s leg and adapted the stepping motion based on the robot’s visual input. No trial-and-error was required to tune the network parameters, i.e., no hand tuning, optimization, or machine learning. Furthermore, because tuning was based on circuit structure and functionality, this approach saved time relative to past studies that used derivative-free optimization to tune the values. The structure of the network and its tuning by the FSA enabled the robot to produce the intended behaviors.[6][43]

Locomotion control of a simulated cockroach

edit
  • This study presented the largest SNS to be tuned by the FSA, an SNS with over 3,500 neurons and over 6,500 synapses whose structure was based on thoracic circuitry that controls insect locomotion. The SNS controlled the walking of a forward-dynamics simulation of a cockroach, named SimRoach2. SimRoach2 walked in a straight path with minimal body pitch and roll at 20 cm/s, a commonly observed walking speed for the model organism, Blaberus discoidalis.[44] As in study,[43] no trial-and-error was required to tune the network parameters.[7]

Neuromechanical walking model of a rat hind limb incorporating neural central pattern generators

edit
  • This study applied the FSA to the SNS from [5] and expanded it to include additional hierarchical levels of the spinal locomotion control network. This study demonstrated that FSA techniques could be applied to models of vertebrate locomotion and were not insect-specific.[45]

Brain networks

edit

Synthetic Nervous Systems have also been used to model higher functions in the nervous system than the peripheral networks responsible for locomotion. Some examples of these kinds of SNS are listed here:

Visual neural network model of a lobster for optical flow reflexes

edit
  • This study produced an SNS that calculated the optic flow of a lobster’s visual scene, and formulated direction-specific descending commands to the locomotion networks to drive behavior. This is an early SNS model of a brain network.[46]

Visual neural network model of a fruit fly for motion recognition

edit
  • The FSA was used to construct an SNS model of networks that process wide-field vision in insects, i.e., 12 columns of the insect optic lobe, including the retina, lamina, medulla, and lobula plate tangential cells (LPTC). This study is the first to apply the FSA to design exteroceptive networks, i.e., visual elementary motion detector (EMD) networks.[47]

Optomotor response model for a praying mantis inspired robot visual system

edit
  • The authors extend the model from [47] to include 64 columns of the optic lobe. The network was implemented as part of a robot’s control system. Neural feedback from the LPTCs drove an optomotor reflex similar to that described in insects.[34]

Simulation of a sensory integrator in the central complex of an insect brain

edit
  • An SNS based on the connectivity and function of the insect central complex (CX) was designed and tuned using the FSA and tested in simulation. The CX model reproduced responses to perturbations recorded in fruit flies and integrated antennal input as hypothesized in cockroaches.[48] Analysis from the FSA suggested a mechanism that may underlie the memory-like behavior of the CX.[49]

References

edit
  1. ^ a b c d e f g h i j k l m n o p q r s Szczecinski, Nicholas S.; Hunt, Alexander J.; Quinn, Roger D. (2017). "A Functional Subnetwork Approach to Designing Synthetic Nervous Systems That Control Legged Robot Locomotion". Frontiers in Neurorobotics. 11: 37. doi:10.3389/fnbot.2017.00037. ISSN 1662-5218. PMC 5552699. PMID 28848419.
  2. ^ a b c d e Szczecinski, Nicholas S.; Quinn, Roger D.; Hunt, Alexander J. (2020). "Extending the Functional Subnetwork Approach to a Generalized Linear Integrate-and-Fire Neuron Model". Frontiers in Neurorobotics. 14: 577804. doi:10.3389/fnbot.2020.577804. ISSN 1662-5218. PMC 7691602. PMID 33281592.
  3. ^ a b c d e f Szczecinski, Nicholas S.; Hunt, Alexander J.; Quinn, Roger D. (February 2017). "Design process and tools for dynamic neuromechanical models and robot controllers". Biological Cybernetics. 111 (1): 105–127. doi:10.1007/s00422-017-0711-4. ISSN 1432-0770. PMID 28224266. S2CID 253889279.
  4. ^ a b Rybak, Ilya A.; Shevtsova, Natalia A.; Lafreniere-Roula, Myriam; McCrea, David A. (2006-12-01). "Modelling spinal circuitry involved in locomotor pattern generation: insights from deletions during fictive locomotion". The Journal of Physiology. 577 (Pt 2): 617–639. doi:10.1113/jphysiol.2006.118703. ISSN 0022-3751. PMC 1890439. PMID 17008376.
  5. ^ a b c d Hunt, Alexander; Szczecinski, Nicholas; Quinn, Roger (2017). "Development and Training of a Neural Controller for Hind Leg Walking in a Dog Robot". Frontiers in Neurorobotics. 11: 18. doi:10.3389/fnbot.2017.00018. ISSN 1662-5218. PMC 5378996. PMID 28420977.
  6. ^ a b Szczecinski, Nicholas S.; Quinn, Roger D. (2017-06-08). "Template for the neural control of directed stepping generalized to all legs of MantisBot". Bioinspiration & Biomimetics. 12 (4): 045001. Bibcode:2017BiBi...12d5001S. doi:10.1088/1748-3190/aa6dd9. ISSN 1748-3190. PMID 28422047. S2CID 46824463.
  7. ^ a b c d Rubeo, Scott; Szczecinski, Nicholas; Quinn, Roger (January 2018). "A Synthetic Nervous System Controls a Simulated Cockroach". Applied Sciences. 8 (1): 6. doi:10.3390/app8010006. ISSN 2076-3417.
  8. ^ Riddle, Shane; Nourse, William R. P.; Yu, Zhuojun; Thomas, Peter J.; Quinn, Roger D. (2022). "A Synthetic Nervous System with Coupled Oscillators Controls Peristaltic Locomotion". In Hunt, Alexander; Vouloutsi, Vasiliki; Moses, Kenneth; Quinn, Roger; Mura, Anna; Prescott, Tony; Verschure, Paul F. M. J. (eds.). Biomimetic and Biohybrid Systems. Lecture Notes in Computer Science. Vol. 13548. Cham: Springer International Publishing. pp. 249–261. doi:10.1007/978-3-031-20470-8_25. ISBN 978-3-031-20470-8.
  9. ^ Castelvecchi, Davide (2016-10-06). "Can we open the black box of AI?". Nature News. 538 (7623): 20–23. Bibcode:2016Natur.538...20C. doi:10.1038/538020a. PMID 27708329. S2CID 4465871.
  10. ^ Beniaguev, David; Segev, Idan; London, Michael (2021-09-01). "Single cortical neurons as deep artificial neural networks". Neuron. 109 (17): 2727–2739.e3. doi:10.1016/j.neuron.2021.07.002. ISSN 0896-6273. PMID 34380016.
  11. ^ a b Rybak, Ilya A.; Shevtsova, Natalia A.; Kiehn, Ole (2013-11-15). "Modelling genetic reorganization in the mouse spinal cord affecting left-right coordination during locomotion". The Journal of Physiology. 591 (22): 5491–5508. doi:10.1113/jphysiol.2013.261115. ISSN 1469-7793. PMC 3853491. PMID 24081162.
  12. ^ a b Eliasmith, Chris (June 2005). "A unified approach to building and controlling spiking attractor networks". Neural Computation. 17 (6): 1276–1314. doi:10.1162/0899766053630332. ISSN 0899-7667. PMID 15901399. S2CID 2588747.
  13. ^ Bando, Yuki; Grimm, Christiane; Cornejo, Victor H.; Yuste, Rafael (2019-09-12). "Genetic voltage indicators". BMC Biology. 17 (1): 71. doi:10.1186/s12915-019-0682-0. ISSN 1741-7007. PMC 6739974. PMID 31514747.
  14. ^ Huan, Yu; Gill, Jeffrey P; Fritzinger, Johanna B; Patel, Paras R; Richie, Julianna M; Della Valle, Elena; Weiland, James D; Chestek, Cynthia A; Chiel, Hillel J (2021-12-01). "Carbon fiber electrodes for intracellular recording and stimulation". Journal of Neural Engineering. 18 (6): 066033. Bibcode:2021JNEng..18f6033H. doi:10.1088/1741-2552/ac3dd7. ISSN 1741-2560. PMC 10729305. PMID 34826825. S2CID 237100047.
  15. ^ Newton, Taylor H.; Reimann, Michael W.; Abdellah, Marwan; Chevtchenko, Grigori; Muller, Eilif B.; Markram, Henry (2021-06-15). "In silico voltage-sensitive dye imaging reveals the emergent dynamics of cortical populations". Nature Communications. 12 (1): 3630. Bibcode:2021NatCo..12.3630N. doi:10.1038/s41467-021-23901-7. ISSN 2041-1723. PMC 8206372. PMID 34131136.
  16. ^ Buschmann, Thomas; Ewald, Alexander; von Twickel, Arndt; Büschges, Ansgar (2015-06-29). "Controlling legs for locomotion-insights from robotics and neurobiology". Bioinspiration & Biomimetics. 10 (4): 041001. Bibcode:2015BiBi...10d1001B. doi:10.1088/1748-3190/10/4/041001. ISSN 1748-3190. PMID 26119450. S2CID 206101969.
  17. ^ Hunt, Alexander; Schmidt, Manuela; Fischer, Martin; Quinn, Roger (2015-09-09). "A biologically based neural system coordinates the joints and legs of a tetrapod". Bioinspiration & Biomimetics. 10 (5): 055004. doi:10.1088/1748-3190/10/5/055004. ISSN 1748-3190. PMID 26351756. S2CID 24424624.
  18. ^ Szczecinski, Nicholas S.; Quinn, Roger D. (April 2018). "Leg-local neural mechanisms for searching and learning enhance robotic locomotion". Biological Cybernetics. 112 (1–2): 99–112. doi:10.1007/s00422-017-0726-x. ISSN 0340-1200. PMID 28782078. S2CID 253884817.
  19. ^ a b Burrows, M.; Laurent, G. J.; Field, L. H. (August 1988). "Proprioceptive inputs to nonspiking local interneurons contribute to local reflexes of a locust hindleg". The Journal of Neuroscience. 8 (8): 3085–3093. doi:10.1523/JNEUROSCI.08-08-03085.1988. ISSN 0270-6474. PMC 6569416. PMID 3411369.
  20. ^ Bässler, U.; Büschges, A. (June 1998). "Pattern generation for stick insect walking movements--multisensory control of a locomotor program". Brain Research. Brain Research Reviews. 27 (1): 65–88. doi:10.1016/s0165-0173(98)00006-x. PMID 9639677. S2CID 16673654.
  21. ^ Li, Zhaoyu; Liu, Jie; Zheng, Maohua; Xu, X.Z. Shawn (November 2014). "Encoding of Both Analog- and Digital-like Behavioral Outputs by One C. elegans Interneuron". Cell. 159 (4): 751–765. doi:10.1016/j.cell.2014.09.056. ISSN 0092-8674. PMC 4243084. PMID 25417153.
  22. ^ Mihalaş, Ştefan; Niebur, Ernst (March 2009). "A Generalized Linear Integrate-and-Fire Neural Model Produces Diverse Spiking Behaviors". Neural Computation. 21 (3): 704–718. doi:10.1162/neco.2008.12-07-680. ISSN 0899-7667. PMC 2954058. PMID 18928368.
  23. ^ Breazeal, Cynthia L. (2002). Designing sociable robots. Cambridge, Mass.: MIT Press. ISBN 978-0-262-25583-7. OCLC 52291678.
  24. ^ Harvey, Inman; Paolo, Ezequiel Di; Wood, Rachel; Quinn, Matt; Tuci, Elio (January 2005). "Evolutionary Robotics: A New Scientific Tool for Studying Cognition". Artificial Life. 11 (1–2): 79–98. doi:10.1162/1064546053278991. ISSN 1064-5462. PMID 15811221. S2CID 224707.
  25. ^ Eastman, Peggy (2008-09-04). "National 'Think Tank' Calls for New Vision for Neuroscience". Neurology Today. 8 (17): 24–26. doi:10.1097/01.NT.0000337678.15055.f5. ISSN 1533-7006.
  26. ^ Olivier, Paul; Moreno Arostegui, Juan Manuel (2011). "Equilibrium-Driven Adaptive Behavior Design". In Cabestany, Joan; Rojas, Ignacio; Joya, Gonzalo (eds.). Advances in Computational Intelligence. Lecture Notes in Computer Science. Vol. 6692. Berlin, Heidelberg: Springer. pp. 589–596. doi:10.1007/978-3-642-21498-1_74. ISBN 978-3-642-21498-1.
  27. ^ a b Blustein, Daniel H. (2014). Control of a biomimetic robot lobster with a synthetic nervous system (Thesis). Northeastern University. doi:10.17760/d20128358. hdl:2047/d20128358.
  28. ^ Ayers, Joseph; Rulkov, Nikolai; Knudsen, Dan; Kim, Yong-Bin; Volkovskii, Alexander; Selverston, Allen (2010-02-09). "Controlling underwater robots with electronic nervous systems". Applied Bionics and Biomechanics. 7 (1): 57–67. doi:10.1080/11762320903244843. ISSN 1176-2322.
  29. ^ Blustein, Daniel; Rosenthal, Nikolai; Ayers, Joseph (2013-05-25). "Designing and Implementing Nervous System Simulations on LEGO Robots". JoVE (Journal of Visualized Experiments) (75): e50519. doi:10.3791/50519. ISSN 1940-087X. PMC 3719268. PMID 23728477.
  30. ^ Ayers, Joseph (2016-03-01). "Underwater Vehicles Based on Biological Intelligence". Mechanical Engineering. 138 (3): S6–S10. doi:10.1115/1.2016-Mar-7. ISSN 0025-6501.
  31. ^ a b c Rulkov, Nikolai F. (2002-04-10). "Modeling of spiking-bursting neural behavior using two-dimensional map". Physical Review E. 65 (4): 041922. arXiv:nlin/0201006. Bibcode:2002PhRvE..65d1922R. doi:10.1103/PhysRevE.65.041922. ISSN 1063-651X. PMID 12005888. S2CID 1998912.
  32. ^ Goldsmith, C A; Quinn, R D; Szczecinski, N S (2021-11-01). "Investigating the role of low level reinforcement reflex loops in insect locomotion". Bioinspiration & Biomimetics. 16 (6): 065008. Bibcode:2021BiBi...16f5008G. doi:10.1088/1748-3190/ac28ea. ISSN 1748-3182. PMID 34547724. S2CID 237595138.
  33. ^ Goldsmith, C A; Szczecinski, N S; Quinn, R D (2020-09-14). "Neurodynamic modeling of the fruit fly Drosophila melanogaster". Bioinspiration & Biomimetics. 15 (6): 065003. doi:10.1088/1748-3190/ab9e52. ISSN 1748-3190. PMID 32924978. S2CID 219911361.
  34. ^ a b Sedlackova, Anna; Szczecinski, Nicholas S.; Quinn, Roger D. (2020). "A Synthetic Nervous System Model of the Insect Optomotor Response". In Vouloutsi, Vasiliki; Mura, Anna; Tauber, Falk; Speck, Thomas; Prescott, Tony J.; Verschure, Paul F. M. J. (eds.). Biomimetic and Biohybrid Systems. Lecture Notes in Computer Science. Vol. 12413. Cham: Springer International Publishing. pp. 312–324. doi:10.1007/978-3-030-64313-3_30. ISBN 978-3-030-64313-3. S2CID 230717272.
  35. ^ Goodman, Miriam B; Hall, David H; Avery, Leon; Lockery, Shawn R (April 1998). "Active Currents Regulate Sensitivity and Dynamic Range in C. elegans Neurons". Neuron. 20 (4): 763–772. doi:10.1016/S0896-6273(00)81014-4. PMC 4444786. PMID 9581767.
  36. ^ Pearson, K. G.; Fourtner, C. R. (1975-01-01). "Nonspiking interneurons in walking system of the cockroach". Journal of Neurophysiology. 38 (1): 33–52. doi:10.1152/jn.1975.38.1.33. ISSN 0022-3077. PMID 162945.
  37. ^ Wilson, Hugh R.; Cowan, Jack D. (January 1972). "Excitatory and Inhibitory Interactions in Localized Populations of Model Neurons". Biophysical Journal. 12 (1): 1–24. Bibcode:1972BpJ....12....1W. doi:10.1016/S0006-3495(72)86068-5. PMC 1484078. PMID 4332108.
  38. ^ Ripley, S. H.; Bush, B. M. H.; Roberts, Alan (June 1968). "Crab Muscle Receptor which responds without Impulses". Nature. 218 (5147): 1170–1171. Bibcode:1968Natur.218.1170R. doi:10.1038/2181170a0. ISSN 0028-0836. PMID 5656640. S2CID 4260867.
  39. ^ a b Izhikevich, E.M. (November 2003). "Simple model of spiking neurons". IEEE Transactions on Neural Networks. 14 (6): 1569–1572. doi:10.1109/TNN.2003.820440. ISSN 1045-9227. PMID 18244602. S2CID 814743.
  40. ^ a b Izhikevich, Eugene M. (2007). Dynamical systems in neuroscience : the geometry of excitability and bursting. Cambridge, Mass.: MIT Press. ISBN 978-0-262-27607-8. OCLC 76159374.
  41. ^ Ayers, Joseph (July 2004). "Underwater walking". Arthropod Structure & Development. 33 (3): 347–360. Bibcode:2004ArtSD..33..347A. doi:10.1016/j.asd.2004.06.001. PMID 18089043.
  42. ^ Szczecinski, Nicholas S.; Quinn, Roger D. (2017), Mangan, Michael; Cutkosky, Mark; Mura, Anna; Verschure, Paul F.M.J. (eds.), "MantisBot Changes Stepping Speed by Entraining CPGS to Positive Velocity Feedback", Biomimetic and Biohybrid Systems, Lecture Notes in Computer Science, vol. 10384, Cham: Springer International Publishing, pp. 440–452, doi:10.1007/978-3-319-63537-8_37, ISBN 978-3-319-63536-1, retrieved 2023-04-21
  43. ^ a b Szczecinski, Nicholas S.; Getsy, Andrew P.; Martin, Joshua P.; Ritzmann, Roy E.; Quinn, Roger D. (September 2017). "Mantisbot is a robotic model of visually guided motion in the praying mantis". Arthropod Structure & Development. 46 (5): 736–751. Bibcode:2017ArtSD..46..736S. doi:10.1016/j.asd.2017.03.001. PMID 28302586.
  44. ^ Bender, John A.; Simpson, Elaine M.; Tietz, Brian R.; Daltorio, Kathryn A.; Quinn, Roger D.; Ritzmann, Roy E. (2011-06-15). "Kinematic and behavioral evidence for a distinction between trotting and ambling gaits in the cockroach Blaberus discoidalis". Journal of Experimental Biology. 214 (12): 2057–2064. doi:10.1242/jeb.056481. ISSN 1477-9145. PMC 3102013. PMID 21613522.
  45. ^ Deng, Kaiyu; Szczecinski, Nicholas S.; Arnold, Dirk; Andrada, Emanuel; Fischer, Martin S.; Quinn, Roger D.; Hunt, Alexander J. (2019-03-01). "Neuromechanical Model of Rat Hindlimb Walking with Two-Layer CPGs". Biomimetics. 4 (1): 21. doi:10.3390/biomimetics4010021. ISSN 2313-7673. PMC 6477610. PMID 31105206.
  46. ^ Ayers, Joseph; Rulkov, Nikolai (2008), Kato, Naomi; Kamimura, Shinji (eds.), "Controlling Biomimetic Underwater Robots with Electronic Nervous Systems", Bio-mechanisms of Swimming and Flying, Tokyo: Springer Japan, pp. 295–306, doi:10.1007/978-4-431-73380-5_24, ISBN 978-4-431-73379-9, retrieved 2023-04-21
  47. ^ a b Bračun, Drago; Szczecinski, Nicholas S.; Škulj, Gašper; Hunt, Alexander J.; Quinn, Roger D. (2018), Vouloutsi, Vasiliki; Halloy, José; Mura, Anna; Mangan, Michael (eds.), "Artificial Compound Eye and Synthetic Neural System for Motion Recognition", Biomimetic and Biohybrid Systems, Lecture Notes in Computer Science, vol. 10928, Cham: Springer International Publishing, pp. 52–63, doi:10.1007/978-3-319-95972-6_7, ISBN 978-3-319-95971-9, retrieved 2023-04-21
  48. ^ Varga, Adrienn G.; Kathman, Nicholas D.; Martin, Joshua P.; Guo, Peiyuan; Ritzmann, Roy E. (2017-01-24). "Spatial Navigation and the Central Complex: Sensory Acquisition, Orientation, and Motor Control". Frontiers in Behavioral Neuroscience. 11: 4. doi:10.3389/fnbeh.2017.00004. ISSN 1662-5153. PMC 5258693. PMID 28174527.
  49. ^ Pickard, S C; Quinn, R D; Szczecinski, N S (2020-01-13). "A dynamical model exploring sensory integration in the insect central complex substructures". Bioinspiration & Biomimetics. 15 (2): 026003. Bibcode:2020BiBi...15b6003P. doi:10.1088/1748-3190/ab57b6. ISSN 1748-3190. PMID 31726442. S2CID 208040084.