Litcius/Paper detail

Learning by non-interfering feedback chemical signaling in physical networks

Vidyesh Rao Anisetti, B. Scellier, J. M. Schwarz

2023Physical Review Research23 citationsDOIOpen Access PDF

Abstract

Both non-neural and neural biological systems can learn. So rather than focusing on purely brain-like learning, efforts are underway to study learning in physical systems. Such efforts include equilibrium propagation (EP) and coupled learning (CL), which require storage of two different states---the free state and the perturbed state---during the learning process to retain information about gradients. Here, we propose a learning algorithm rooted in chemical signaling that does not require storage of two different states. Rather, the output error information is encoded in a chemical signal that diffuses into the network in a similar way as the activation/feedforward signal. The steady-state feedback chemical concentration, along with the activation signal, stores the required gradient information locally. We apply our algorithm using a physical, linear flow network and test it using the Iris data set with 93% accuracy. We also prove that our algorithm performs gradient descent. Finally, in addition to comparing our algorithm directly with EP and CL, we address the biological plausibility of the algorithm.

Topics & Concepts

SIGNAL (programming language)Gradient descentFeed forwardComputer scienceArtificial neural networkSet (abstract data type)Process (computing)State (computer science)Physical systemPositive feedbackSignal-flow graphAlgorithmArtificial intelligenceBiological systemEngineeringPhysicsControl engineeringProgramming languageBiologyQuantum mechanicsElectrical engineeringOperating systemNeural dynamics and brain functionNeural Networks and Reservoir ComputingSlime Mold and Myxomycetes Research
Learning by non-interfering feedback chemical signaling in physical networks | Litcius