Litcius/Paper detail

Control of criticality and computation in spiking neuromorphic networks with plasticity

Benjamin Cramer, David Stöckel, Markus Kreft, Michael Wibral, Johannes Schemmel, Karlheinz Meier, Viola Priesemann

2020Nature Communications94 citationsDOIOpen Access PDF

Abstract

The critical state is assumed to be optimal for any computation in recurrent neural networks, because criticality maximizes a number of abstract computational properties. We challenge this assumption by evaluating the performance of a spiking recurrent neural network on a set of tasks of varying complexity at - and away from critical network dynamics. To that end, we developed a plastic spiking network on a neuromorphic chip. We show that the distance to criticality can be easily adapted by changing the input strength, and then demonstrate a clear relation between criticality, task-performance and information-theoretic fingerprint. Whereas the information-theoretic measures all show that network capacity is maximal at criticality, only the complex tasks profit from criticality, whereas simple tasks suffer. Thereby, we challenge the general assumption that criticality would be beneficial for any task, and provide instead an understanding of how the collective network state should be tuned to task requirement.

Topics & Concepts

Neuromorphic engineeringCriticalityComputer scienceComputationTask (project management)Spiking neural networkArtificial neural networkSet (abstract data type)State (computer science)Models of neural computationSimple (philosophy)Theoretical computer scienceArtificial intelligenceControl (management)Relation (database)Random neural networkComputational complexity theoryNetwork dynamicsComplex systemDistributed computingDeep neural networksNetwork modelRecurrent neural networkComplex networkModularity (biology)Computational modelOptimal controlAdvanced Memory and Neural ComputingNeural Networks and Reservoir ComputingFerroelectric and Negative Capacitance Devices
Control of criticality and computation in spiking neuromorphic networks with plasticity | Litcius