Litcius/Paper detail

High-Performance Reservoir Computing With Fluctuations in Linear Networks

Johannes Nokkala, Rodrigo Martínez‐Peña, Roberta Zambrini, Miguel C. Soriano

2021IEEE Transactions on Neural Networks and Learning Systems32 citationsDOI

Abstract

Reservoir computing has emerged as a powerful machine learning paradigm for harvesting nontrivial information processing out of disordered physical systems driven by sequential inputs. To this end, the system observables must become nonlinear functions of the input history. We show that encoding the input to quantum or classical fluctuations of a network of interacting harmonic oscillators can lead to a high performance comparable to that of a standard echo state network in several nonlinear benchmark tasks. This equivalence in performance holds even with a linear Hamiltonian and a readout linear in the system observables. Furthermore, we find that the performance of the network of harmonic oscillators in nonlinear tasks is robust to errors both in input and reservoir observables caused by external noise. For any reservoir computing system with a linear readout, the magnitude of trained weights can either amplify or suppress noise added to reservoir observables. We use this general result to explain why the oscillators are robust to noise and why having precise control over reservoir memory is important for noise robustness in general. Our results pave the way toward reservoir computing harnessing fluctuations in disordered linear systems.

Topics & Concepts

Reservoir computingObservableNonlinear systemRobustness (evolution)Noise (video)Computer sciencePhysical systemControl theory (sociology)Harmonic oscillatorStatistical physicsPhysicsArtificial intelligenceArtificial neural networkQuantum mechanicsBiochemistryChemistryGeneImage (mathematics)Recurrent neural networkControl (management)Neural Networks and Reservoir ComputingAdvanced Memory and Neural ComputingNeural dynamics and brain function
High-Performance Reservoir Computing With Fluctuations in Linear Networks | Litcius