Litcius/Paper detail

Reservoir computing with higher-order interactive coupled pendulums

Xueqi Li, Michael Small, Youming Lei

2023Physical review. E14 citationsDOI

Abstract

The reservoir computing approach utilizes a time series of measurements as input to a high-dimensional dynamical system known as a reservoir. However, the approach relies on sampling a random matrix to define its underlying reservoir layer, which leads to numerous hyperparameters that need to be optimized. Here, we propose a nonlocally coupled pendulum model with higher-order interactions as a novel reservoir, which requires no random underlying matrices and fewer hyperparameters. We use Bayesian optimization to explore the hyperparameter space within a minimal number of iterations and train the coupled pendulums model to reproduce the chaotic attractors, which simplifies complicated hyperparameter optimization. We illustrate the effectiveness of our technique with the Lorenz system and the Hindmarsh-Rose neuronal model, and we calculate the Pearson correlation coefficients between time series and the Hausdorff metrics in the phase space. We demonstrate the contribution of higher-order interactions by analyzing the interaction between different reservoir configurations and prediction performance, as well as computations of the largest Lyapunov exponents. The chimera state is found as the most effective dynamical regime for prediction. The findings, where we present a new reservoir structure, offer potential applications in the design of high-performance modeling of dynamics in physical systems.

Topics & Concepts

HyperparameterReservoir computingChaoticAttractorComputer sciencePhase spaceLyapunov exponentDynamical systems theoryStatistical physicsParameter spaceSeries (stratigraphy)Hyperparameter optimizationBayesian optimizationDynamical system (definition)ComputationApplied mathematicsAlgorithmPhysicsArtificial intelligenceMathematicsArtificial neural networkRecurrent neural networkMathematical analysisThermodynamicsSupport vector machineQuantum mechanicsBiologyStatisticsPaleontologyNeural Networks and Reservoir ComputingNeural dynamics and brain functionAdvanced Memory and Neural Computing