Litcius/Paper detail

AI Pontryagin or how artificial neural networks learn to control dynamical systems

Lucas Böttcher, Nino Antulov-Fantulin, Thomas Asikis

2022Nature Communications84 citationsDOIOpen Access PDF

Abstract

The efficient control of complex dynamical systems has many applications in the natural and applied sciences. In most real-world control problems, both control energy and cost constraints play a significant role. Although such optimal control problems can be formulated within the framework of variational calculus, their solution for complex systems is often analytically and computationally intractable. To overcome this outstanding challenge, we present AI Pontryagin, a versatile control framework based on neural ordinary differential equations that automatically learns control signals that steer high-dimensional dynamical systems towards a desired target state within a specified time interval. We demonstrate the ability of AI Pontryagin to learn control signals that closely resemble those found by corresponding optimal control frameworks in terms of control energy and deviation from the desired target state. Our results suggest that AI Pontryagin is capable of solving a wide range of control and optimization problems, including those that are analytically intractable.

Topics & Concepts

Optimal controlPontryagin's minimum principleDynamical systems theoryComputer scienceRange (aeronautics)Control (management)Dynamical system (definition)Ordinary differential equationArtificial neural networkHamiltonian (control theory)State (computer science)Mathematical optimizationControl theory (sociology)MathematicsDifferential equationArtificial intelligenceAlgorithmPhysicsEngineeringMathematical analysisAerospace engineeringQuantum mechanicsModel Reduction and Neural NetworksNeural Networks and ApplicationsNeural Networks and Reservoir Computing