Litcius/Paper detail

A Theoretical Analysis of Deep Neural Networks and Parametric PDEs

Gitta Kutyniok, Philipp Petersen, Mones Raslan, Reinhold Schneider

2021Constructive Approximation67 citationsDOIOpen Access PDF

Abstract

Abstract We derive upper bounds on the complexity of ReLU neural networks approximating the solution maps of parametric partial differential equations. In particular, without any knowledge of its concrete shape, we use the inherent low dimensionality of the solution manifold to obtain approximation rates which are significantly superior to those provided by classical neural network approximation results. Concretely, we use the existence of a small reduced basis to construct, for a large variety of parametric partial differential equations, neural networks that yield approximations of the parametric solution maps in such a way that the sizes of these networks essentially only depend on the size of the reduced basis.

Topics & Concepts

Parametric statisticsArtificial neural networkCurse of dimensionalityPartial differential equationMathematicsBasis (linear algebra)Applied mathematicsManifold (fluid mechanics)Variety (cybernetics)Parametric equationParametric modelComputer scienceMathematical optimizationMathematical analysisArtificial intelligenceGeometryMechanical engineeringStatisticsEngineeringModel Reduction and Neural NetworksNeural Networks and ApplicationsAdvanced Numerical Methods in Computational Mathematics