Litcius/Paper detail

Algorithm 1004

Jeremy Reizenstein, Benjamin Graham

2020ACM Transactions on Mathematical Software26 citationsDOIOpen Access PDF

Abstract

Iterated-integral signatures and log signatures are sequences calculated from a path that characterizes its shape. They originate from the work of K. T. Chen and have become important through Terry Lyons’s theory of differential equations driven by rough paths, which is an important developing area of stochastic analysis. They have applications in statistics and machine learning, where there can be a need to calculate finite parts of them quickly for many paths. We introduce the signature and the most basic information (displacement and signed areas) that it contains. We present algorithms for efficiently calculating these signatures. For log signatures this requires consideration of the structure of free Lie algebras. We benchmark the performance of the algorithms. The methods are implemented in C++ and released as a Python extension package, which also supports differentiation. In combination with a machine learning library (Tensorflow, PyTorch, or Theano), this allows end-to-end learning of neural networks involving signatures.

Topics & Concepts

Python (programming language)Computer scienceIterated functionOrdinary differential equationAlgorithmSignature (topology)Benchmark (surveying)Artificial neural networkTheoretical computer scienceArtificial intelligenceDifferential equationMathematicsProgramming languageGeometryGeographyMathematical analysisGeodesyPolynomial and algebraic computationModel Reduction and Neural NetworksAdvanced Numerical Analysis Techniques