Learning Long-Range Relationships for Temporal Aircraft Anomaly Detection
Da Zhang, Junyu Gao, Xuelong Li
Abstract
Time-series classification for anomaly detection in calibrating aircraft sensors is crucial to ensuring aviation security. Nevertheless, the lengthy temporal span of sensor data causes difficulties in extracting global information dependence and the limited number of samples can easily cause model overfitting. To tackle these problems, we propose SMDA-Net, the <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$\underline{\rm{S}}$</tex-math></inline-formula> tratified <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$\underline{\rm{M}}$</tex-math></inline-formula> ulti-scale representation learning network with automatic <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$\underline{\rm{D}}$</tex-math></inline-formula> ata <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$\underline{\rm{A}}$</tex-math></inline-formula> ugmentation for long-range time-series modeling. Specifically, we design a stratified structure to extract multi-scale characteristics of time-series, wherein we develop an encoder with an efficient self-attention block for ultra-long sequences. Meanwhile, we present a scheme via learning to weight the contribution of the augmented samples to the loss for automatic data augmentation to improve the generalization ability of our model. Extensive experiments indicate that our model exhibits high performance on Flights dataset and exceeds state-of-the-art methods on 18 long-range time-series datasets. Moreover, we verify the effectiveness of our method through ablation study and visualization analysis.