Hybrid Deep Learning for Predictive Maintenance: LSTM, GRU, CNN, and Dense Models Applied to Transformer Failure Forecasting
Balduíno César Mateus, Mateus Mendes, José Torres Farinha, Alexandre Martins
Abstract
Data is an important resource for gaining knowledge about the behavior and condition monitoring of machines, enabling the estimation of parameters and the prediction of failures. However, in industrial environments, sensor interruptions often create gaps in the time series, which affects the reliability of the data. To overcome this challenge, this paper proposes an imputation strategy based on recurrent neural networks, in particular long short-term memory (LSTM) models, within a multivariate encoder–decoder architecture. This approach utilizes correlations between variables to reconstruct missing values, resulting in more complete and robust datasets. Experimental results with multivariate time series show that the proposed method achieves accurate imputation, with errors as low as RMSE = 2.33 and R2 = 0.90 for some variables. Comparisons with alternative architectures, including GRU and Dense networks, show that LSTM excels in specific cases (e.g., VL3, R2 = 0.45), while the Dense architecture provides more stable performance across most variables. In particular, the Dense model achieved the best overall balance between accuracy and robustness, reaching RMSE = 2.33 and R2 = 0.90 for the best-performing variables, while the LSTM achieved the lowest error values in targeted scenarios, confirming its suitability for capturing complex temporal dependencies. Overall, this study highlights the feasibility of using recurrent neural networks to exploit temporal correlations for reliable data recovery, even under conditions of signal interruption in factory environments.