A recurrent neural network-based monitoring system using time-sequential molten pool images in wire arc directed energy deposition

Abstract

• A monitoring system to ensure the quality of wire arc directed energy deposition parts. • A novel conditional generative adversarial network-based data augmentation method. • A classifier using time-sequential molten pool image data to identify defects. • Multiple common welding defect types are covered, especially internal defects. • A real-world aircraft winglet part is fabricated to evaluate the monitoring system. Directed energy deposition (DED) is a widely utilized additive manufacturing technique, with wire arc directed energy deposition (WA-DED) being a notable variant, particularly for producing medium to large-sized metal parts in industries such as aerospace and maritime. However, due to the inherent instability of the WA-DED process, even with optimized deposition parameters, subtle internal defects that significantly impact part structural integrity may still occasionally occur. To ensure the quality and reliability of high-end and high-valued parts, developing an effective monitoring system to detect defects and eliminate substandard products is a significant research focus. Thus, this research proposes a novel monitoring system for WA-DED, utilizing recurrent neural network algorithmic structures and time-sequential molten pool images. The system consists of three critical modules: (i) data pre-processing, using fast Fourier transform and low-pass filter for noise reduction; (ii) data augmentation, employing a time-sequential image data augmentation algorithm with vector quantized variational autoencoder (VQVAE) for feature extraction and conditional generative adversarial network (CGAN) for generating new datasets; (iii) classifier construction, developing an algorithm based on the convolutional long short-term memory (ConvLSTM) algorithmic structure to construct a classifier. The proposed monitoring system demonstrates near real-time performance with an average monitoring latency of approximately 0.02 s per time-sequential image group. The effectiveness of the proposed monitoring system is validated by its application in defect detection within a real-world aircraft winglet part. The defect spectrums of each case are generated based on the detection results, which intuitively show the category and location of the potential defects. The detection accuracies on internal defects and severe defects are 94.25% and 93.76% respectively. The result demonstrates the system’s superior ability to identify various types of defects with high accuracy and reliability in fabricating complex parts.

Topics & Concepts