Deep and Handcrafted Feature Fusion for Automatic Defect Detection in Quadratic Frequency Modulated Thermal Wave Imaging
G. T. Vesala, V. S. Ghali, A. Vijaya Lakshmi, R. Baloji Naik
Abstract
Recent advancements of nondestructive testing and evaluation (NDT&E) with machine learning, artificial intelligence, and the internet of things as key enablers in parallel with industry 4.0 reached the fourth industrial revolution. Nevertheless, active thermography (AT) is a noncontact, whole field, safe, remote, cost-efficient, and widely used NDT technique for subsurface anomaly detection. In AT, the automatic defect detection is modelled as object localization and semantic segmentation in thermograms. This paper presents a feature fusion network that fuses the global features extracted using a deep neural network (DNN) with the deep features extracted using a convolutional neural network (CNN). A set of handcrafted timedomain statistical and frequency domain features of thermal profiles are given to the DNN subnetwork whereas, the CNN subnetwork is fed with the thermal profiles in the feature fusion network. Experimentation is carried out over carbon fiber reinforced polymer (CFRP) sample with artificially drilled flat bottom holes excited by quadratic frequency-modulated optical stimulus. Experimental results showed that the feature fusion enhanced the defect detection capability compared to the local networks with a significant increment in signal-to-noise ratio, accuracy, and F-score.