Composite Neuro-Fuzzy System-Guided Cross-Modal Zero-Sample Diagnostic Framework Using Multisource Heterogeneous Noncontact Sensing Data
Sheng Li, Jinchen Ji, Ke Feng, Ke Zhang, Qing Ni, Yadong Xu
Abstract
Zero-sample diagnostic methods have gained recognition in addressing the scarcity of gearbox fault samples, thereby being regarded as a promising technique to guarantee gearbox safety. However, historical zero-sample approaches typically neglect the use of multimodal noncontact sensing data and rarely consider the interpretability of the diagnostic process. This oversight limits their application in industrial environments that require high reliability or operate under extreme conditions. Therefore, this article presents a composite neuro-fuzzy system-guided cross-modal zero-sample diagnostic framework, termed FCZD-IA, which employs infrared thermography and acoustic data to monitor gearbox conditions. Specifically, FCZD-IA uses a proposed composite neural system as a decision-maker in the diagnostic task, while integrating a deep backbone network to discriminatively learn high-level fault features from multimodal data. Moreover, a specific training strategy is designed to guide the learning process of the FCZD-IA to promote robust and interpretable zero-sample diagnostics. Comprehensive experimental results validate the effectiveness of the proposed framework and its superiority over other competitive methods.