Infrared Thermal Image Instance Segmentation Method for Power Substation Equipment Based on Visual Feature Reasoning
Zhenbing Zhao, Shuo Feng, Yongjie Zhai, Wenqing Zhao, Gang Li
Abstract
Accurate infrared thermal image instance segmentation of substation equipment is a prerequisite for intelligent analysis of its temperature status. To address the issues of low accuracy and false detection in existing substation instance segmentation methods, we propose a visual feature reasoning-based substation infrared thermal image instance segmentation method to compensate for the limitations of deep learning methods and improve the instance segmentation accuracy. We propose utilizing distinctive visual features as a priori knowledge for three types of substation equipment and construct a two-branch instance segmentation model (FR-SOLOv2) based on power domain expertise and visual feature reasoning. FR-SOLOv2 comprises distinctive visual feature extraction and reasoning network (FR) as well as a substation equipment image segmentation network (SOLOv2). FR combines power domain knowledge and visual feature reasoning to provide accurate localization and classification information for each substation device. SOLOv2 accomplishes segmenting substation devices in infrared images based on residual networks and feature fusion pyramids. The test results well demonstrate the superiority of our model for instance segmentation of the infrared image of substation equipment. Additionally, FR-SOLOv2 demonstrates an average accuracy of 83.18% on the substation equipment infrared image dataset, a significant improvement of 13.5% compared to the baseline model. The method relying on prior knowledge for visual feature reasoning on deep learning methods also presents a new approach to substation equipment image segmentation.