DCA-DAFFNet: An End-to-End Network With Deformable Fusion Attention and Deep Adaptive Feature Fusion for Laryngeal Tumor Grading From Histopathology Images
Jiayang Luo, Pan Huang, Peng He, Biao Wei, Xiaodong Guo, Hualiang Xiao, Yuchun Sun, Sukun Tian, Mi Zhou, Peng Feng
Abstract
Laryngeal Tumor Grading is a challenge task for computer-aided clinical diagnosis (CACD), mainly because the nuclei in histopathological images have large differences in shape and distribution, and the complex spatial relationship between nuclei. However, the existing CNN-based tumor grading models cannot adaptively represent the nuclei with variable morphology, and lack of effective modeling for the semantic information of nuclear spatial location. Therefore, we propose an end-to-end network (DCA-DAFFNet) with deformable convolution guided attention block (DCAB) and deep adaptive feature fusion (DAFF) to improve the grading ability. Specifically, a novel DCAB is designed to represent variable nuclei adaptively with more flexible receptive fields of deformable convolution. Besides, to solve the problem of poor semantic information modeling ability of nuclear spatial location, the vision transformer (ViT) block is incorporated into the attention-based CNN models to construct DCA-DAFFNet with powerful global information representation capability. Furthermore, a DAFF method containing multi-kernel max mean discrepancy (MK-MMD) and adaptive fusion block is proposed to solve the problem of negative fusion in DCA-DAFFNet. Extensive experiments results demonstrate the effectiveness of DCA-DAFFNet, and its average grading accuracy is increased to 90.78% ( ↑ 11.80%). By comparing visualization results, our proposed DCA-DAFFNet can pay more attention to the heterogeneous nuclei (polymorphic-nucleus, mega-nucleus, etc.) concerned by pathologists, which shows that our method more interpretable and human-computer interactive.