A New Approach for Fundus Lesions Instance Segmentation Based on Mask R-CNN X101-FPN Pre-Trained Architecture
Carlos Silva, Marílton Sanchotene de Aguiar, Daniel Welfer, Marcelo Fernandes Pacheco Dias, Alejandro Pereira, Marcelo Lima Ribeiro, Bruno Belloni
Abstract
Diabetic retinopathy is one of the main causes of vision loss, and it can be identified through ophthalmological examinations that aim to locate the presence of retinal lesions such as Microaneurysms, Hemorrhages, Soft Exudates, and Hard Exudates. The development of computerized approaches to perform the instance segmentation of these lesions can help in the early diagnosis of the disease. However, the segmentation of instances of artifacts in the retina is a complex task due to factors such as object size and morphological characteristics. This article proposes a new approach based on a Mask Regions with Convolutional Neural Network features (Mask R-CNN) architecture to perform instance segmentation of lesions associated with diabetic retinopathy. The proposed approach was trained, adjusted, and tested using different public datasets of diabetic retinopathy, which were implemented with the Detectron2 libraries and OpenCV. The best result obtained by the proposed approach in the Dataset for Diabetic Retinopathy (DDR) was using Tilling and Adam optimizer, reaching a mean Average Precision ( <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$mAP$ </tex-math></inline-formula> ) of 0.2903 in the detection of fundus lesions for the limit of Intersection Over Union ( <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$IoU$ </tex-math></inline-formula> ) of 0.5 in the validation stage and an <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$mAP$ </tex-math></inline-formula> of 0.1670 in the detection of fundus lesions to the limit of <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$IoU$ </tex-math></inline-formula> of 0.5 in the test step. The results obtained in the experiments demonstrate that the proposed approach presented promising results in the instance segmentation of microaneurysms with an increase in precision, which in our case reaches approximately 16%.