Practical Application of Artificial Intelligence Technology in Glaucoma Diagnosis
Di Gong, Man Hu, Yue Yin, Tong Zhao, Tong Ding, Fan Meng, Yongli Xu, Yi Chen
Abstract
Purpose. By comparing the performance of different models between artificial intelligence (AI) and doctors, we aim to evaluate and identify the optimal model for future usage of AI. Methods. A total of 500 fundus images of glaucoma and 500 fundus images of normal eyes were collected and randomly divided into five groups, with each group corresponding to one round. The AI system provided diagnostic suggestions for each image. Four doctors provided diagnoses without the assistance of the AI in the first round and with the assistance of the AI in the second and third rounds. In the fourth round, doctor B and doctor D made diagnoses with the help of the AI and the other two doctors without the help of the AI. In the last round, doctor A and doctor B made diagnoses with the help of AI and the other two doctors without the help of the AI. Results. Doctor A, doctor B, and doctor D had a higher accuracy in the diagnosis of glaucoma with the assistance of AI in the second ( <a:math xmlns:a="http://www.w3.org/1998/Math/MathML" id="M1"> <a:mi>p</a:mi> <a:mo>=</a:mo> <a:mn>0.036</a:mn> </a:math> , <c:math xmlns:c="http://www.w3.org/1998/Math/MathML" id="M2"> <c:mi>p</c:mi> <c:mo>=</c:mo> <c:mn>0.003</c:mn> </c:math> , and <e:math xmlns:e="http://www.w3.org/1998/Math/MathML" id="M3"> <e:mi>p</e:mi> <e:mo>≤</e:mo> <e:mn>0.000</e:mn> </e:math> ) and the third round ( <g:math xmlns:g="http://www.w3.org/1998/Math/MathML" id="M4"> <g:mi>p</g:mi> <g:mo>=</g:mo> <g:mn>0.021</g:mn> </g:math> , <i:math xmlns:i="http://www.w3.org/1998/Math/MathML" id="M5"> <i:mi>p</i:mi> <i:mo>≤</i:mo> <i:mn>0.000</i:mn> </i:math> , and <k:math xmlns:k="http://www.w3.org/1998/Math/MathML" id="M6"> <k:mi>p</k:mi> <k:mo>≤</k:mo> <k:mn>0.000</k:mn> </k:math> ) than in the first round. The accuracy of at least one doctor was higher than that of AI in the second and third rounds, in spite of no detectable significance ( <m:math xmlns:m="http://www.w3.org/1998/Math/MathML" id="M7"> <m:mi>p</m:mi> <m:mo>=</m:mo> <m:mn>0.283</m:mn> </m:math> , <o:math xmlns:o="http://www.w3.org/1998/Math/MathML" id="M8"> <o:mi>p</o:mi> <o:mo>=</o:mo> <o:mn>0.727</o:mn> </o:math> , <q:math xmlns:q="http://www.w3.org/1998/Math/MathML" id="M9"> <q:mi>p</q:mi> <q:mo>=</q:mo> <q:mn>0.344</q:mn> </q:math> , and <s:math xmlns:s="http://www.w3.org/1998/Math/MathML" id="M10"> <s:mi>p</s:mi> <s:mo>=</s:mo> <s:mn>0.508</s:mn> </s:math> ). The four doctors’ overall accuracy ( <u:math xmlns:u="http://www.w3.org/1998/Math/MathML" id="M11"> <u:mi>p</u:mi> <u:mo>=</u:mo> <u:mn>0.004</u:mn> </u:math> and <w:math xmlns:w="http://www.w3.org/1998/Math/MathML" id="M12"> <w:mi>p</w:mi> <w:mo>≤</w:mo> <w:mn>0.000</w:mn> </w:math> ) and sensitivity ( <y:math xmlns:y="http://www.w3.org/1998/Math/MathML" id="M13"> <y:mi>p</y:mi> <y:mo>=</y:mo> <y:mn>0.006</y:mn> </y:math> and <ab:math xmlns:ab="http://www.w3.org/1998/Math/MathML" id="M14"> <ab:mi>p</ab:mi> <ab:mo>≤</ab:mo> <ab:mn>0.000</ab:mn> </ab:math> ) as a whole were significantly improved in the second and third rounds. Conclusions. This “Doctor + AI” model can clarify the role of doctors and AI in medical responsibility and ensure the safety of patients, and importantly, this model shows great potential and application prospects.