EyeScreen

Abstract

PurposeEarly diagnosis and treatment of retinoblastoma are of paramount importance for a positive clinical outcome. The most common sign of retinoblastoma is leukocoria, or white pupil. Effective, easy-to-perform, community-based screening is needed to improve outcomes in lower-income regions. The EyeScreen (developed by Joshua Meyer from the University of Michigan) Android (Google LLC) smartphone application is an important step toward addressing this need. The purpose of this study was to examine the potential of the novel use of low-cost technologies—a cell phone application and machine learning—to identify leukocoria.DesignA cell phone application was developed and refined with the feedback from on-site, single-population use in Ethiopia. Application performance was evaluated in this technology validation study.ParticipantsOne thousand four hundred fifty-seven participants were recruited from ophthalmology and pediatric clinics in Addis Ababa, Ethiopia.MethodsPhotographs obtained with inexpensive Android smartphones running the EyeScreen Application were used to train an ImageNet (ResNet) machine learning model and to measure the performance of the app. Eighty percent of the images were used in training the model, and 20% were reserved for testing.Main Outcome MeasuresPerformance of the model was measured in terms of sensitivity, specificity, receiver operating characteristic (ROC) curve, and precision-recall curve.ResultsAnalyses of the participant images resulted in the following at the participant level: sensitivity, 87%; specificity, 73%; area under the ROC curve, 0.93; and area under the precision-recall curve, 0.77.ConclusionsEyeScreen has the potential to serve as an effective screening tool in the areas of the world most affected by delayed retinoblastoma diagnosis. The relatively high initial performance of the machine learning model with small training datasets in this early-phase study can serve as a proof of concept for future use of machine learning and artificial intelligence in ophthalmic applications. Early diagnosis and treatment of retinoblastoma are of paramount importance for a positive clinical outcome. The most common sign of retinoblastoma is leukocoria, or white pupil. Effective, easy-to-perform, community-based screening is needed to improve outcomes in lower-income regions. The EyeScreen (developed by Joshua Meyer from the University of Michigan) Android (Google LLC) smartphone application is an important step toward addressing this need. The purpose of this study was to examine the potential of the novel use of low-cost technologies—a cell phone application and machine learning—to identify leukocoria. A cell phone application was developed and refined with the feedback from on-site, single-population use in Ethiopia. Application performance was evaluated in this technology validation study. One thousand four hundred fifty-seven participants were recruited from ophthalmology and pediatric clinics in Addis Ababa, Ethiopia. Photographs obtained with inexpensive Android smartphones running the EyeScreen Application were used to train an ImageNet (ResNet) machine learning model and to measure the performance of the app. Eighty percent of the images were used in training the model, and 20% were reserved for testing. Performance of the model was measured in terms of sensitivity, specificity, receiver operating characteristic (ROC) curve, and precision-recall curve. Analyses of the participant images resulted in the following at the participant level: sensitivity, 87%; specificity, 73%; area under the ROC curve, 0.93; and area under the precision-recall curve, 0.77. EyeScreen has the potential to serve as an effective screening tool in the areas of the world most affected by delayed retinoblastoma diagnosis. The relatively high initial performance of the machine learning model with small training datasets in this early-phase study can serve as a proof of concept for future use of machine learning and artificial intelligence in ophthalmic applications.

Topics & Concepts