Machine Learning Achieves Pathologist-Level Celiac Disease Diagnosis
Florian Jaeckle, James Denholm, Benjamin Schreiber, Shelley Evans, Mike N. Wicks, James Chan, Adrian C Bateman, Sonali Natu, Mark J. Arends, Elizabeth J. Soilleux
Abstract
Background: The diagnosis of coeliac disease (CD), an autoimmune disorder with an estimated global prevalence of around 1%, generally relies on the histological examination of duodenal biopsies. However, inter-pathologist agreement for coeliac disease diagnosis is estimated to be no more than 80%. We aim to improve coeliac disease diagnosis by developing a novel, accurate, machine-learning-based diagnostic classifier. Methods: We present a machine learning model that diagnoses the presence or absence of coeliac disease from a set of duodenal biopsies representative of real-world clinical data. Our model was trained on a diverse dataset of 3,383 -slide images (WSIs) of H&E-stained duodenal biopsies from four hospitals featuring five different WSI scanners along with their clinical diagnoses. We trained our model using the multiple-instance-learning paradigm in a weakly-supervised manner with cross-validation and evaluated it on an independent test set featuring 644 unseen scans from a different regional NHS Trust. Additionally, we compared the model's predictions to independent diagnoses from four specialist pathologists on a subset of the test data. Results: > 96%). Conclusions: Our model achieved pathologist-level performance in diagnosing the presence or absence of coeliac disease from a representative set of duodenal biopsies, representing a significant advancement towards the adoption of machine learning in clinical practice. Additionally, it demonstrated strong generalisability, performing equally well on biopsies from a previously unseen hospital. We concluded that our model has the potential to revolutionise duodenal biopsy diagnosis by accurately identifying or ruling out coeliac disease, thereby significantly reducing the time required for pathologists to make a diagnosis.