PathologyBERT - Pre-trained Vs. A New Transformer Language Model for Pathology Domain.
Thiago das Virgens Santos, Amara Tariq, Susmita Das, Kavyasree Vayalpati, Geoffrey Smith, Hari Trivedi, Imon Banerjee
Abstract
. Our comprehensive experiments demonstrate that pre-training of transformer model on pathology corpora yields performance improvements on Natural Language Understanding (NLU) and Breast Cancer Diagnose Classification when compared to nonspecific language models.
Topics & Concepts
Computer scienceTerminologySNOMED CTNatural language processingArtificial intelligenceTransformerLanguage modelRisk stratificationPathologyMedicineLinguisticsQuantum mechanicsPhilosophyPhysicsCardiologyVoltageBiomedical Text Mining and OntologiesAI in cancer detectionMachine Learning in Healthcare