LexExp: a system for automatically expanding concept lexicons for noisy biomedical texts
Abeed Sarker
Abstract
SUMMARY: LexExp is an open-source, data-centric lexicon expansion system that generates spelling variants of lexical expressions in a lexicon using a phrase embedding model, lexical similarity-based natural language processing methods and a set of tunable threshold decay functions. The system is customizable, can be optimized for recall or precision and can generate variants for multi-word expressions. AVAILABILITY AND IMPLEMENTATION: Code available at: https://bitbucket.org/asarker/lexexp; data and resources available at: https://sarkerlab.org/lexexp. SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online.
Topics & Concepts
Computer scienceLexiconNatural language processingPhraseWord embeddingArtificial intelligenceSpellingWord (group theory)Set (abstract data type)Source codeEmbeddingCode (set theory)Precision and recallInformation retrievalProgramming languageLinguisticsPhilosophyBiomedical Text Mining and OntologiesTopic ModelingNatural Language Processing Techniques