Incremental Neural Coreference Resolution in Constant Memory
Patrick Xia, João Sedoc, Benjamin Van Durme
Abstract
We investigate modeling coreference resolution under a fixed memory constraint by extending an incremental clustering algorithm to utilize contextualized encoders and neural components. Given a new sentence, our endto-end algorithm proposes and scores each mention span against explicit entity representations created from the earlier document context (if any). These spans are then used to update the entity's representations before being forgotten; we only retain a fixed set of salient entities throughout the document. In this work, we successfully convert a highperforming model
Topics & Concepts
CoreferenceComputer scienceContext (archaeology)Constant (computer programming)SentenceArtificial intelligenceSet (abstract data type)Constraint (computer-aided design)Resolution (logic)Cluster analysisNatural language processingSalientEncoderAlgorithmTheoretical computer scienceMathematicsProgramming languageGeometryOperating systemBiologyPaleontologyTopic ModelingNatural Language Processing TechniquesBiomedical Text Mining and Ontologies