Document-Level Relation Extraction with Sentences Importance Estimation and Focusing
Xu Wang, Kehai Chen, Lili Mou, Tiejun Zhao
Abstract
aims to determine the relation between two entities from a document of multiple sentences. Recent studies typically represent the entire document by sequence-or graph-based models to predict the relations of all entity pairs. However, we find that such a model is not robust and exhibits bizarre behaviors: it predicts correctly when an entire test document is fed as input, but errs when non-evidence sentences are removed. To this end, we propose a Sentence Importance Estimation and Focusing (SIEF) framework for DocRE, where we design a sentence importance score and a sentence focusing loss, encouraging DocRE models to focus on evidence sentences. Experimental results on two domains show that our SIEF not only improves overall performance, but also makes DocRE models more robust. Moreover, SIEF is a general framework, shown to be effective when combined with a variety of base DocRE models. 1 Model Input {1,2,3} {1,2} Ground Truth GAIN Prediction MemberOf MemberOf MemberOf not MemberOf (undesired) [1] Rage Against the Machine is an American rap metal band from Los Angeles, California. [2] Formed in 1991, the group consists of vocalist Zack de la Rocha, guitarist Tom Morello, bassist Tim Commerford and drummer Brad Wilk. [3] After a self-issued demo, the band signed with Epic