ELEVANT: A Fully Automatic Fine-Grained Entity Linking Evaluation and Analysis Tool
Hannah Bast, Matthias Hertel, Natalie Prange
Abstract
We present Elevant, a tool for the fully automatic fine-grained evaluation of a set of entity linkers on a set of benchmarks. Elevant provides an automatic breakdown of the performance by various error categories and by entity type. Elevant also provides a rich and compact, yet very intuitive and self-explanatory visualization of the results of a linker on a benchmark in comparison to the ground truth. A live demo, the link to the complete code base on GitHub and a link to a demo video are provided under https://elevant.cs.uni-freiburg.de .
Topics & Concepts
Computer scienceBenchmark (surveying)VisualizationSet (abstract data type)Ground truthBase (topology)Code (set theory)Knowledge baseSource codeInformation retrievalProgramming languageData miningArtificial intelligenceGeographyGeodesyMathematicsMathematical analysisTopic ModelingMachine Learning in HealthcareAnomaly Detection Techniques and Applications