Findings of the WMT 2020 Shared Task on Parallel Corpus Filtering and Alignment
Philipp Koehn, Vishrav Chaudhary, Ahmed El-Kishky, Naman Goyal, Peng‐Jen Chen, Francisco Guzmán
Abstract
Following two preceding WMT Shared Task on Parallel Corpus Filtering (Koehn et al., 2018, 2019), we posed again the challenge of assigning sentence-level quality scores for very noisy corpora of sentence pairs crawled from the web, with the goal of sub-selecting the highest-quality data to be used to train ma-chine translation systems. This year, the task tackled the low resource condition of Pashto–English and Khmer–English and also included the challenge of sentence alignment from document pairs.
Topics & Concepts
Computer scienceSentenceTask (project management)Machine translationNatural language processingArtificial intelligenceTranslation (biology)Quality (philosophy)Resource (disambiguation)Information retrievalSpeech recognitionChemistryEconomicsPhilosophyManagementGeneBiochemistryComputer networkEpistemologyMessenger RNANatural Language Processing TechniquesTopic ModelingText Readability and Simplification