Litcius/Paper detail

Dynamic Data Selection and Weighting for Iterative Back-Translation

Zi-Yi Dou, Antonios Anastasopoulos, Graham Neubig

202046 citationsDOIOpen Access PDF

Abstract

Back-translation has proven to be an effective method to utilize monolingual data in neural machine translation (NMT), and iteratively conducting back-translation can further improve the model performance. Selecting which monolingual data to back-translate is crucial, as we require that the resulting synthetic data are of high quality and reflect the target domain. To achieve these two goals, data selection and weighting strategies have been proposed, with a common practice being to select samples close to the target domain but also dissimilar to the average general-domain text. In this paper, we provide insights into this commonly used approach and generalize it to a dynamic curriculum learning strategy, which is applied to iterative back-translation models.

Topics & Concepts

Computer scienceWeightingMachine translationDomain adaptationArtificial intelligenceSentenceTranslation (biology)Domain (mathematical analysis)Machine learningSelection (genetic algorithm)Resource (disambiguation)Adaptation (eye)Iterative learning controlQuality (philosophy)Natural language processingData miningMathematicsChemistryControl (management)RadiologyMedicineGeneComputer networkClassifier (UML)PhysicsPhilosophyOpticsBiochemistryMathematical analysisEpistemologyMessenger RNANatural Language Processing TechniquesTopic ModelingText Readability and Simplification