Litcius/Paper detail

Generating Chinese Classical Poems with Statistical Machine Translation Models

Jing He, Ming Zhou, Long Jiang

2021Proceedings of the AAAI Conference on Artificial Intelligence132 citationsDOIOpen Access PDF

Abstract

This paper describes a statistical approach to generation of Chinese classical poetry and proposes a novel method to automatically evaluate poems. The system accepts a set of keywords representing the writing intents from a writer and generates sentences one by one to form a completed poem. A statistical machine translation (SMT) system is applied to generate new sentences, given the sentences generated previously. For each line of sentence a specific model specially trained for that line is used, as opposed to using a single model for all sentences. To enhance the coherence of sentences on every line, a coherence model using mutual information is applied to select candidates with better consistency with previous sentences. In addition, we demonstrate the effectiveness of the BLEU metric for evaluation with a novel method of generating diverse references.

Topics & Concepts

Computer scienceNatural language processingCoherence (philosophical gambling strategy)Artificial intelligenceMachine translationConsistency (knowledge bases)SentenceSet (abstract data type)Example-based machine translationLine (geometry)PoetryMetric (unit)BLEUEvaluation of machine translationTranslation (biology)Speech recognitionMachine translation software usabilityLinguisticsMathematicsProgramming languageStatisticsChemistryMessenger RNAGeneBiochemistryGeometryEconomicsPhilosophyOperations managementNatural Language Processing TechniquesTopic ModelingAdvanced Text Analysis Techniques