PAIR: Planning and Iterative Refinement in Pre-trained Transformers for Long Text Generation
Xinyu Hua, Lu Wang
Abstract
Pre-trained Transformers have enabled impressive breakthroughs in generating long and fluent text, yet their outputs are often "rambling" without coherently arranged content.
Topics & Concepts
Computer scienceTransformerText generationSentenceIterative refinementArtificial intelligenceNatural language processingSequence (biology)AlgorithmVoltageBiologyQuantum mechanicsGeneticsPhysicsTopic ModelingNatural Language Processing TechniquesAdvanced Text Analysis Techniques