Accelerating Transformer Inference for Translation via Parallel Decoding
Andrea Santilli, Silvio Severino, Emilian Postolache, Valentino Maiorca, Michele Mancusi, Riccardo Marin, Emanuele Rodolà
Abstract
Andrea Santilli, Silvio Severino, Emilian Postolache, Valentino Maiorca, Michele Mancusi, Riccardo Marin, Emanuele Rodola. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2023.
Topics & Concepts
InferenceDecoding methodsComputer scienceTransformerMachine translationSpeech recognitionNatural language processingArtificial intelligenceAlgorithmElectrical engineeringEngineeringVoltageNatural Language Processing Techniques