Fine-tuning pretrained transformer encoders for sequence-to-sequence learning
Hangbo Bao, Dong Li, Wenhui Wang, Nan Yang, Songhao Piao, Furu Wei
Topics & Concepts
TransformerComputer scienceInitializationAutomatic summarizationEncoderLanguage modelGenerative grammarArtificial intelligenceSequence (biology)Fine-tuningSpeech recognitionVoltageProgramming languageEngineeringElectrical engineeringGeneticsPhysicsBiologyOperating systemQuantum mechanicsTopic ModelingNatural Language Processing TechniquesMultimodal Machine Learning Applications