Litcius/Paper detail

CPT: a pre-trained unbalanced transformer for both Chinese language understanding and generation

Yunfan Shao, Zhichao Geng, Yitao Liu, Junqi Dai, Hang Yan, Fei Yang, Zhe Li, Hujun Bao, Xipeng Qiu

2024Science China Information Sciences109 citationsDOIOpen Access PDF

Topics & Concepts

Computer scienceTransformerNatural language understandingInferenceEncoderArtificial intelligenceLanguage modelDecoding methodsExploitNatural languageNatural language processingAlgorithmEngineeringComputer securityElectrical engineeringOperating systemVoltageTopic ModelingNatural Language Processing TechniquesMultimodal Machine Learning Applications