Syntax-BERT: Improving Pre-trained Transformers with Syntax Trees
Jiangang Bai, Yujing Wang, Yiren Chen, Yaming Yang, Jing Bai, Jing Yu, Yunhai Tong
Abstract
Jiangang Bai, Yujing Wang, Yiren Chen, Yaming Yang, Jing Bai, Jing Yu, Yunhai Tong. Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume. 2021.
Topics & Concepts
SyntaxComputer scienceNatural language processingAbstract syntax treeLinguisticsProgramming languageComputational linguisticsArtificial intelligenceChenTransformerPhilosophyEngineeringBiologyElectrical engineeringPaleontologyVoltageTopic ModelingNatural Language Processing TechniquesSoftware Engineering Research