Pre-training language model incorporating domain-specific heterogeneous knowledge into a unified representation
Hongyin Zhu, Hao Peng, Zhiheng Lyu, Lei Hou, Juanzi Li, Jinghui Xiao
Topics & Concepts
Computer scienceNatural language processingDomain (mathematical analysis)Artificial intelligenceDomain knowledgeLanguage modelPlain textConstruct (python library)Word (group theory)Matching (statistics)Representation (politics)Information retrievalLinguisticsProgramming languageMathematicsPolitical sciencePoliticsMathematical analysisOperating systemStatisticsPhilosophyEncryptionLawTopic ModelingNatural Language Processing TechniquesMultimodal Machine Learning Applications