BERT4CTR: An Efficient Framework to Combine Pre-trained Language Model with Non-textual Features for CTR Prediction
Dong Wang, Kavé Salamatian, Yunqing Xia, Weiwei Deng, Qi Zhang
Abstract
Although deep pre-trained language models have shown promising benefit in a large set of industrial scenarios, including Click-Through-Rate (CTR) prediction, how to integrate pre-trained language models that handle only textual signals into a prediction pipeline with non-textual features is challenging.
Topics & Concepts
Computer sciencePipeline (software)Artificial intelligenceLanguage modelSet (abstract data type)Natural language processingSpeech recognitionMachine learningProgramming languageRecommender Systems and TechniquesData Stream Mining TechniquesTopic Modeling