Litcius/Paper detail

A Package for Learning on Tabular and Text Data with Transformers

Ken Gu, Akshay Budhkar

202144 citationsDOIOpen Access PDF

Abstract

Recent progress in natural language processing has led to Transformer architectures becoming the predominant model used for natural language tasks. However, in many realworld datasets, additional modalities are included which the Transformer does not directly leverage.

Topics & Concepts

Computer sciencePython (programming language)TransformerLexical analysisProgramming languageCategorical variableXMLArtificial intelligenceMachine learningWorld Wide WebEngineeringElectrical engineeringVoltageTopic ModelingNatural Language Processing TechniquesMultimodal Machine Learning Applications