What Context Features Can Transformer Language Models Use?
Joe O’Connor, Jacob Andreas
Abstract
Joe O’Connor, Jacob Andreas. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). 2021.
Topics & Concepts
Computer scienceTransformerComputational linguisticsNatural language processingContext (archaeology)LinguisticsArtificial intelligenceHistoryEngineeringElectrical engineeringPhilosophyArchaeologyVoltageTopic ModelingNatural Language Processing TechniquesMultimodal Machine Learning Applications