Common Sense or World Knowledge? Investigating Adapter-Based Knowledge Injection into Pretrained Transformers
Anne Lauscher, Olga Majewska, Leonardo F. R. Ribeiro, Iryna Gurevych, Nikolai Rozanov, Goran Glavaš
Abstract
Anne Lauscher, Olga Majewska, Leonardo F. R. Ribeiro, Iryna Gurevych, Nikolai Rozanov, Goran Glavaš. Proceedings of Deep Learning Inside Out (DeeLIO): The First Workshop on Knowledge Extraction and Integration for Deep Learning Architectures. 2020.
Topics & Concepts
Computer scienceTransformerInferenceAdapter (computing)ForgettingLanguage modelArtificial intelligenceNatural language processingMachine learningEngineeringCognitive psychologyPsychologyOperating systemElectrical engineeringVoltageTopic ModelingNatural Language Processing TechniquesExplainable Artificial Intelligence (XAI)