Parameter-Efficient Transfer Learning with Diff Pruning
Demi Guo, Alexander M. Rush, Yoon Kim
Abstract
Demi Guo, Alexander Rush, Yoon Kim. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). 2021.
Topics & Concepts
Computer sciencePruningTransfer of learningNatural language processingArtificial intelligenceComputational linguisticsJoint (building)Transfer (computing)Deep learningSpeech recognitionLinguisticsPhilosophyEngineeringParallel computingBiologyAgronomyArchitectural engineeringTopic ModelingNatural Language Processing TechniquesDomain Adaptation and Few-Shot Learning