Knowledge distillation for BERT unsupervised domain adaptation
Minho Ryu, Geonseok Lee, Kichun Lee
Topics & Concepts
Computer scienceDiscriminative modelArtificial intelligenceDomain adaptationDistillationMachine learningDomain (mathematical analysis)Adaptation (eye)Language modelNatural language processingTask (project management)Adversarial systemLabeled dataPattern recognition (psychology)Classifier (UML)MathematicsChemistryOpticsEconomicsMathematical analysisManagementOrganic chemistryPhysicsTopic ModelingNatural Language Processing TechniquesDomain Adaptation and Few-Shot Learning