From Zero to Hero: On the Limitations of Zero-Shot Language Transfer with Multilingual Transformers
Anne Lauscher, Vinit Ravishankar, Ivan Vulić, Goran Glavaš
Abstract
bak probing, til beskrivelser av transformerarkitekturen og debatten rundt tolkbarhet av oppmerksomhet. I hvert introduksjonskapittel prver vi derfor kontekstualisere vrt eget arbeid.
Topics & Concepts
Computer scienceTransformerNatural language processingArtificial intelligenceZero (linguistics)Transfer (computing)LimitingTransfer of learningParsingLanguage modelDependency grammarLinguisticsVoltagePhilosophyMechanical engineeringPhysicsEngineeringQuantum mechanicsParallel computingNatural Language Processing TechniquesTopic ModelingMultimodal Machine Learning Applications