Regularizing transformers with deep probabilistic layers
Aurora Cobo Aguilera, Pablo M. Olmos, Antonio Artés-Rodrı́guez, Fernando Pérez‐Cruz
Topics & Concepts
TransformerComputer scienceAutoencoderProbabilistic logicRegularization (linguistics)Language modelGenerative grammarGaussianArtificial intelligenceImputation (statistics)Generative modelMixture modelArtificial neural networkPattern recognition (psychology)Missing dataMachine learningAlgorithmPhysicsVoltageQuantum mechanicsTopic ModelingNatural Language Processing TechniquesSpeech Recognition and Synthesis