What Makes My Model Perplexed? A Linguistic Investigation on Neural Language Models Perplexity
Alessio Miaschi, Dominique Brunato⋄, Felice Dell’Orletta⋄, Giulia Venturi⋄
Abstract
Alessio Miaschi, Dominique Brunato, Felice Dell’Orletta, Giulia Venturi. Proceedings of Deep Learning Inside Out (DeeLIO): The 2nd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures. 2021.
Topics & Concepts
PerplexityComputer scienceLanguage modelLinguisticsNatural language processingArtificial intelligencePhilosophyTopic ModelingNatural Language Processing TechniquesText Readability and Simplification