FNet: Mixing Tokens with Fourier Transforms
James Lee-Thorp, Joshua Ainslie, Ilya Eckstein, Santiago Ontañón
2022Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies499 citationsDOIOpen Access PDF
Abstract
James Lee-Thorp, Joshua Ainslie, Ilya Eckstein, Santiago Ontanon. Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 2022.
Topics & Concepts
IlyaComputer scienceMixing (physics)Fourier transformArtificial intelligenceCognitive scienceLinguisticsPhilosophyPhysicsPsychologyQuantum mechanicsTopic ModelingNatural Language Processing TechniquesTime Series Analysis and Forecasting