An Empirical Study of Tokenization Strategies for Various Korean NLP Tasks
Kyubyong Park, Joohong Lee, Seongbo Jang, Dawoon Jung
Abstract
Kyubyong Park, Joohong Lee, Seongbo Jang, Dawoon Jung. Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing. 2020.
Topics & Concepts
Lexical analysisComputer scienceSecurity tokenNatural language processingArtificial intelligenceByteMachine translationProgramming languageComputer securityNatural Language Processing TechniquesTopic ModelingAdvanced Text Analysis Techniques