KLPT – Kurdish Language Processing Toolkit
Sina Ahmadi
Abstract
Despite the recent advances in applying language-independent approaches to various natural language processing tasks thanks to artificial intelligence, some language-specific tools are still essential to process a language in a viable manner. Kurdish language is a lessresourced language with a notable diversity in dialects and scripts and lacks basic language processing tools. To address this issue, we introduce a language processing toolkit to handle such a diversity in an efficient way. Our toolkit is composed of fundamental components such as text preprocessing, stemming, tokenization, lemmatization and transliteration and is able to get further extended by future developers. This project is publicly available 1 .
Topics & Concepts
Computer scienceLexical analysisScripting languageLemmatisationNatural language processingArtificial intelligenceProcess (computing)PreprocessorTroubleshootingProgramming languageLanguage technologyUSableNatural languageWorld Wide WebComprehension approachOperating systemNatural Language Processing TechniquesTopic ModelingText Readability and Simplification