Deep Learning based Part-of-Speech tagging for Assamese using RNN and GRU
Kuwali Talukdar, Shikhar Kumar Sarma
Abstract
Deep Learning (DL) techniques have been widely used in different Natural Language Processing (NLP) tasks. Parts of Speech (PoS) tagging is one where a wide variety of DL techniques have been experimented with across the languages. Here in the present work, Recurrent Neural Network (RNN) and Gated Recurrent Unit (GRU) based Parts of Speech taggers have been trained and modelled for Assamese, an Indo Aryan family language. Universal Parts of Speech (UPoS) tag set of 17 tags were used for the experiment. A dataset of 30000 sequences has been used for the work, which is originally a BIS tag set tagged dataset, and customized through conversion from BIS tagged sequences to UPoS tagged sequences. RNN and GRU based systems have been configured using tensorflow platform and the performance measurement was done through accuracy, precision, recall and F1 scores. The accuracy of the RNN based system has been found to be 93.78%. Precision of 94.75 and recall of 93.28 were recorded for the RNN model. Accuracy of 94.38%, precision of 95.44 and recall of 93.7 were recorded for the GRU model. RNN and GRU models respectively yield F1 scores of 94.01 and 94.56. Although PoS tagging with other tag sets like BIS have been attempted by other researchers, UPoS tagging using DL approaches for Assamese is attempted for the first time. And this baseline work with observed accuracies of 93.78 and 94.38 for RNN and GRU respectively, shall serve as reference models for further works.