A Hybrid RNN based Deep Learning Approach for Text Classification
Pramod Sunagar, Anita Kanavalli
Abstract
Despite the fact that text classification has grown in relevance over the last decade, there are a plethora of approaches that have been created to meet the difficulties related with text classification. To handle the complexities involved in the text classification process, the focus has shifted away from traditional machine learning methods and toward neural networks. In this work the traditional RNN model is embedded with different layers to test the accuracy of the text classification. The work involves the implementation of RNN+LSTM+GRU model. This model is compared with RCNN+LSTM and RNN+GRU. The model is trained by using the GloVe dataset. The accuracy and recall are obtained from the models is assessed. The F1 score is used to compare the performance of both models. The hybrid RNN model has three LSTM layers and two GRU layers, whereas the RCNN model contains four convolution layers and four LSTM levels, and the RNN model contains four GRU layers. The weighted average for the hybrid RNN model is found to be 0.74, RCNN+LSTM is 0.69 and RNN+GRU is 0.77. RNN+LSTM+GRU model shows moderate accuracy in the initial epochs but slowly the accuracy increases as and when the epochs are increased.