Text classification based recurrent neural network
Haojin Hu, Mengfan Liao, Chao Zhang, Yanmei Jing
20202020 IEEE 5th Information Technology and Mechatronics Engineering Conference (ITOEC)23 citationsDOI
Abstract
Recurrent neural networks (RNNs) have shown outstanding performance for natural language processing tasks, influenced by the repeated multiplication of the recurrent weight matrices, the problem of gradient vanishing and explosion problem will be encountered when training RNN. Independently recurrent neural network (IndRNN) makes neurons independent and constrains recursive weights to effectively solve gradient problems. We combine IndRNN with long short-term memory (LSTM) and attention model, and test it for text classification, the results show that our models can effectively adapt to text classification task.
Topics & Concepts
Recurrent neural networkComputer scienceTask (project management)Artificial intelligenceArtificial neural networkMultiplication (music)Time delay neural networkTypes of artificial neural networksMachine learningPattern recognition (psychology)MathematicsCombinatoricsEconomicsManagementTopic ModelingNatural Language Processing TechniquesText and Document Classification Technologies