Deep neural networks and weighted word embeddings for sentiment analysis of drug product reviews
Derwin Suhartono, Kartika Purwandari, Nicholaus Hendrik Jeremy, Samuel Philip, Panji Arisaputra, Ivan Halim Parmonangan
Abstract
One of the major tasks of natural language processing is sentiment analysis. The web is a source of unstructured and rich informa-tion with thousands of opinions and reviews. Individuals, businesses, and governments can all benefit from recognizing sentiment. As part of this study, we propose a deep learning-based approach for sentiment analysis on drug product review data obtained from the UCI machine learning repository. As an alternative to deep learning models, this architecture integrates glove word embedding with convolutional neural networks (CNN). Word2vec and GloVe word embedding schemes have been evaluated empirically for their predictive performance in CNN architectures. Based on a comparison of the deep learning architecture with RoBERTa, itcan be seen that BERT architecture outperforms both of them in training and validation. However, CNN models using Glove word embedding provided superior results in testing.