Litcius/Paper detail

Sentiment Analysis in Code-Mixed Telugu-English Text with Unsupervised Data Normalization

Kusampudi Siva Subrahamanyam Varma, Preetham Sathineni, Radhika Mamidi

202119 citationsDOIOpen Access PDF

Abstract

In a multilingual society, people communicate in more than one language, leading to Code-Mixed data. Sentimental analysis on Code-Mixed Telugu-English Text (CMTET) poses unique challenges. The unstructured nature of the Code-Mixed Data is due to the informal language, informal transliterations, and spelling errors. In this paper, we introduce an annotated dataset for Sentiment Analysis in CMTET. Also, we report an accuracy of 80.22% on this dataset using novel unsupervised data normalization with a Multilayer Perceptron (MLP) model. This proposed data normalization technique can be extended to any NLP task involving CMTET. Further, we report an increase of 2.53% accuracy due to this data normalization approach in our best model.

Topics & Concepts

Computer scienceTeluguNormalization (sociology)Artificial intelligenceNatural language processingSpellingSentiment analysisCode (set theory)Unstructured dataData miningBig dataLinguisticsProgramming languageAnthropologySociologyPhilosophySet (abstract data type)Natural Language Processing TechniquesTopic ModelingSentiment Analysis and Opinion Mining
Sentiment Analysis in Code-Mixed Telugu-English Text with Unsupervised Data Normalization | Litcius