Unsupervised Summarization Approach With Computational Statistics of Microblog Data
Abhishek Bhattacharya, Arijit Ghosal, Ahmed J. Obaid, Salah-ddine Krit, Vinod Kumar Shukla, Krishnasis Mandal, Sabyasachi Pramanik
Abstract
Microblogging, where millions of users exchange messages to share their opinions on different trending and non-trending topics, is one of the popular communication media in recent times. Several researchers are concentrating on these data due to a huge source of information exchanges in online social media. In platforms such as Twitter, dataset-generated lacks coherence, and manually extracting meaning or knowledge from them proves to be painstakingly difficult. It opens up the challenges to the researchers for knowledge extraction driven by a summarization approach. Therefore, automated summary generation tools are recommended to get a meaningful summary out of a given topic becomes crucial in the age of big data. In this work, an unsupervised, extractive summarization model has been proposed. For categorization of data, k-means algorithm has been used, and based on scoring of each document in the corpus, summarization model is designed. The proposed methodology achieves an improved outcome over existing methods, such as lexical rank, sum basic, LSA, etc. evaluated by rouge tool.