Zero-Shot Sentiment Analysis Exploring BART Models
Konstantinos Kyritsis, Isidoros Perikos, Michael Paraskevas
Abstract
The BART model is an advanced adaptation of transformers introduced by Facebook. It has incorporated elements from both BERT and GPT transformers, enabling significant advancements in language understanding and general speech processing. Utilizing both encoder and decoder components, BART proves versatile for various tasks, including translation, text completion, automatic sentence generation, entity recognition, sentiment analysis, and more. In this study, we focus on the study of pretrained models, BART and a modified version called distilbart, in the context of Zero-Shot Text Classification. In the experimental study we dive into the Zero-Shot technique applied to various pretrained Transformers. Our analysis demonstrates that, depending on the Model we utilize, we can achieve F1 scores of up to 88%, showcasing the model's effectiveness in discerning classes for this Sentiment Analysis problem using the Zero-Shot Text Classification technique.