Litcius/Paper detail

Generative Data Augmentation with Contrastive Learning for Zero-Shot Stance Detection

Yang Li, Jiawei Yuan

202218 citationsDOIOpen Access PDF

Abstract

Stance detection aims to identify whether the author of an opinionated text is in favor of, against, or neutral towards a given target. Remarkable success has been achieved when sufficient labeled training data is available. However, it is labor-intensive to annotate sufficient data and train the model for every new target.Therefore, zero-shot stance detection, aiming at identifying stances of unseen targets with seen targets, has gradually attracted attention. Among them, one of the important challenges is to reduce the domain transfer between seen and unseen targets. To tackle this problem, we propose a generative data augmentation approach to generate training samples containing targets and stances for testing data, and map the real samples and generated synthetic samples into the same embedding space with contrastive learning, then perform the final classification based on the augmented data. We evaluate our proposed model on two benchmark datasets. Experimental results show that our approach achieves state-of-the-art performance on most topics in the task of zero-shot stance detection.

Topics & Concepts

Computer scienceBenchmark (surveying)Artificial intelligenceEmbeddingGenerative modelGenerative grammarTask (project management)Zero (linguistics)Training setMachine learningTransfer of learningShot (pellet)Domain (mathematical analysis)Labeled dataSynthetic dataPattern recognition (psychology)MathematicsEconomicsGeographyOrganic chemistryChemistryMathematical analysisManagementLinguisticsGeodesyPhilosophyDomain Adaptation and Few-Shot LearningMultimodal Machine Learning ApplicationsHuman Pose and Action Recognition