SemEval-2023 Task 1: Visual Word Sense Disambiguation
Alessandro Raganato, Iacer Calixto, Asahi Ushio, José Camacho-Collados, Mohammad Taher Pilehvar
Abstract
This paper presents the Visual Word Sense Disambiguation (Visual-WSD) task. The objective of Visual-WSD is to identify among a set of ten images the one that corresponds to the intended meaning of a given ambiguous word which is accompanied with minimal context. The task provides datasets for three different languages: English, Italian, and Farsi. We received a total of 96 different submissions. Out of these, 40 systems outperformed a strong zero-shot CLIPbased baseline (Radford et al., 2021). Participating systems proposed different zero- and few-shot approaches, often involving generative models and data augmentation. More information can be found on the task’s website: https://raganato.github.io/vwsd/.