Litcius/Paper detail

A gaze-based interactive system to explore artwork imagery

Piercarlo Dondi, Marco Porta, Angelo Donvito, Giovanni Volpe

2021Journal on Multimodal User Interfaces25 citationsDOIOpen Access PDF

Abstract

Abstract Interactive and immersive technologies can significantly enhance the fruition of museums and exhibits. Several studies have proved that multimedia installations can attract visitors, presenting cultural and scientific information in an appealing way. In this article, we present our workflow for achieving a gaze-based interaction with artwork imagery. We designed both a tool for creating interactive “gaze-aware” images and an eye tracking application conceived to interact with those images with the gaze. Users can display different pictures, perform pan and zoom operations, and search for regions of interest with associated multimedia content (text, image, audio, or video). Besides being an assistive technology for motor impaired people (like most gaze-based interaction applications), our solution can also be a valid alternative to the common touch screen panels present in museums, in accordance with the new safety guidelines imposed by the COVID-19 pandemic. Experiments carried out with a panel of volunteer testers have shown that the tool is usable, effective, and easy to learn.

Topics & Concepts

Computer scienceGazeUSableZoomWorkflowMultimediaHuman–computer interactionPalette (painting)Eye trackingArtificial intelligencePetroleum engineeringDatabaseEngineeringOperating systemLens (geology)Tactile and Sensory InteractionsGaze Tracking and Assistive TechnologyVisual Attention and Saliency Detection
A gaze-based interactive system to explore artwork imagery | Litcius