Litcius/Paper detail

Content4All Open Research Sign Language Translation Datasets

Necati Cihan Camgöz, Ben Saunders, Guillaume Rochette, Marco Giovanelli, Giacomo Inches, Robin Nachtrab-Ribback, Richard Bowden

20212021 16th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2021)36 citationsDOI

Abstract

Computational sign language research lacks the large-scale datasets that enables the creation of useful real-life applications. To date, most research has been limited to prototype systems on small domains of discourse, e.g. weather forecasts. To address this issue and to push the field forward, we release six datasets comprised of 190 hours of footage on the larger domain of news. From this, 20 hours of footage have been annotated by Deaf experts and interpreters and is made publicly available for research purposes. In this paper, we share the dataset collection process and tools developed to enable the alignment of sign language video and subtitles, as well as baseline translation results to underpin future research.

Topics & Concepts

Computer scienceSign languageInterpreterBaseline (sea)Machine translationField (mathematics)Domain (mathematical analysis)Process (computing)Natural language processingSign (mathematics)Open researchArtificial intelligenceData scienceWorld Wide WebLinguisticsProgramming languageMathematicsOceanographyPhilosophyPure mathematicsGeologyMathematical analysisHand Gesture Recognition SystemsHearing Impairment and CommunicationHuman Pose and Action Recognition