LifeSeeker 4.0: An Interactive Lifelog Search Engine for LSC'22
Thao-Nhu Nguyen, Tu-Khiem Le, Van-Tu Ninh, Minh–Triet Tran, Binh Nguyen, Graham Healy, Sinéad Smyth, Annalina Caputo, Cathal Gurrin
Abstract
In this paper, we introduce LifeSeeker 4.0 - an interactive lifelog retrieval system developed for the fifth annual Lifelog Search Challenge (LSC'22). In LifeSeeker 4.0, we focus on enhancing our previous system to allow users who have little to no knowledge of underlying system functioning and lifelog data to use it with ease by employing a Contrastive Language-Image Pre-training (CLIP) model. Furthermore, we have exploited the music metadata to facilitate searches that may incorporate emotion. Event clustering is also improved in this version to increase user experience by reducing the occurrence of repeated images, and hence decreasing the search time.