Offsite Evaluation of Localization Systems: Criteria, Systems, and Results From IPIN 2021 and 2022 Competitions
Francesco Potortì, Antonino Crivello, Soyeon Lee, Blagovest Vladimirov, Sangjoon Park, Yushi Chen, Long Wang, Runze Chen, Fang Zhao, Yue Zhuge, Haiyong Luo, Antoni Pérez-Navarro, Antonio R. Jiménez, Han Wang, Hengyi Liang, Cedric De Cock, David Plets, Cui Yan, Zhi Xiong, Xiaodong Li, Yiming Ding, Fernando J. Álvarez, Fernando J. Aranda, Felipe Parralejo, Adriano Moreira, Cristiano Pendão, Ivo Silva, Miguel Ortiz, Ni Zhu, Ziyou Li, Valérie Renaudin, Dongyan Wei, Xinchun Ji, Wenchao Zhang, Yan Wang, Longyang Ding, Jian Kuang, Xiaobing Zhang, Zhi Dou, Chaoqun Yang, Sebastian Kram, Maximilian Stahlke, Christopher Mutschler, Sander Coene, Chenglong Li, Alexander Venus, Erik Leitinger, Stefan Tertinek, Klaus Witrisal, Yi Wang, Shaobo Wang, Beihong Jin, Fusang Zhang, Su Chang, Zhi Wang, Siheng Li, Xiaodong Li, Shitao Li, Mengguan Pan, Zheng Wang, Kai Luo, Ziyao Ma, Yanbiao Gao, Jiaxing Chang, H. Ren, Wenfang Guo, Joaquín Torres-Sospedra
Abstract
Indoor positioning is a thriving research area which is slowly gaining market momentum. Its applications are mostly customised, ad hoc installations; ubiquitous applications analogous to GNSS for outdoors are not available because of the lack of generic platforms, widely accepted standards and interoperability protocols. In this context, the Indoor Positioning and Indoor Navigation (IPIN) competition is the only long-term, technically sound initiative to monitor the state of the art of real systems by measuring their performance in a realistic environment. Most competing systems are pedestrian-oriented and based on the use of smartphones, but several competing Tracks were set up, enabling comparison of an array of technologies. The two IPIN competitions described here include only off-site Tracks. In contrast with on-site Tracks where competitors bring their systems on site - which were impossible to organise during 2021 and 2022 - in off-site Tracks competitors download pre-recorded data from multiple sensors and process them using the EvaalAPI, a real-time, web-based emulation interface. As usual with IPIN competitions, Tracks were compliant with the EvAAL framework, ensuring consistency of the measurement procedure and reliability of results. The main contribution of this work is to show a compilation of possible indoor positioning scenarios and different indoor positioning solutions to the same problem.