Project Starline: A high-fidelity telepresence system
Jason Lawrence, Ryan Overbeck, Todd Prives, Tommy Fortes, N. Roth, Brett Newman
Abstract
Experience Project Starline, the first photorealistic telepresence system that demonstrably outperforms 2D videoconferencing systems, as measured by participant ratings, meeting recall, and non-verbal behaviors [Lawrence et al. 2021]. Our prototype communication endstations combine state-of-the-art face tracking, real-time neural view synthesis, spatial audio, multi-stream compression, and a high-resolution auto-stereoscopic display to produce a striking and natural sense of co-presence between two meeting participants that is not possible with traditional videoconferencing.
Topics & Concepts
Computer scienceHuman–computer interactionVideo Analysis and SummarizationInteractive and Immersive DisplaysVirtual Reality Applications and Impacts