Litcius/Paper detail

Interacting With New York City Data by HoloLens Through Remote Rendering

Zijian Long, Haiwei Dong, Abdulmotaleb El Saddik

2022IEEE Consumer Electronics Magazine13 citationsDOIOpen Access PDF

Abstract

In the digital era, extended reality (XR) is considered the next frontier. However, XR systems are computationally intensive, and they must be implemented within strict latency constraints. Thus, XR devices with finite computing resources are limited in terms of quality of experience (QoE) they can offer, particularly in the cases of big 3D data. This problem can be effectively addressed by offloading the highly intensive rendering tasks to a remote server. Therefore, we proposed a remote rendering enabled XR system that presents the 3D city model of New York City on the Microsoft HoloLens. Experimental results indicate that remote rendering outperforms local rendering for the New York City model with significant improvement in average QoE by at least 21%. In addition, we clarified the network traffic pattern in the proposed XR system developed under the OpenXR standard.

Topics & Concepts

Rendering (computer graphics)Computer science3D renderingTiled renderingQuality of experienceComputer graphics (images)Real-time renderingAugmented realitySoftware renderingReal-time computingComputer networkHuman–computer interactionComputer graphicsQuality of service3D computer graphicsVirtual Reality Applications and ImpactsAugmented Reality ApplicationsImage and Video Quality Assessment