Ubiq-Genie: Leveraging External Frameworks for Enhanced Social VR Experiences
Nels Numan, Daniele Giunchi, Benjamin Congdon, Anthony Steed
Abstract
This paper describes the Ubiq-Genie framework for integrating external frameworks with the Ubiq social VR platform. The proposed architecture is modular, allowing for easy integration of services and providing mechanisms to offload computationally intensive processes to a server. To showcase the capabilities of the framework, we present two prototype applications: 1) a voice- and gesture-controlled texture generation method based on Stable Diffusion 2.0 and 2) an embodied conversational agent based on ChatGPT. This work aims to demonstrate the potential of integrating external frameworks into social VR for the creation of new types of collaborative experiences.
Topics & Concepts
Computer scienceModular designEmbodied cognitionHuman–computer interactionGestureMultimediaArchitectureKnowledge managementArtificial intelligenceOperating systemArtVisual artsInnovative Human-Technology InteractionVirtual Reality Applications and ImpactsVideo Analysis and Summarization