Spatial audio in 360° videos

Amit Hirway, Yuansong Qiao, Niall Murray

202218 citationsDOI

Abstract

Immersive technologies are rapidly gaining traction across a variety of application domains. 360° video is one such technology, which can be captured with an omnidirectional multi-camera arrangement. With a Virtual Reality (VR) Head Mounted Display (HMD), users have the freedom to look in any direction they wish within the scene. While there is a plethora of work focused on modeling visual attention (VA) in VR, little research has considered the influence of the audio modality on VA in VR. It is well known that audio has an important role in VR experiences. Listeners can experience sound in all directions with high quality spatial audio. One such technique, Ambisonics or 3D audio, provides a full 360° sound soundscape.

Topics & Concepts

AmbisonicsComputer scienceVirtual realitySoundscapeModality (human–computer interaction)Human–computer interactionOmnidirectional antennaMultimediaComputer graphics (images)Sound (geography)AcousticsLoudspeakerPhysicsTelecommunicationsAntenna (radio)Virtual Reality Applications and ImpactsMultisensory perception and integrationTactile and Sensory Interactions