Interaction Design for Augmented, Virtual, and Extended Reality Environments
Kay M. Stanney, Claire Hughes, Hannah Nye, Ed Cross, CJ Boger, Stephen Deming
Abstract
Interaction design is focused on creating a means of communication between the user and interactive system, that supports an intuitive, efficient, effective, and satisfying experience. eXtended Reality (XR) technologies, which encompass any combination of immersive experiences that merge the physical and virtual worlds, have evolved over the past decade, and with this advancement have come fundamental shifts in user interaction. This chapter posits that this evolution of interaction design can be guided through the use of user-centered design (UCD), and that the design of interactions in three-dimensional (3D) space encompasses a multitude of considerations beyond those associated with design in two-dimensional space. The phases of the UCD process are then reviewed, focusing on how they can evolve to address the broader scope of design in 3D space. This chapter then takes a deeper dive into the XR interaction design process, describing how inspiration can be derived through video games and other means, reviewing storyboarding techniques, and comparing prototyping tools. This chapter concludes by demonstrating how this process can be applied to XR solutions through an example use case in the military health education domain.