Memory performance as a function of modality and context: revealing the cognitive mechanisms underlying enhanced memory in virtual reality

Abstract

Abstract Although recent psychological research provides evidence for enhanced memory retrieval of Virtual Reality (VR) experiences compared to conventional laboratory experiences, the functional characteristics of the underlying mnemonic processes remain unclear. Initial studies suggest that encoding and retrieval involve distinct cognitive processes, yet the possible technological artifacts induced by VR head-mounted displays (VR-HMDs) have not been accounted for. To determine the factors influencing modality-specific memory processing, 122 participants performed an old/new recognition memory task wearing a VR-HMD. Stimuli were first either presented two-dimensionally on a screen within a VR environment (mediated VR; mVR) or experienced immediately in a three-dimensional immersive VR environment (iVR). In the subsequent old/new recognition memory task, participants had to recall the stimuli either in the same or the other modality, providing a cross-modality comparison. As a result, the canonical context effect, i.e., an advantage for memory performance in congruent contexts, was found for both mVR and iVR modalities. Most importantly, the study further provides evidence for a memory superiority effect following iVR experiences, as an equally high retrieval success was observed even when the subsequent recall was tested in mVR. In conclusion, the improved recall observed suggests that immersive environments play a crucial role in enhancing the encoding process, whereas technological artifacts, particularly contextual factors of the VR-HMD, can be ruled out. Furthermore, the transferability of information from two-dimensional to three-dimensional environments seems limited. Our study thus advocates for integrating immersive VR into learning contexts to extend the applicability of learned content to various settings.

Topics & Concepts