Litcius/Paper detail

BlocklyVR: Exploring Block-based Programming in Virtual Reality

Martin Hedlund, Adam Jonsson, Cristian Bogdan, Gerrit Meixner, Elin Ekblom‐Bak, Andrii Matviienko

202321 citationsDOIOpen Access PDF

Abstract

As programming is typically a static activity in front of a screen, we perform an initial exploration around the capabilities of block-based programming in the immersive space using Virtual Reality (VR) to make an early charting on how programming could involve moving the programmer’s body. We created a block-based programming interface in a VR space called BlocklyVR based on the existing Blockly programming environment. To investigate programmer performance and experience in BlocklyVR, we conducted a controlled lab experiment (N = 20) with eight programming tasks that covered mathematical operations, if-statements, and function creation. Our initial exploration contributes by classifying movement types made by BlocklyVR programmers and reflecting on how these movements are related to the programming tasks. Additionally, our data suggests that participant performance in BlocklyVR was not affected compared to the 2D Blockly, even if participants were physically moving in VR space. We also found that the virtual reality sickness was marginal. Lastly, we identified four types of interaction that can potentially be employed by VR designers and developers aiming to convert a static task, like programming at a desk, into a “mobile” immersive experience.

Topics & Concepts

Computer scienceProgrammerHuman–computer interactionVirtual realityFunctional reactive programmingBlock (permutation group theory)DeskProgramming paradigmReactive programmingSpace (punctuation)Event-driven programmingTask (project management)Inductive programmingProgramming languageOperating systemEngineeringMathematicsGeometrySystems engineeringVirtual Reality Applications and ImpactsInteractive and Immersive DisplaysAugmented Reality Applications