Sand Playground: Designing Human-AI physical Interface for Co-creation in Motion
Dina EL-Zanfaly, Yiwei Huang, Yanwen Dong
Abstract
In this paper, we investigated the potential of using a tangible interaction interface for creative activities as a preliminary step to achieve human-AI co-creation. We conducted a preliminary study to explore sand as a medium for co-creation and identify potential opportunities of AI mediating the process. We created Sand Playground, a co-creation interface that uses sand as an interaction medium. We describe details for building the interface. We selected two opportunities from the study and developed them as two modes, Artistic Mimicry and Zen Garden. We also conducted a workshop study using Sand Playground to evaluate collaboration and the characteristics of the tangible interface. We identified findings responding to drawing strategies, multisensorial experience, and performative and ephemeral quality of creation. We discuss next steps of achieving our ultimate goal: an AI-mediated interface that collaborates with users physically in real-time on sand.