Litcius/Paper detail

Figaro: A Tabletop Authoring Environment for Human-Robot Interaction

David Porfirio, Laura Stegner, Maya Çakmak, Allison Sauppé, Aws Albarghouthi, Bilge Mutlu

202111 citationsDOI

Abstract

Human-robot interaction designers and developers navigate a complex design space, which creates a need for tools that support intuitive design processes and harness the programming capacity of state-of-the-art authoring environments. We introduce Figaro, an expressive tabletop authoring environment for mobile robots, inspired by shadow puppetry, that provides designers with a natural, situated representation of human-robot interactions while exploiting the intuitiveness of tabletop and tangible programming interfaces. On the tabletop, Figaro projects a representation of an environment. Users demonstrate sequences of behaviors, or scenes, of an interaction by manipulating instrumented figurines that represent the robot and the human. During a scene, Figaro records the movement of figurines on the tabletop and narrations uttered by users. Subsequently, Figaro employs real-time program synthesis to assemble a complete robot program from all scenes provided. Through a user study, we demonstrate the ability of Figaro to support design exploration and development for human-robot interaction.

Topics & Concepts

Computer scienceHuman–computer interactionRobotSituatedRepresentation (politics)Shadow (psychology)Space (punctuation)Human–robot interactionMultimediaArtificial intelligenceOperating systemPsychologyPolitical sciencePsychotherapistLawPoliticsRobot Manipulation and LearningTeaching and Learning ProgrammingReinforcement Learning in Robotics