Litcius/Paper detail

Combining haptics and inertial motion capture to enhance remote control of a dual-arm robot

Vicent Girbés-Juan, V. Schettino, Luis Gracia, J. Ernesto Solanes, Yiannis Demiris, Josep Tornero

2022Journal on Multimodal User Interfaces21 citationsDOIOpen Access PDF

Abstract

Abstract High dexterity is required in tasks in which there is contact between objects, such as surface conditioning (wiping, polishing, scuffing, sanding, etc.), specially when the location of the objects involved is unknown or highly inaccurate because they are moving, like a car body in automotive industry lines. These applications require the human adaptability and the robot accuracy. However, sharing the same workspace is not possible in most cases due to safety issues. Hence, a multi-modal teleoperation system combining haptics and an inertial motion capture system is introduced in this work. The human operator gets the sense of touch thanks to haptic feedback, whereas using the motion capture device allows more naturalistic movements. Visual feedback assistance is also introduced to enhance immersion. A Baxter dual-arm robot is used to offer more flexibility and manoeuvrability, allowing to perform two independent operations simultaneously. Several tests have been carried out to assess the proposed system. As it is shown by the experimental results, the task duration is reduced and the overall performance improves thanks to the proposed teleoperation method.

Topics & Concepts

TeleoperationComputer scienceHaptic technologyWorkspaceRobotSimulationMotion captureFlexibility (engineering)Robotic armBitTorrent trackerArtificial intelligenceInertial frame of referenceComputer visionAutomotive industryMotion (physics)Eye trackingEngineeringStatisticsPhysicsMathematicsQuantum mechanicsAerospace engineeringTeleoperation and Haptic SystemsSoft Robotics and ApplicationsVirtual Reality Applications and Impacts
Combining haptics and inertial motion capture to enhance remote control of a dual-arm robot | Litcius