Litcius/Paper detail

Comparison of Three Feedback Modalities for Haptics Sensation in Remote Machine Manipulation

Masaki Haruna, Kawaguchi Noboru, Masaki Ogino, Toshiaki Koike–Akino

2021IEEE Robotics and Automation Letters25 citationsDOIOpen Access PDF

Abstract

Previous studies have verified the usefulness of visual haptics for achieving the appropriate grasping force and task success rate to operate remote machines. However, its capabilities have not been evaluated objectively and quantitatively. We comprehensively compare three feedback modalities (i.e., sound, vibration, and light) for providing pseudo-haptic information on contact with an object, which we apply to grasping an object with a remotely operated robot arm. Experimental results verify that the light modality (i.e., visual haptics) minimizes the grasping force and processing load in the operator's brain. We then develop a prototype of a remote machine to demonstrate the feasibility of visual haptic feedback. We consider three implementations (i.e., a light-emitting diode, model-based superimposition, and model-less superimposition) to verify the performance. The results show that visual haptics can stabilize the performance of delicate tasks such as grasping and carrying fragile raw eggs and potato chips. We demonstrate that our visual haptics method (i.e., superimposing haptic information as images on the contact points of the robot's fingertips) can significantly improve the operability of remote machines without the need for highly complex and expensive interfaces.

Topics & Concepts

Haptic technologyComputer scienceOperabilityComputer visionSuperimpositionObject (grammar)Modality (human–computer interaction)Virtual machineArtificial intelligenceRobotVisualizationStereotaxyModalitiesSimulationHuman–computer interactionSociologyOperating systemSoftware engineeringSocial scienceTeleoperation and Haptic SystemsTactile and Sensory InteractionsGaze Tracking and Assistive Technology