Litcius/Paper detail

VID-Fusion: Robust Visual-Inertial-Dynamics Odometry for Accurate External Force Estimation

Ziming Ding, Tiankai Yang, Kunyi Zhang, Chao Xu, Fei Gao

202131 citationsDOI

Abstract

Recently, quadrotors are gaining significant attention in aerial transportation and delivery. In these scenarios, an accurate estimation of the external force is as essential as the six degree-of-freedom (DoF) pose since it is of vital importance for planning and control of the vehicle. To this end, we propose a tightly-coupled Visual-Inertial-Dynamics (VID) system that simultaneously estimates the external force applied to the quadrotor along with the six DoF pose. Our method builds on the state-of-the-art optimization-based Visual-Inertial system [1], with a novel deduction of the dynamics and external force factor extended from VIMO [2]. Utilizing the proposed dynamics and external force factor, our estimator robustly and accurately estimates the external force even when it varies widely. Moreover, since we explicitly consider the influence of the external force, when compared with VIMO [2] and VINS-Mono [1], our method shows comparable and superior pose accuracy, even when the external force ranges from neglectable to significant. The robustness and effectiveness of the proposed method are validated by extensive real-world experiments and application scenario simulation. We will release an open-source package of this method along with datasets with ground truth force measurements for the reference of the community.

Topics & Concepts

Robustness (evolution)Computer scienceInertial frame of referenceComputer visionPoseArtificial intelligenceFictitious forceControl theory (sociology)Dynamics (music)EstimatorMathematicsControl (management)PhysicsAcousticsQuantum mechanicsChemistryStatisticsBiochemistryGeneRobotics and Sensor-Based LocalizationAdvanced Vision and Imaging3D Surveying and Cultural Heritage
VID-Fusion: Robust Visual-Inertial-Dynamics Odometry for Accurate External Force Estimation | Litcius