Latency compensated visual-inertial odometry for agile autonomous flight

Kyuman Lee, Eric N. Johnson

Research output: Contribution to journalArticlepeer-review

3 Scopus citations

Abstract

In visual-inertial odometry (VIO), inertial measurement unit (IMU) dead reckoning acts as the dynamic model for flight vehicles while camera vision extracts information about the surrounding environment and determines features or points of interest. With these sensors, the most widely used algorithm for estimating vehicle and feature states for VIO is an extended Kalman filter (EKF). The design of the standard EKF does not inherently allow for time offsets between the timestamps of the IMU and vision data. In fact, sensor-related delays that arise in various realistic conditions are at least partially unknown parameters. A lack of compensation for unknown parameters often leads to a serious impact on the accuracy of VIO systems and systems like them. To compensate for the uncertainties of the unknown time delays, this study incorporates parameter estimation into feature initialization and state estimation. Moreover, computing cross-covariance and estimating delays in online temporal calibration correct residual, Jacobian, and covariance. Results from flight dataset testing validate the improved accuracy of VIO employing latency compensated filtering frameworks. The insights and methods proposed here are ultimately useful in any estimation problem (e.g., multi-sensor fusion scenarios) where compensation for partially unknown time delays can enhance performance.

Original languageEnglish
Article number2209
JournalSensors
Volume20
Issue number8
DOIs
StatePublished - 2 Apr 2020

Keywords

  • Camera vision
  • EKF
  • IMU
  • Latency compensation
  • Navigation
  • Online temporal calibration
  • Sensor fusion
  • Time delay
  • UAV
  • VIO

Fingerprint

Dive into the research topics of 'Latency compensated visual-inertial odometry for agile autonomous flight'. Together they form a unique fingerprint.

Cite this