Robust Stereo Visual Inertial Odometry for Fast Autonomous Flight
Not on the map. Why?
Abstract (arXiv)
In recent years, vision-aided inertial odometry for state estimation has matured significantly. However, we still encounter challenges in terms of improving the computational efficiency and robustness of the underlying algorithms for applications in autonomous flight with micro aerial vehicles in which it is difficult to use high quality sensors and pow- erful processors because of constraints on size and weight. In this paper, we present a filter-based stereo visual inertial odometry that uses the Multi-State Constraint Kalman Filter (MSCKF) [1]. Previous work on stereo visual inertial odometry has resulted in solutions that are computationally expensive. We demonstrate that our Stereo Multi-State Constraint Kalman Filter (S-MSCKF) is comparable to state-of-art monocular solutions in terms of computational cost, while providing signifi- cantly greater robustness. We evaluate our S-MSCKF algorithm and compare it with state-of-art methods including OKVIS, ROVIO, and VINS-MONO on both the EuRoC dataset, and our own experimental datasets demonstrating fast autonomous flight with maximum speed of 17.5m/s in indoor and outdoor environments. Our implementation of the S-MSCKF is available at https://github.com/KumarRobotics/msckf_vio.
Key facts. Cited by 27 papers in the map (data through 14 Oct 2026). First posted on arXiv 30 Nov 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 4; 2023: 4; 2024: 6; 2025: 3; 2026: 4.
27 papers.
Sort:
- 2024FAST-LIVO2: Fast, Direct LiDAR-Inertial-Visual Odometrycited by 44
- 2021Large-scale Autonomous Flight with Real-time Semantic SLAM under Dense Forest Canopycited by 12
- 2021HybVIO: Pushing the Limits of Real-time Visual-inertial Odometrycited by 8
- 2023Recent Advancements in Deep Learning Applications and Methods for Autonomous Navigation: A Comprehensive Reviewcited by 6
- 2021The GRIFFIN Perception Dataset: Bridging the Gap Between Flapping-Wing Flight and Robotic Perceptioncited by 5
- 2023SchurVINS: Schur Complement-Based Lightweight Visual Inertial Navigation Systemcited by 5
- 2021Localization and Mapping using Instance-specific Mesh Modelscited by 4
- 2025Monocular visual simultaneous localization and mapping: (r)evolution from geometry to deep learning-based pipelinescited by 4
- 2021CNN-based Ego-Motion Estimation for Fast MAV Maneuverscited by 3
- 2022Expansion of Visual Hints for Improved Generalization in Stereo Matchingcited by 3
- 2024Low Latency Visual Inertial Odometry with On-Sensor Accelerated Optical Flow for Resource-Constrained UAVscited by 3
- 2024High-Speed Stereo Visual SLAM for Low-Powered Computing Devicescited by 3
15 more
- 2023Tightly-coupled Visual-DVL-Inertial Odometry for Robot-based Ice-water Boundary Explorationcited by 2
- 2023Multi-Visual-Inertial System: Analysis, Calibration and Estimationcited by 1
- 2024PO-MSCKF: An Efficient Visual-Inertial Odometry by Reconstructing the Multi-State Constrained Kalman Filter with the Pose-only Theorycited by 1
- 2025A Plug-and-Play Learning-based IMU Bias Factor for Robust Visual-Inertial Odometrycited by 1
- 2026A Review of Vision-Based Vehicle Detection for UAV-Based Traffic Monitoring: Experimental Insights and Future Directionscited by 1
- 2021Accurate Visual-Inertial SLAM by Feature Re-identificationcited by 0
- 2022A Look at Improving Robustness in Visual-inertial SLAM by Moment Matchingcited by 0
- 2022An Improved Multi-State Constraint Kalman Filter for Visual-Inertial Odometrycited by 0
- 2022Vision-based localization methods under GPS-denied conditionscited by 0
- 2024PathFinder: Attention-Driven Dynamic Non-Line-of-Sight Tracking with a Mobile Robotcited by 0
- 2024Sky-GVIO: an enhanced GNSS/INS/Vision navigation with FCN-based sky-segmentation in urban canyoncited by 0
- 2025Efficient and Accurate Downfacing Visual Inertial Odometrycited by 0
- 2026POPL-KF: A Pose-Only Geometric Representation-Based Kalman Filter for Point-Line-Based Visual-Inertial Odometrycited by 0
- 2026Edge-Assisted Multi-Robot Visual-Inertial SLAM with Efficient Communicationcited by 0
- 2026MFVINS: Multiple Fisheye Camera-Based Visual Inertial Systemcited by 0
- 2026MFVINS: Multiple Fisheye Camera-Based Visual Inertial System8 Sep 2026
- 2026A Review of Vision-Based Vehicle Detection for UAV-Based Traffic Monitoring: Experimental Insights and Future Directions4 Aug 2026
- 2026Edge-Assisted Multi-Robot Visual-Inertial SLAM with Efficient Communication11 Mar 2026
- 2026POPL-KF: A Pose-Only Geometric Representation-Based Kalman Filter for Point-Line-Based Visual-Inertial Odometry6 Feb 2026
- 2025Efficient and Accurate Downfacing Visual Inertial Odometry12 Sep 2025
- 2025A Plug-and-Play Learning-based IMU Bias Factor for Robust Visual-Inertial Odometry16 Mar 2025
- 2025Monocular visual simultaneous localization and mapping: (r)evolution from geometry to deep learning-based pipelines4 Mar 2025
- 2024High-Speed Stereo Visual SLAM for Low-Powered Computing Devices5 Oct 2024
- 2024FAST-LIVO2: Fast, Direct LiDAR-Inertial-Visual Odometry26 Aug 2024
- 2024PO-MSCKF: An Efficient Visual-Inertial Odometry by Reconstructing the Multi-State Constrained Kalman Filter with the Pose-only Theory2 Jul 2024
- 2024Low Latency Visual Inertial Odometry with On-Sensor Accelerated Optical Flow for Resource-Constrained UAVs19 Jun 2024
- 2024Sky-GVIO: an enhanced GNSS/INS/Vision navigation with FCN-based sky-segmentation in urban canyon17 Apr 2024
15 more
- 2024PathFinder: Attention-Driven Dynamic Non-Line-of-Sight Tracking with a Mobile Robot7 Apr 2024
- 2023SchurVINS: Schur Complement-Based Lightweight Visual Inertial Navigation System4 Dec 2023
- 2023Multi-Visual-Inertial System: Analysis, Calibration and Estimation10 Aug 2023
- 2023Tightly-coupled Visual-DVL-Inertial Odometry for Robot-based Ice-water Boundary Exploration29 Mar 2023
- 2023Recent Advancements in Deep Learning Applications and Methods for Autonomous Navigation: A Comprehensive Review22 Feb 2023
- 2022Vision-based localization methods under GPS-denied conditions22 Nov 2022
- 2022Expansion of Visual Hints for Improved Generalization in Stereo Matching1 Nov 2022
- 2022An Improved Multi-State Constraint Kalman Filter for Visual-Inertial Odometry4 Oct 2022
- 2022A Look at Improving Robustness in Visual-inertial SLAM by Moment Matching27 May 2022
- 2021Large-scale Autonomous Flight with Real-time Semantic SLAM under Dense Forest Canopy14 Sep 2021
- 2021HybVIO: Pushing the Limits of Real-time Visual-inertial Odometry22 Jun 2021
- 2021Localization and Mapping using Instance-specific Mesh Models8 Mar 2021
- 2021Accurate Visual-Inertial SLAM by Feature Re-identification26 Feb 2021
- 2021The GRIFFIN Perception Dataset: Bridging the Gap Between Flapping-Wing Flight and Robotic Perception25 Jan 2021
- 2021CNN-based Ego-Motion Estimation for Fast MAV Maneuvers6 Jan 2021
- 2024FAST-LIVO2: Fast, Direct LiDAR-Inertial-Visual Odometrycited by 44
- 2021Large-scale Autonomous Flight with Real-time Semantic SLAM under Dense Forest Canopycited by 12
- 2021HybVIO: Pushing the Limits of Real-time Visual-inertial Odometrycited by 8
- 2023Recent Advancements in Deep Learning Applications and Methods for Autonomous Navigation: A Comprehensive Reviewcited by 6
- 2021The GRIFFIN Perception Dataset: Bridging the Gap Between Flapping-Wing Flight and Robotic Perceptioncited by 5
- 2023SchurVINS: Schur Complement-Based Lightweight Visual Inertial Navigation Systemcited by 5
- 2021Localization and Mapping using Instance-specific Mesh Modelscited by 4
- 2025Monocular visual simultaneous localization and mapping: (r)evolution from geometry to deep learning-based pipelinescited by 4
- 2021CNN-based Ego-Motion Estimation for Fast MAV Maneuverscited by 3
- 2022Expansion of Visual Hints for Improved Generalization in Stereo Matchingcited by 3
- 2024Low Latency Visual Inertial Odometry with On-Sensor Accelerated Optical Flow for Resource-Constrained UAVscited by 3
- 2024High-Speed Stereo Visual SLAM for Low-Powered Computing Devicescited by 3
12 most cited of 27 All 27 (JSON)
- 2026MFVINS: Multiple Fisheye Camera-Based Visual Inertial System8 Sep 2026
- 2026A Review of Vision-Based Vehicle Detection for UAV-Based Traffic Monitoring: Experimental Insights and Future Directions4 Aug 2026
- 2026Edge-Assisted Multi-Robot Visual-Inertial SLAM with Efficient Communication11 Mar 2026
- 2026POPL-KF: A Pose-Only Geometric Representation-Based Kalman Filter for Point-Line-Based Visual-Inertial Odometry6 Feb 2026
- 2025Efficient and Accurate Downfacing Visual Inertial Odometry12 Sep 2025
- 2025A Plug-and-Play Learning-based IMU Bias Factor for Robust Visual-Inertial Odometry16 Mar 2025
- 2025Monocular visual simultaneous localization and mapping: (r)evolution from geometry to deep learning-based pipelines4 Mar 2025
- 2024High-Speed Stereo Visual SLAM for Low-Powered Computing Devices5 Oct 2024
- 2024FAST-LIVO2: Fast, Direct LiDAR-Inertial-Visual Odometry26 Aug 2024
- 2024PO-MSCKF: An Efficient Visual-Inertial Odometry by Reconstructing the Multi-State Constrained Kalman Filter with the Pose-only Theory2 Jul 2024
- 2024Low Latency Visual Inertial Odometry with On-Sensor Accelerated Optical Flow for Resource-Constrained UAVs19 Jun 2024
- 2024Sky-GVIO: an enhanced GNSS/INS/Vision navigation with FCN-based sky-segmentation in urban canyon17 Apr 2024
12 newest of 27 All 27 (JSON)