STAG-VIO: Stabilized Prompt-to-Geometry Interface for Robust Dynamic Visual--Inertial Odometry
Not on the map. Why?
Abstract (arXiv)
Dynamic visual-inertial odometry (VIO) requires reliable suppression of motion-corrupted measurements, yet prior semantic-assisted approaches depend on category-limited segmenters and degrade under partial occlusion. Promptable foundation segmentation models offer category-agnostic dynamic parsing, but their effectiveness in VIO depends critically on the temporal stability of input prompts---a factor largely overlooked in existing pipelines. When prompts derived from raw detection are jittery or intermittent under occlusion, the resulting masks flicker across frames, destabilizing geometric estimation. We propose STAG-VIO, which formulates dynamic robustness as a perception-to-geometry interface stabilization problem. We introduce uncertainty-adaptive multi-object tracking that models prompt generation as state estimation with bounded noise adaptation, producing temporally coherent box prompts. These stabilized prompts drive a lightweight foundation segmenter whose masks undergo geometry-oriented morphological refinement to establish conservative safety margins. A constraint-budget-aware feature redistribution strategy preserves well-conditioned static measurements when dynamic regions dominate the view. Experiments on VIODE and OpenLORIS-Scene show consistent gains over state-of-the-art baselines. Ablation confirms that prompt stabilization is the single most impactful component, reducing trajectory error by up to 83%.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 33 references that are in the map. First posted on arXiv 28 Nov 2024.
Builds on
24 of 33 references.
References · 24
- 2023Segment Anythingcited by 8,234
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,487
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 878
- 2023DETRs Beat YOLOs on Real-time Object Detectioncited by 533
- 2024YOLOv11: An Overview of the Key Architectural Enhancementscited by 425
- 2017VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimatorcited by 423
- 2023Faster Segment Anything: Towards Lightweight SAM for Mobile Applicationscited by 352
- 2021FAST-LIO2: Fast Direct LiDAR-inertial Odometrycited by 183
- 2018DynaSLAM: Tracking, Mapping and Inpainting in Dynamic Scenescited by 134
- 2018DS-SLAM: A Semantic Visual SLAM towards Dynamic Environmentscited by 91
12 more
- 2024RT-DETRv2: Improved Baseline with Bag-of-Freebies for Real-Time Detection Transformercited by 91
- 2019A General Optimization-based Framework for Local Odometry Estimation with Multiple Sensorscited by 45
- 2019Are We Ready for Service Robots? The OpenLORIS-Scene Datasets for Lifelong SLAMcited by 42
- 2023MobileSAMv2: Faster Segment Anything to Everythingcited by 42
- 2022PVO: Panoptic Visual Odometrycited by 26
- 2021VIODE: A Simulated Dataset to Address the Challenges of Visual-Inertial Odometry in Dynamic Environmentscited by 15
- 2022DynaVINS: A Visual-Inertial SLAM for Dynamic Environmentscited by 12
- 2024YOLOv5, YOLOv8 and YOLOv10: The Go-To Detectors for Real-time Visioncited by 12
- 2023RD-VIO: Robust Visual-Inertial Odometry for Mobile Augmented Reality in Dynamic Environmentscited by 9
- 2023RGB-D Inertial Odometry for a Resource-Restricted Robot in Dynamic Environmentscited by 5
- 2021RP-VIO: Robust Plane-based Visual-Inertial Odometry for Dynamic Environmentscited by 3
- 2022Computing a many-to-many matching with demands and capacities between two sets using the Hungarian algorithmcited by 1
Built on by
Not cited yet.