mlsanityData to 7 Oct 2026

LGU-SLAM: Learnable Gaussian Uncertainty Matching with Deformable Correlation Sampling for Deep Visual SLAM

arXiv 2410.23231 ↗First posted 30 Oct 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Deep visual Simultaneous Localization and Mapping (SLAM) techniques, e.g., DROID, have made significant advancements by leveraging deep visual odometry on dense flow fields. In general, they heavily rely on global visual similarity matching. However, the ambiguous similarity interference in uncertain regions could often lead to excessive noise in correspondences, ultimately misleading SLAM in geometric modeling. To address this issue, we propose a Learnable Gaussian Uncertainty (LGU) matching. It mainly focuses on precise correspondence construction. In our scheme, a learnable 2D Gaussian uncertainty model is designed to associate matching-frame pairs. It could generate input-dependent Gaussian distributions for each correspondence map. Additionally, a multi-scale deformable correlation sampling strategy is devised to adaptively fine-tune the sampling of each direction by a priori look-up ranges, enabling reliable correlation construction. Furthermore, a KAN-bias GRU component is adopted to improve a temporal iterative enhancement for accomplishing sophisticated spatio-temporal modeling with limited parameters. The extensive experiments on real-world and synthetic datasets are conducted to validate the effectiveness and superiority of our method.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 32 of its 54 references that are in the map. First posted on arXiv 30 Oct 2024.

Builds on

32 of 54 references.

References · 32

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  2. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  3. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
  4. 2017Deformable Convolutional Networkscited by 1,481
  5. 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
  6. 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,303
  7. 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 983
  8. 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 862
  9. 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
  10. 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
  11. 2024KAN: Kolmogorov-Arnold Networkscited by 634
  12. 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
20 more
  1. 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 494
  2. 2016Direct Sparse Odometrycited by 479
  3. 2017VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimatorcited by 418
  4. 2016Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Agecited by 405
  5. 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 386
  6. 2023GS-SLAM: Dense Visual SLAM with 3D Gaussian Splattingcited by 278
  7. 2016DeMoN: Depth and Motion Network for Learning Monocular Stereocited by 200
  8. 2022Deep Patch Visual Odometrycited by 186
  9. 2018DeepV2D: Video to Depth with Differentiable Structure from Motioncited by 185
  10. 2018BA-Net: Dense Bundle Adjustment Networkcited by 173
  11. 2022ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fieldscited by 158
  12. 2023GO-SLAM: Global Optimization for Consistent 3D Instant Reconstructioncited by 132
  13. 2020DeepFactors: Real-Time Probabilistic Dense Monocular SLAMcited by 117
  14. 2020TartanVO: A Generalizable Learning-based VOcited by 107
  15. 2018DeepTAM: Deep Tracking and Mappingcited by 87
  16. 2024Deep Patch Visual SLAMcited by 68
  17. 2022DytanVO: Joint Refinement of Visual Odometry and Motion Segmentation in Dynamic Environmentscited by 27
  18. 2018Omnidirectional DSO: Direct Sparse Odometry with Fisheye Camerascited by 17
  19. 2023DVI-SLAM: A Dual Visual Inertial SLAM Networkcited by 9
  20. 2022Shared Coupling-bridge for Weakly Supervised Local Feature Learningcited by 4

Built on by

Not cited yet.