An Object SLAM Framework for Association, Mapping, and High-Level Tasks
Not on the map. Why?
Abstract (arXiv)
Object SLAM is considered increasingly significant for robot high-level perception and decision-making. Existing studies fall short in terms of data association, object representation, and semantic mapping and frequently rely on additional assumptions, limiting their performance. In this paper, we present a comprehensive object SLAM framework that focuses on object-based perception and object-oriented robot tasks. First, we propose an ensemble data association approach for associating objects in complicated conditions by incorporating parametric and nonparametric statistic testing. In addition, we suggest an outlier-robust centroid and scale estimation algorithm for modeling objects based on the iForest and line alignment. Then a lightweight and object-oriented map is represented by estimated general object models. Taking into consideration the semantic invariance of objects, we convert the object map to a topological map to provide semantic descriptors to enable multi-map matching. Finally, we suggest an object-driven active exploration strategy to achieve autonomous mapping in the grasping scenario. A range of public datasets and real-world results in mapping, augmented reality, scene matching, relocalization, and robotic manipulation have been used to evaluate the proposed object SLAM framework for its efficient performance.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 52 of its 103 references that are in the map. First posted on arXiv 12 May 2023.
Builds on
52 of 103 references.
References · 52
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2018YOLOv3: An Incremental Improvementcited by 2,652
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 862
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
- 2019Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimationcited by 490
- 2020FairMOT: On the Fairness of Detection and Re-Identification in Multiple Object Trackingcited by 489
- 2019DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusioncited by 352
- 2020CosyPose: Consistent multi-view multi-object 6D pose estimationcited by 287
- 2021Group-Free 3D Object Detection via Transformerscited by 215
- 2019Kimera: an Open-Source Library for Real-Time Metric-Semantic Localization and Mappingcited by 181
- 2021SceneGraphFusion: Incremental 3D Scene Graph Prediction from RGB-D Sequencescited by 159
38 more
- 2016SemanticFusion: Dense 3D Semantic Mapping with Convolutional Neural Networkscited by 134
- 2022Multimodal Token Fusion for Vision Transformerscited by 132
- 2018CubeSLAM: Monocular 3D Object SLAMcited by 101
- 2018Fusion++: Volumetric Object-Level SLAMcited by 97
- 2018MaskFusion: Real-Time Recognition, Tracking and Reconstruction of Multiple Moving Objectscited by 95
- 2018QuadricSLAM: Dual Quadrics from Object Detections as Landmarks in Object-oriented SLAMcited by 86
- 2019Volumetric Instance-Aware Semantic Mapping and 3D Object Discoverycited by 79
- 2020NodeSLAM: Neural Object Descriptors for Multi-View Shape Reconstructioncited by 61
- 2020MoreFusion: Multi-object Reasoning for 6D Pose Estimation from Volumetric Fusioncited by 46
- 2017X-View: Graph-Based Semantic Multi-View Localizationcited by 43
- 2018FutureMapping: The Computational Structure of Spatial AI Systemscited by 35
- 2016Meaningful Maps With Object-Oriented Semantic Mappingcited by 31
- 2021DSP-SLAM: Object Oriented SLAM with Deep Shape Priorscited by 30
- 2019EM-Fusion: Dynamic Object-Level SLAM with Probabilistic Data Associationcited by 28
- 2022Symmetry and Uncertainty-Aware Object SLAM for 6DoF Object Pose Estimationcited by 28
- 2020EAO-SLAM: Monocular Semi-Dense Object SLAM Based on Ensemble Data Associationcited by 24
- 2018Monocular Object and Plane SLAM in Structured Environmentscited by 23
- 2021ODAM: Object Detection, Association, and Mapping using Posed RGB Videocited by 22
- 2020Semantic Linking Maps for Active Visual Object Searchcited by 18
- 2017DA-RNN: Semantic Mapping with Data Associated Recurrent Neural Networkscited by 17
- 2020Semantic Histogram Based Graph Matching for Real-Time Multi-Robot Global Localization in Large Scale Environmentcited by 17
- 2021GVINS: Tightly Coupled GNSS-Visual-Inertial Fusion for Smooth and Consistent State Estimationcited by 17
- 2021ManhattanSLAM: Robust Planar Tracking and Mapping Leveraging Mixture of Manhattan Framescited by 17
- 2017Semantic 3D Occupancy Mapping through Efficient High Order CRFscited by 15
- 2018Multi-View Picking: Next-best-view Reaching for Improved Grasping in Cluttercited by 15
- 2021Reconstructing Interactive 3D Scenes by Panoptic Mapping and CAD Model Alignmentscited by 15
- 2020Canny-VO: Visual Odometry with RGB-D Cameras based on Geometric 3D-2D Edge Alignmentcited by 12
- 2020TP-TIO: A Robust Thermal-Inertial Odometry with Deep ThermalPointcited by 11
- 2022Boosting 3D Object Detection via Object-Focused Image Fusioncited by 11
- 2022Learning to Complete Object Shapes for Object-level Mapping in Dynamic Scenescited by 8
- 2017SLAM with Objects using a Nonparametric Pose Graphcited by 7
- 2018Constructing Category-Specific Models for Monocular Object-SLAMcited by 7
- 2021VIRAL SLAM: Tightly Coupled Camera-IMU-UWB-Lidar SLAMcited by 7
- 2021Object-Augmented RGB-D SLAM for Wide-Disparity Relocalisationcited by 7
- 2020Object SLAM-Based Active Mapping and Robotic Graspingcited by 5
- 2020Accurate Object Association and Pose Updating for Semantic SLAMcited by 5
- 2017Active vision for dexterous grasping of novel objectscited by 4
- 2017Incremental 3D Line Segment Extraction from Semi-dense SLAMcited by 1
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2023: 1; 2024: 8; 2025: 5; 2026: 1.
15 papers.
Sort:
- 2024Multiview Scene Graphcited by 9
- 2024CLIP-Loc: Multi-modal Landmark Association for Global Localization in Object-based Mapscited by 8
- 2024GOReloc: Graph-based Object-Level Relocalization for Visual SLAMcited by 7
- 2024VOOM: Robust Visual Object Odometry and Mapping using Hierarchical Landmarkscited by 6
- 2024Representing 3D sparse map points and lines for camera relocalizationcited by 3
- 2024PAS-SLAM: A Visual SLAM System for Planar Ambiguous Scenescited by 2
- 2024LOSS-SLAM: Lightweight Open-Set Semantic Simultaneous Localization and Mappingcited by 2
- 2025Rooms from Motion: Un-posed Indoor 3D Object Detection as Localization and Mappingcited by 2
- 2023UniQuadric: A SLAM Backend for Unknown Rigid Object 3D Tracking and Light-Weight Modelingcited by 1
- 2024Category-level Neural Field for Reconstruction of Partially Observed Objects in Indoor Environmentcited by 1
- 2025MCOO-SLAM: A Multi-Camera Omnidirectional Object SLAM Systemcited by 1
- 2025MSG-Loc: Multi-Label Likelihood-based Semantic Graph Matching for Object-Level Global Localizationcited by 1
- 2026Stable and Scalable Bundle Adjustment of Holistic 3D Structures3 Sep 2026
- 2025MSG-Loc: Multi-Label Likelihood-based Semantic Graph Matching for Object-Level Global Localization3 Dec 2025
- 2025MCOO-SLAM: A Multi-Camera Omnidirectional Object SLAM System18 Jun 2025
- 2025Rooms from Motion: Un-posed Indoor 3D Object Detection as Localization and Mapping29 May 2025
- 2025Category-level Meta-learned NeRF Priors for Efficient Object Mapping3 Mar 2025
- 2025Convex Hull-based Algebraic Constraint for Visual Quadric SLAM3 Mar 2025
- 2024Multiview Scene Graph15 Oct 2024
- 2024GOReloc: Graph-based Object-Level Relocalization for Visual SLAM15 Aug 2024
- 2024Category-level Neural Field for Reconstruction of Partially Observed Objects in Indoor Environment12 Jun 2024
- 2024LOSS-SLAM: Lightweight Open-Set Semantic Simultaneous Localization and Mapping5 Apr 2024
- 2024Representing 3D sparse map points and lines for camera relocalization28 Feb 2024
- 2024VOOM: Robust Visual Object Odometry and Mapping using Hierarchical Landmarks21 Feb 2024
- 2024Multiview Scene Graphcited by 9
- 2024CLIP-Loc: Multi-modal Landmark Association for Global Localization in Object-based Mapscited by 8
- 2024GOReloc: Graph-based Object-Level Relocalization for Visual SLAMcited by 7
- 2024VOOM: Robust Visual Object Odometry and Mapping using Hierarchical Landmarkscited by 6
- 2024Representing 3D sparse map points and lines for camera relocalizationcited by 3
- 2024PAS-SLAM: A Visual SLAM System for Planar Ambiguous Scenescited by 2
- 2024LOSS-SLAM: Lightweight Open-Set Semantic Simultaneous Localization and Mappingcited by 2
- 2025Rooms from Motion: Un-posed Indoor 3D Object Detection as Localization and Mappingcited by 2
- 2023UniQuadric: A SLAM Backend for Unknown Rigid Object 3D Tracking and Light-Weight Modelingcited by 1
- 2024Category-level Neural Field for Reconstruction of Partially Observed Objects in Indoor Environmentcited by 1
- 2025MCOO-SLAM: A Multi-Camera Omnidirectional Object SLAM Systemcited by 1
- 2025MSG-Loc: Multi-Label Likelihood-based Semantic Graph Matching for Object-Level Global Localizationcited by 1
12 most cited of 15 All 15 (JSON)
- 2026Stable and Scalable Bundle Adjustment of Holistic 3D Structures3 Sep 2026
- 2025MSG-Loc: Multi-Label Likelihood-based Semantic Graph Matching for Object-Level Global Localization3 Dec 2025
- 2025MCOO-SLAM: A Multi-Camera Omnidirectional Object SLAM System18 Jun 2025
- 2025Rooms from Motion: Un-posed Indoor 3D Object Detection as Localization and Mapping29 May 2025
- 2025Category-level Meta-learned NeRF Priors for Efficient Object Mapping3 Mar 2025
- 2025Convex Hull-based Algebraic Constraint for Visual Quadric SLAM3 Mar 2025
- 2024Multiview Scene Graph15 Oct 2024
- 2024GOReloc: Graph-based Object-Level Relocalization for Visual SLAM15 Aug 2024
- 2024Category-level Neural Field for Reconstruction of Partially Observed Objects in Indoor Environment12 Jun 2024
- 2024LOSS-SLAM: Lightweight Open-Set Semantic Simultaneous Localization and Mapping5 Apr 2024
- 2024Representing 3D sparse map points and lines for camera relocalization28 Feb 2024
- 2024VOOM: Robust Visual Object Odometry and Mapping using Hierarchical Landmarks21 Feb 2024
12 newest of 15 All 15 (JSON)