MoreFusion: Multi-object Reasoning for 6D Pose Estimation from Volumetric Fusion
Not on the map. Why?
Abstract (arXiv)
Robots and other smart devices need efficient object-based scene representations from their on-board vision systems to reason about contact, physics and occlusion. Recognized precise object models will play an important role alongside non-parametric reconstructions of unrecognized structures. We present a system which can estimate the accurate poses of multiple known objects in contact and occlusion from real-time, embodied multi-view vision. Our approach makes 3D object pose proposals from single RGB-D views, accumulates pose estimates and non-parametric occupancy information from multiple views as the camera moves, and performs joint optimization to estimate consistent, non-intersecting poses for multiple objects in contact. We verify the accuracy and robustness of our approach experimentally on 2 object datasets: YCB-Video, and our own challenging Cluttered YCB-Video. We demonstrate a real-time robotics application where a robot arm precisely and orderly disassembles complicated piles of objects, using only on-board RGB-D vision.
Key facts. Cited by 46 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 17; 2023: 8; 2024: 3; 2025: 5; 2026: 1.
46 papers.
Sort:
- 2022Real-World Robot Learning with Masked Visual Pre-trainingcited by 241
- 2021FFB6D: A Full Flow Bidirectional Fusion Network for 6D Pose Estimationcited by 144
- 2023BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objectscited by 144
- 2021Coarse-to-Fine Q-attention: Efficient Learning for Visual Robotic Manipulation via Discretisationcited by 120
- 2021Q-attention: Enabling Efficient Learning for Vision-based Robotic Manipulationcited by 85
- 2023vMAP: Vectorised Object Mapping for Neural Field SLAMcited by 67
- 2021SAR-Net: Shape Alignment and Recovery Network for Category-level 6D Object Pose and Size Estimationcited by 53
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Surveycited by 39
- 2022RNNPose: Recurrent 6-DoF Object Pose Refinement with Robust Correspondence Field Estimation and Pose Optimizationcited by 38
- 2021Deep Learning on Monocular Object Pose Detection and Tracking: A Comprehensive Overviewcited by 31
- 2022Object Level Depth Reconstruction for Category Level 6D Object Pose Estimation From Monocular RGB Imagecited by 29
- 2022Uni6D: A Unified CNN Framework without Projection Breakdown for 6D Pose Estimationcited by 22
34 more
- 2022Sim-to-Real 6D Object Pose Estimation via Iterative Self-training for Robotic Bin Pickingcited by 20
- 2022Learning 6-DoF Object Poses to Grasp Category-level Objects by Language Instructionscited by 19
- 2021StablePose: Learning 6D Object Poses from Geometrically Stable Patchescited by 17
- 2021PR-GCN: A Deep Graph Convolutional Network with Point Refinement for 6D Pose Estimationcited by 17
- 2023HiPose: Hierarchical Binary Surface Encoding and Correspondence Pruning for RGB-D 6DoF Object Pose Estimationcited by 17
- 2023Deep Fusion Transformer Network with Weighted Vector-Wise Keypoints Voting for Robust 6D Object Pose Estimationcited by 16
- 2021Reconstructing Interactive 3D Scenes by Panoptic Mapping and CAD Model Alignmentscited by 15
- 2023An Object SLAM Framework for Association, Mapping, and High-Level Taskscited by 15
- 2023MVTrans: Multi-View Perception of Transparent Objectscited by 14
- 2022DGECN: A Depth-Guided Edge Convolutional Network for End-to-End 6D Pose Estimationcited by 12
- 2022ReorientBot: Learning Object Reorientation for Specific-Posed Placementcited by 10
- 2022RGB-Only Reconstruction of Tabletop Scenes for Collision-Free Manipulator Controlcited by 10
- 2023Self-Supervised Unseen Object Instance Segmentation via Long-Term Robot Interactioncited by 10
- 2022Coarse-to-fine Q-attention with Tree Expansioncited by 9
- 2022Bingham Policy Parameterization for 3D Rotations in Reinforcement Learningcited by 7
- 2022NeRF-Loc: Transformer-Based Object Localization Within Neural Radiance Fieldscited by 7
- 2022Ambiguity-Aware Multi-Object Pose Optimization for Visually-Assisted Robot Manipulationcited by 6
- 2021SIMstack: A Generative Shape and Instance Model for Unordered Object Stackscited by 4
- 2022SporeAgent: Reinforced Scene-level Plausibility for Object Pose Refinementcited by 4
- 2022SafePicking: Learning Safe Object Extraction via Object-Level Mappingcited by 3
- 2023Physics-Based Rigid Body Object Tracking and Friction Filtering From RGB-D Videoscited by 3
- 2025Active 6D Pose Estimation for Textureless Objects using Multi-View RGB Framescited by 3
- 2025PhysPose: Refining 6D Object Poses with Physical Constraintscited by 3
- 2024Fit-NGP: Fitting Object Models to Neural Graphics Primitivescited by 2
- 2024A Low-Cost, High-Speed, and Robust Bin Picking System for Factory Automation Enabled by a Non-Stop, Multi-View, and Active Vision Schemecited by 2
- 2025Reasoning and Learning a Perceptual Metric for Self-Training of Reflective Objects in Bin-Picking with a Low-cost Cameracited by 2
- 2021Generating Annotated Training Data for 6D Object Pose Estimation in Operational Environments with Minimal User Interactioncited by 0
- 2021Learning Stereopsis from Geometric Synthesis for 6D Object Pose Estimationcited by 0
- 2021Advanced Algorithms of Collision Free Navigation and Flocking for Autonomous UAVscited by 0
- 2022GloCAL: Glocalized Curriculum-Aided Learning of Multiple Tasks with Application to Robotic Graspingcited by 0
- 2022Towards Two-view 6D Object Pose Estimation: A Comparative Study on Fusion Strategycited by 0
- 2025Exploiting Radiance Fields for Grasp Generation on Novel Synthetic Viewscited by 0
- 2025AlignPose: Generalizable 6D Pose Estimation via Multi-view Feature-metric Alignmentcited by 0
- 2026Temporally Consistent Object 6D Pose Estimation for Robot Controlcited by 0
- 2026Temporally Consistent Object 6D Pose Estimation for Robot Control4 May 2026
- 2025AlignPose: Generalizable 6D Pose Estimation via Multi-view Feature-metric Alignment23 Dec 2025
- 2025Exploiting Radiance Fields for Grasp Generation on Novel Synthetic Views16 May 2025
- 2025PhysPose: Refining 6D Object Poses with Physical Constraints30 Mar 2025
- 2025Reasoning and Learning a Perceptual Metric for Self-Training of Reflective Objects in Bin-Picking with a Low-cost Camera26 Mar 2025
- 2025Active 6D Pose Estimation for Textureless Objects using Multi-View RGB Frames5 Mar 2025
- 2024A Low-Cost, High-Speed, and Robust Bin Picking System for Factory Automation Enabled by a Non-Stop, Multi-View, and Active Vision Scheme1 Oct 2024
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Survey13 May 2024
- 2024Fit-NGP: Fitting Object Models to Neural Graphics Primitives4 Jan 2024
- 2023HiPose: Hierarchical Binary Surface Encoding and Correspondence Pruning for RGB-D 6DoF Object Pose Estimation21 Nov 2023
- 2023Physics-Based Rigid Body Object Tracking and Friction Filtering From RGB-D Videos27 Sep 2023
- 2023Deep Fusion Transformer Network with Weighted Vector-Wise Keypoints Voting for Robust 6D Object Pose Estimation10 Aug 2023
34 more
- 2023An Object SLAM Framework for Association, Mapping, and High-Level Tasks12 May 2023
- 2023BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objects24 Mar 2023
- 2023MVTrans: Multi-View Perception of Transparent Objects22 Feb 2023
- 2023Self-Supervised Unseen Object Instance Segmentation via Long-Term Robot Interaction7 Feb 2023
- 2023vMAP: Vectorised Object Mapping for Neural Field SLAM3 Feb 2023
- 2022Ambiguity-Aware Multi-Object Pose Optimization for Visually-Assisted Robot Manipulation2 Nov 2022
- 2022RGB-Only Reconstruction of Tabletop Scenes for Collision-Free Manipulator Control21 Oct 2022
- 2022Real-World Robot Learning with Masked Visual Pre-training6 Oct 2022
- 2022NeRF-Loc: Transformer-Based Object Localization Within Neural Radiance Fields24 Sep 2022
- 2022Towards Two-view 6D Object Pose Estimation: A Comparative Study on Fusion Strategy1 Jul 2022
- 2022Learning 6-DoF Object Poses to Grasp Category-level Objects by Language Instructions9 May 2022
- 2022Coarse-to-fine Q-attention with Tree Expansion26 Apr 2022
- 2022DGECN: A Depth-Guided Edge Convolutional Network for End-to-End 6D Pose Estimation21 Apr 2022
- 2022Sim-to-Real 6D Object Pose Estimation via Iterative Self-training for Robotic Bin Picking14 Apr 2022
- 2022GloCAL: Glocalized Curriculum-Aided Learning of Multiple Tasks with Application to Robotic Grasping14 Apr 2022
- 2022Object Level Depth Reconstruction for Category Level 6D Object Pose Estimation From Monocular RGB Image4 Apr 2022
- 2022Uni6D: A Unified CNN Framework without Projection Breakdown for 6D Pose Estimation28 Mar 2022
- 2022RNNPose: Recurrent 6-DoF Object Pose Refinement with Robust Correspondence Field Estimation and Pose Optimization24 Mar 2022
- 2022ReorientBot: Learning Object Reorientation for Specific-Posed Placement22 Feb 2022
- 2022SafePicking: Learning Safe Object Extraction via Object-Level Mapping11 Feb 2022
- 2022Bingham Policy Parameterization for 3D Rotations in Reinforcement Learning8 Feb 2022
- 2022SporeAgent: Reinforced Scene-level Plausibility for Object Pose Refinement1 Jan 2022
- 2021Advanced Algorithms of Collision Free Navigation and Flocking for Autonomous UAVs30 Oct 2021
- 2021Learning Stereopsis from Geometric Synthesis for 6D Object Pose Estimation25 Sep 2021
- 2021PR-GCN: A Deep Graph Convolutional Network with Point Refinement for 6D Pose Estimation23 Aug 2021
- 2021SAR-Net: Shape Alignment and Recovery Network for Category-level 6D Object Pose and Size Estimation27 Jun 2021
- 2021Coarse-to-Fine Q-attention: Efficient Learning for Visual Robotic Manipulation via Discretisation23 Jun 2021
- 2021Q-attention: Enabling Efficient Learning for Vision-based Robotic Manipulation31 May 2021
- 2021Deep Learning on Monocular Object Pose Detection and Tracking: A Comprehensive Overview29 May 2021
- 2021SIMstack: A Generative Shape and Instance Model for Unordered Object Stacks30 Mar 2021
- 2021Reconstructing Interactive 3D Scenes by Panoptic Mapping and CAD Model Alignments30 Mar 2021
- 2021Generating Annotated Training Data for 6D Object Pose Estimation in Operational Environments with Minimal User Interaction17 Mar 2021
- 2021FFB6D: A Full Flow Bidirectional Fusion Network for 6D Pose Estimation3 Mar 2021
- 2021StablePose: Learning 6D Object Poses from Geometrically Stable Patches18 Feb 2021
- 2022Real-World Robot Learning with Masked Visual Pre-trainingcited by 241
- 2021FFB6D: A Full Flow Bidirectional Fusion Network for 6D Pose Estimationcited by 144
- 2023BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objectscited by 144
- 2021Coarse-to-Fine Q-attention: Efficient Learning for Visual Robotic Manipulation via Discretisationcited by 120
- 2021Q-attention: Enabling Efficient Learning for Vision-based Robotic Manipulationcited by 85
- 2023vMAP: Vectorised Object Mapping for Neural Field SLAMcited by 67
- 2021SAR-Net: Shape Alignment and Recovery Network for Category-level 6D Object Pose and Size Estimationcited by 53
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Surveycited by 39
- 2022RNNPose: Recurrent 6-DoF Object Pose Refinement with Robust Correspondence Field Estimation and Pose Optimizationcited by 38
- 2021Deep Learning on Monocular Object Pose Detection and Tracking: A Comprehensive Overviewcited by 31
- 2022Object Level Depth Reconstruction for Category Level 6D Object Pose Estimation From Monocular RGB Imagecited by 29
- 2022Uni6D: A Unified CNN Framework without Projection Breakdown for 6D Pose Estimationcited by 22
12 most cited of 46 All 46 (JSON)
- 2026Temporally Consistent Object 6D Pose Estimation for Robot Control4 May 2026
- 2025AlignPose: Generalizable 6D Pose Estimation via Multi-view Feature-metric Alignment23 Dec 2025
- 2025Exploiting Radiance Fields for Grasp Generation on Novel Synthetic Views16 May 2025
- 2025PhysPose: Refining 6D Object Poses with Physical Constraints30 Mar 2025
- 2025Reasoning and Learning a Perceptual Metric for Self-Training of Reflective Objects in Bin-Picking with a Low-cost Camera26 Mar 2025
- 2025Active 6D Pose Estimation for Textureless Objects using Multi-View RGB Frames5 Mar 2025
- 2024A Low-Cost, High-Speed, and Robust Bin Picking System for Factory Automation Enabled by a Non-Stop, Multi-View, and Active Vision Scheme1 Oct 2024
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Survey13 May 2024
- 2024Fit-NGP: Fitting Object Models to Neural Graphics Primitives4 Jan 2024
- 2023HiPose: Hierarchical Binary Surface Encoding and Correspondence Pruning for RGB-D 6DoF Object Pose Estimation21 Nov 2023
- 2023Physics-Based Rigid Body Object Tracking and Friction Filtering From RGB-D Videos27 Sep 2023
- 2023Deep Fusion Transformer Network with Weighted Vector-Wise Keypoints Voting for Robust 6D Object Pose Estimation10 Aug 2023
12 newest of 46 All 46 (JSON)