Multi-View Picking: Next-best-view Reaching for Improved Grasping in Clutter
Not on the map. Why?
Abstract (arXiv)
Camera viewpoint selection is an important aspect of visual grasp detection, especially in clutter where many occlusions are present. Where other approaches use a static camera position or fixed data collection routines, our Multi-View Picking (MVP) controller uses an active perception approach to choose informative viewpoints based directly on a distribution of grasp pose estimates in real time, reducing uncertainty in the grasp poses caused by clutter and occlusions. In trials of grasping 20 objects from clutter, our MVP controller achieves 80% grasp success, outperforming a single-viewpoint grasp detector by 12%. We also show that our approach is both more accurate and more efficient than approaches which consider multiple fixed viewpoints.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). First posted on arXiv 23 Sep 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 1; 2023: 2; 2024: 5; 2025: 3; 2026: 1.
15 papers.
Sort:
By area:
- 2024DexGraspNet 2.0: Learning Generative Dexterous Grasping in Large-scale Synthetic Cluttered Scenescited by 44
- 2023An Object SLAM Framework for Association, Mapping, and High-Level Taskscited by 15
- 2025VISO-Grasp: Vision-Language Informed Spatial Object-centric 6-DoF Active View Planning and Grasping in Clutter and Invisibilitycited by 11
- 2021Simultaneous Multi-View Object Recognition and Grasping in Open-Ended Domainscited by 10
- 2023Active-Perceptive Motion Generation for Mobile Manipulationcited by 10
- 2021Transferring Experience from Simulation to the Real World for Precise Pick-And-Place Tasks in Highly Cluttered Scenescited by 6
- 2021Learning suction graspability considering grasp quality and robot reachability for bin-pickingcited by 5
- 2024Grasp, See, and Place: Efficient Unknown Object Rearrangement with Policy Structure Priorcited by 5
- 2024Observe Then Act: Asynchronous Active Vision-Action Model for Robotic Manipulationcited by 5
- 2024Optimizing Active Perception for Learning Simultaneous Viewpoint Selection and Manipulation with Diffusion Policycited by 3
- 2024Learning to Look: Seeking Information for Decision Making via Policy Factorizationcited by 3
- 2025Active 6D Pose Estimation for Textureless Objects using Multi-View RGB Framescited by 3
- 2026Robustness of Robotic Manipulation: Foundations and Frontiers30 Jun 2026
- 2025VISO-Grasp: Vision-Language Informed Spatial Object-centric 6-DoF Active View Planning and Grasping in Clutter and Invisibility16 Mar 2025
- 2025Active 6D Pose Estimation for Textureless Objects using Multi-View RGB Frames5 Mar 2025
- 2025DNRSelect: Active Best View Selection for Deferred Neural Rendering21 Jan 2025
- 2024DexGraspNet 2.0: Learning Generative Dexterous Grasping in Large-scale Synthetic Cluttered Scenes30 Oct 2024
- 2024Learning to Look: Seeking Information for Decision Making via Policy Factorization24 Oct 2024
- 2024Observe Then Act: Asynchronous Active Vision-Action Model for Robotic Manipulation23 Sep 2024
- 2024Optimizing Active Perception for Learning Simultaneous Viewpoint Selection and Manipulation with Diffusion Policy22 Sep 2024
- 2024Grasp, See, and Place: Efficient Unknown Object Rearrangement with Policy Structure Prior23 Feb 2024
- 2023Active-Perceptive Motion Generation for Mobile Manipulation30 Sep 2023
- 2023An Object SLAM Framework for Association, Mapping, and High-Level Tasks12 May 2023
- 2022A Robotic Visual Grasping Design: Rethinking Convolution Neural Network with High-Resolutions15 Sep 2022
3 more
- 2021Learning suction graspability considering grasp quality and robot reachability for bin-picking4 Nov 2021
- 2021Simultaneous Multi-View Object Recognition and Grasping in Open-Ended Domains3 Jun 2021
- 2021Transferring Experience from Simulation to the Real World for Precise Pick-And-Place Tasks in Highly Cluttered Scenes12 Jan 2021
- 2024DexGraspNet 2.0: Learning Generative Dexterous Grasping in Large-scale Synthetic Cluttered Scenescited by 44
- 2023An Object SLAM Framework for Association, Mapping, and High-Level Taskscited by 15
- 2025VISO-Grasp: Vision-Language Informed Spatial Object-centric 6-DoF Active View Planning and Grasping in Clutter and Invisibilitycited by 11
- 2021Simultaneous Multi-View Object Recognition and Grasping in Open-Ended Domainscited by 10
- 2023Active-Perceptive Motion Generation for Mobile Manipulationcited by 10
- 2021Transferring Experience from Simulation to the Real World for Precise Pick-And-Place Tasks in Highly Cluttered Scenescited by 6
- 2021Learning suction graspability considering grasp quality and robot reachability for bin-pickingcited by 5
- 2024Grasp, See, and Place: Efficient Unknown Object Rearrangement with Policy Structure Priorcited by 5
- 2024Observe Then Act: Asynchronous Active Vision-Action Model for Robotic Manipulationcited by 5
- 2024Learning to Look: Seeking Information for Decision Making via Policy Factorizationcited by 3
- 2025Active 6D Pose Estimation for Textureless Objects using Multi-View RGB Framescited by 3
- 2022A Robotic Visual Grasping Design: Rethinking Convolution Neural Network with High-Resolutionscited by 2
12 most cited of 13 All 13 (JSON)
- 2026Robustness of Robotic Manipulation: Foundations and Frontiers30 Jun 2026
- 2025VISO-Grasp: Vision-Language Informed Spatial Object-centric 6-DoF Active View Planning and Grasping in Clutter and Invisibility16 Mar 2025
- 2025Active 6D Pose Estimation for Textureless Objects using Multi-View RGB Frames5 Mar 2025
- 2024DexGraspNet 2.0: Learning Generative Dexterous Grasping in Large-scale Synthetic Cluttered Scenes30 Oct 2024
- 2024Learning to Look: Seeking Information for Decision Making via Policy Factorization24 Oct 2024
- 2024Observe Then Act: Asynchronous Active Vision-Action Model for Robotic Manipulation23 Sep 2024
- 2024Grasp, See, and Place: Efficient Unknown Object Rearrangement with Policy Structure Prior23 Feb 2024
- 2023Active-Perceptive Motion Generation for Mobile Manipulation30 Sep 2023
- 2023An Object SLAM Framework for Association, Mapping, and High-Level Tasks12 May 2023
- 2022A Robotic Visual Grasping Design: Rethinking Convolution Neural Network with High-Resolutions15 Sep 2022
- 2021Learning suction graspability considering grasp quality and robot reachability for bin-picking4 Nov 2021
- 2021Simultaneous Multi-View Object Recognition and Grasping in Open-Ended Domains3 Jun 2021
12 newest of 13 All 13 (JSON)