ReorientBot: Learning Object Reorientation for Specific-Posed Placement
Not on the map. Why?
Abstract (arXiv)
Robots need the capability of placing objects in arbitrary, specific poses to rearrange the world and achieve various valuable tasks. Object reorientation plays a crucial role in this as objects may not initially be oriented such that the robot can grasp and then immediately place them in a specific goal pose. In this work, we present a vision-based manipulation system, ReorientBot, which consists of 1) visual scene understanding with pose estimation and volumetric reconstruction using an onboard RGB-D camera; 2) learned waypoint selection for successful and efficient motion generation for reorientation; 3) traditional motion planning to generate a collision-free trajectory from the selected waypoints. We evaluate our method using the YCB objects in both simulation and the real world, achieving 93% overall success, 81% improvement in success rate, and 22% improvement in execution time compared to a heuristic approach. We demonstrate extended multi-object rearrangement showing the general capability of the system.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 23 of its 37 references that are in the map. First posted on arXiv 22 Feb 2022.
Builds on
23 of 37 references.
References · 23
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015End-to-End Training of Deep Visuomotor Policiescited by 847
- 2018QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulationcited by 730
- 2019Solving Rubik's Cube with a Robot Handcited by 699
- 2018Learning Dexterous In-Hand Manipulationcited by 643
- 2019DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusioncited by 352
- 2020Transporter Networks: Rearranging the Visual World for Robotic Manipulationcited by 342
- 2016Learning Hand-Eye Coordination for Robotic Grasping with Deep Learning and Large-Scale Data Collectioncited by 312
- 2015Supersizing Self-supervision: Learning to Grasp from 50K Tries and 700 Robot Hourscited by 208
- 2020Rearrangement: A Challenge for Embodied AIcited by 153
- 2019kPAM: KeyPoint Affordances for Category-Level Robotic Manipulationcited by 152
11 more
- 2017Robotic Pick-and-Place of Novel Objects in Clutter with Multi-Affordance Grasping and Cross-Domain Image Matchingcited by 124
- 2021Coarse-to-Fine Q-attention: Efficient Learning for Visual Robotic Manipulation via Discretisationcited by 120
- 2017Intel RealSense Stereoscopic Depth Camerascited by 82
- 2016Multi-view Self-supervised Deep Learning for 6D Pose Estimation in the Amazon Picking Challengecited by 70
- 2020MoreFusion: Multi-object Reasoning for 6D Pose Estimation from Volumetric Fusioncited by 46
- 2020Task-driven Perception and Manipulation for Constrained Placement of Unknown Objectscited by 11
- 2021Learning to Regrasp by Learning to Placecited by 11
- 2017Pick and Place Without Geometric Object Modelscited by 9
- 2020Instance Segmentation of Visible and Occluded Regions for Finding and Picking Target from a Pile of Objectscited by 8
- 2015Developing and Comparing Single-arm and Dual-arm Regraspcited by 3
- 2022SafePicking: Learning Safe Object Extraction via Object-Level Mappingcited by 3
Built on by
Citing papers per year: 2022: 3; 2023: 5; 2024: 2.
10 papers.
- 2022Real-World Robot Learning with Masked Visual Pre-trainingcited by 241
- 2023Shelving, Stacking, Hanging: Relational Pose Diffusion for Multi-modal Rearrangementcited by 29
- 2022Sim-to-Real 6D Object Pose Estimation via Iterative Self-training for Robotic Bin Pickingcited by 20
- 2023ReorientDiff: Diffusion Model based Reorientation for Object Manipulationcited by 19
- 2023CabiNet: Scaling Neural Collision Detection for Object Rearrangement with Procedural Scene Generationcited by 17
- 2023Dream2Real: Zero-Shot 3D Object Rearrangement with Vision-Language Modelscited by 16
- 2022Coarse-to-fine Q-attention with Tree Expansioncited by 9
- 2023You Only Look at One: Category-Level Object Representations for Pose Estimation From a Single Examplecited by 8
- 2024Grasp, See, and Place: Efficient Unknown Object Rearrangement with Policy Structure Priorcited by 5
- 2024Synthetica: Large Scale Synthetic Data for Robot Perceptioncited by 3
- 2024Synthetica: Large Scale Synthetic Data for Robot Perception28 Oct 2024
- 2024Grasp, See, and Place: Efficient Unknown Object Rearrangement with Policy Structure Prior23 Feb 2024
- 2023Dream2Real: Zero-Shot 3D Object Rearrangement with Vision-Language Models7 Dec 2023
- 2023Shelving, Stacking, Hanging: Relational Pose Diffusion for Multi-modal Rearrangement10 Jul 2023
- 2023You Only Look at One: Category-Level Object Representations for Pose Estimation From a Single Example22 May 2023
- 2023CabiNet: Scaling Neural Collision Detection for Object Rearrangement with Procedural Scene Generation18 Apr 2023
- 2023ReorientDiff: Diffusion Model based Reorientation for Object Manipulation28 Feb 2023
- 2022Real-World Robot Learning with Masked Visual Pre-training6 Oct 2022
- 2022Coarse-to-fine Q-attention with Tree Expansion26 Apr 2022
- 2022Sim-to-Real 6D Object Pose Estimation via Iterative Self-training for Robotic Bin Picking14 Apr 2022