Goal-Auxiliary Actor-Critic for 6D Robotic Grasping with Point Clouds
Not on the map. Why?
Abstract (arXiv)
6D robotic grasping beyond top-down bin-picking scenarios is a challenging task. Previous solutions based on 6D grasp synthesis with robot motion planning usually operate in an open-loop setting, which are sensitive to grasp synthesis errors. In this work, we propose a new method for learning closed-loop control policies for 6D grasping. Our policy takes a segmented point cloud of an object from an egocentric camera as input, and outputs continuous 6D control actions of the robot gripper for grasping the object. We combine imitation learning and reinforcement learning and introduce a goal-auxiliary actor-critic algorithm for policy learning. We demonstrate that our learned policy can be integrated into a tabletop 6D grasping system and a human-robot handover system to improve the grasping performance of unseen objects. Our videos and code can be found at https://sites.google.com/view/gaddpg .
Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 7; 2023: 7; 2024: 5; 2025: 5.
24 papers.
Sort:
By area:
- 2024Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformerscited by 145
- 2022DexPoint: Generalizable Point Cloud Reinforcement Learning for Sim-to-Real Dexterous Manipulationcited by 78
- 2023DexArt: Benchmarking Generalizable Dexterous Manipulation with Articulated Objectscited by 64
- 2023NeRF in the Palm of Your Hand: Corrective Augmentation for Robotics via Novel-View Synthesiscited by 56
- 2024GenSim2: Scaling Robot Data Generation with Multi-modal and Reasoning LLMscited by 48
- 2024PoCo: Policy Composition from and for Heterogeneous Robot Learningcited by 42
- 2023Learning Human-to-Robot Handovers from Point Cloudscited by 34
- 2023HACMan: Learning Hybrid Actor-Critic Maps for 6D Non-Prehensile Manipulationcited by 27
- 2022Learning to Grasp the Ungraspable with Emergent Extrinsic Dexteritycited by 25
- 2022Mean Shift Mask Transformer for Unseen Object Instance Segmentationcited by 19
- 2023XVO: Generalized Visual Odometry via Cross-Modal Self-Trainingcited by 17
- 2022HandoverSim: A Simulation Framework and Benchmark for Human-to-Robot Object Handoverscited by 15
12 more
- 2024GenH2R: Learning Generalizable Human-to-Robot Handover via Scalable Simulation, Demonstration, and Imitationcited by 14
- 2023SynH2R: Synthesizing Hand-Object Motions for Learning Human-to-Robot Handoverscited by 13
- 2022NeuralGrasps: Learning Implicit Representations for Grasps of Multiple Robotic Handscited by 12
- 2023Robot Fleet Learning via Policy Mergingcited by 11
- 2022DA2 Dataset: Toward Dexterity-Aware Dual-Arm Graspingcited by 10
- 2022Neural Motion Fields: Encoding Grasp Trajectories as Implicit Value Functionscited by 3
- 2024Stereo Hand-Object Reconstruction for Human-to-Robot Handovercited by 2
- 2025GraspCoT: Integrating Physical Property Reasoning for 6-DoF Grasping under Flexible Language Instructionscited by 2
- 2025Visuomotor Grasping with World Models for Surgical Robotscited by 1
- 2025Grasp-MPC: Closed-Loop Visual Grasping via Value-Guided Model Predictive Controlcited by 1
- 2025PointNet4D: A Lightweight 4D Point Cloud Video Backbone for Online and Offline Perception in Robotic Applicationscited by 1
- 2025COMBO-Grasp: Learning Constraint-Based Manipulation for Bimanual Occluded Graspingcited by 0
- 2025PointNet4D: A Lightweight 4D Point Cloud Video Backbone for Online and Offline Perception in Robotic Applications1 Dec 2025
- 2025Grasp-MPC: Closed-Loop Visual Grasping via Value-Guided Model Predictive Control7 Sep 2025
- 2025Visuomotor Grasping with World Models for Surgical Robots15 Aug 2025
- 2025GraspCoT: Integrating Physical Property Reasoning for 6-DoF Grasping under Flexible Language Instructions20 Mar 2025
- 2025COMBO-Grasp: Learning Constraint-Based Manipulation for Bimanual Occluded Grasping12 Feb 2025
- 2024Stereo Hand-Object Reconstruction for Human-to-Robot Handover10 Dec 2024
- 2024GenSim2: Scaling Robot Data Generation with Multi-modal and Reasoning LLMs4 Oct 2024
- 2024Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformers30 Sep 2024
- 2024PoCo: Policy Composition from and for Heterogeneous Robot Learning4 Feb 2024
- 2024GenH2R: Learning Generalizable Human-to-Robot Handover via Scalable Simulation, Demonstration, and Imitation1 Jan 2024
- 2023SynH2R: Synthesizing Hand-Object Motions for Learning Human-to-Robot Handovers9 Nov 2023
- 2023Robot Fleet Learning via Policy Merging2 Oct 2023
12 more
- 2023XVO: Generalized Visual Odometry via Cross-Modal Self-Training28 Sep 2023
- 2023DexArt: Benchmarking Generalizable Dexterous Manipulation with Articulated Objects9 May 2023
- 2023HACMan: Learning Hybrid Actor-Critic Maps for 6D Non-Prehensile Manipulation6 May 2023
- 2023Learning Human-to-Robot Handovers from Point Clouds30 Mar 2023
- 2023NeRF in the Palm of Your Hand: Corrective Augmentation for Robotics via Novel-View Synthesis18 Jan 2023
- 2022Mean Shift Mask Transformer for Unseen Object Instance Segmentation21 Nov 2022
- 2022DexPoint: Generalizable Point Cloud Reinforcement Learning for Sim-to-Real Dexterous Manipulation17 Nov 2022
- 2022Learning to Grasp the Ungraspable with Emergent Extrinsic Dexterity2 Nov 2022
- 2022DA2 Dataset: Toward Dexterity-Aware Dual-Arm Grasping31 Jul 2022
- 2022NeuralGrasps: Learning Implicit Representations for Grasps of Multiple Robotic Hands6 Jul 2022
- 2022Neural Motion Fields: Encoding Grasp Trajectories as Implicit Value Functions29 Jun 2022
- 2022HandoverSim: A Simulation Framework and Benchmark for Human-to-Robot Object Handovers19 May 2022
- 2024Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformerscited by 145
- 2022DexPoint: Generalizable Point Cloud Reinforcement Learning for Sim-to-Real Dexterous Manipulationcited by 78
- 2023DexArt: Benchmarking Generalizable Dexterous Manipulation with Articulated Objectscited by 64
- 2024PoCo: Policy Composition from and for Heterogeneous Robot Learningcited by 42
- 2023Learning Human-to-Robot Handovers from Point Cloudscited by 34
- 2023HACMan: Learning Hybrid Actor-Critic Maps for 6D Non-Prehensile Manipulationcited by 27
- 2022Learning to Grasp the Ungraspable with Emergent Extrinsic Dexteritycited by 25
- 2022Mean Shift Mask Transformer for Unseen Object Instance Segmentationcited by 19
- 2023XVO: Generalized Visual Odometry via Cross-Modal Self-Trainingcited by 17
- 2022HandoverSim: A Simulation Framework and Benchmark for Human-to-Robot Object Handoverscited by 15
- 2023SynH2R: Synthesizing Hand-Object Motions for Learning Human-to-Robot Handoverscited by 13
- 2022NeuralGrasps: Learning Implicit Representations for Grasps of Multiple Robotic Handscited by 12
12 most cited of 18 All 18 (JSON)
- 2025Grasp-MPC: Closed-Loop Visual Grasping via Value-Guided Model Predictive Control7 Sep 2025
- 2025COMBO-Grasp: Learning Constraint-Based Manipulation for Bimanual Occluded Grasping12 Feb 2025
- 2024Stereo Hand-Object Reconstruction for Human-to-Robot Handover10 Dec 2024
- 2024Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformers30 Sep 2024
- 2024PoCo: Policy Composition from and for Heterogeneous Robot Learning4 Feb 2024
- 2023SynH2R: Synthesizing Hand-Object Motions for Learning Human-to-Robot Handovers9 Nov 2023
- 2023Robot Fleet Learning via Policy Merging2 Oct 2023
- 2023XVO: Generalized Visual Odometry via Cross-Modal Self-Training28 Sep 2023
- 2023DexArt: Benchmarking Generalizable Dexterous Manipulation with Articulated Objects9 May 2023
- 2023HACMan: Learning Hybrid Actor-Critic Maps for 6D Non-Prehensile Manipulation6 May 2023
- 2023Learning Human-to-Robot Handovers from Point Clouds30 Mar 2023
- 2022Mean Shift Mask Transformer for Unseen Object Instance Segmentation21 Nov 2022
12 newest of 18 All 18 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2021Learning 6DoF Grasping Using Reward-Consistent Demonstration
- 202423 DoF Grasping Policies from a Raw Point Cloud ↗
- 2026GraspLDP: Towards Generalizable Grasping Policy via Latent Diffusion
- 2025Universal Dexterous Functional Grasping via Demonstration-Editing Reinforcement Learning
- 2025Spatial RoboGrasp: Generalized Robotic Grasping Control Policy
- 2025Learning Adaptive Dexterous Grasping from Single Demonstrations
- 2026MoDex: A Diffusion Policy for Sequential Multi-Object Dexterous Grasping ↗
- 2025DemoGrasp: Universal Dexterous Grasping from a Single Demonstration