Robotic Grasping using Deep Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
In this work, we present a deep reinforcement learning based method to solve the problem of robotic grasping using visio-motor feedback. The use of a deep learning based approach reduces the complexity caused by the use of hand-designed features. Our method uses an off-policy reinforcement learning framework to learn the grasping policy. We use the double deep Q-learning framework along with a novel Grasp-Q-Network to output grasp probabilities used to learn grasps that maximize the pick success. We propose a visual servoing mechanism that uses a multi-view camera setup that observes the scene which contains the objects of interest. We performed experiments using a Baxter Gazebo simulated environment as well as on the actual robot. The results show that our proposed method outperforms the baseline Q-learning framework and increases grasping accuracy by adapting a multi-view model in comparison to a single-view model.
Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 6; 2023: 6; 2024: 6; 2025: 8; 2026: 1.
27 papers.
Sort:
By area:
- 2025HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Modelcited by 176
- 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 166
- 2023ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulationcited by 157
- 2024RoboMamba: Efficient Vision-Language-Action Model for Robotic Reasoning and Manipulationcited by 102
- 2024Lift3D Foundation Policy: Lifting 2D Large-Scale Pretrained Models for Robust 3D Robotic Manipulationcited by 45
- 2025CoMo: Learning Continuous Latent Motion from Internet Videos for Scalable Robot Learningcited by 37
- 2025AC-DiT: Adaptive Coordination Diffusion Transformer for Mobile Manipulationcited by 21
- 2024A Self-Correcting Vision-Language-Action Model for Fast and Slow System Manipulationcited by 20
- 2025From Experts to a Generalist: Toward General Whole-Body Control for Humanoid Robotscited by 16
- 2026SG-VLA: Learning Spatially-Grounded Vision-Language-Action Models for Mobile Manipulationcited by 8
- 2022World Robot Challenge 2020 -- Partner Robot: A Data-Driven Approach for Room Tidying with Mobile Manipulatorcited by 5
- 2023ImageManip: Image-based Robotic Manipulation with Affordance-guided Next View Selectioncited by 5
15 more
- 2025A Survey of Reinforcement Learning for Optimization in Automationcited by 4
- 2022End-to-end Reinforcement Learning of Robotic Manipulation with Robust Keypoints Representationcited by 2
- 2022Efficient Representations of Object Geometry for Reinforcement Learning of Interactive Grasping Policiescited by 2
- 2023Using Implicit Behavior Cloning and Dynamic Movement Primitive to Facilitate Reinforcement Learning for Robot Motion Planningcited by 2
- 2024Towards Real-World Efficiency: Domain Randomization in Reinforcement Learning for Pre-Capture of Free-Floating Moving Targets by Autonomous Robotscited by 2
- 2024Bayesian optimization for robust robotic grasping using a sensorized compliant handcited by 2
- 2023State Representations as Incentives for Reinforcement Learning Agents: A Sim2Real Analysis on Robotic Graspingcited by 1
- 2022Benchmarking Deep Reinforcement Learning Algorithms for Vision-based Roboticscited by 0
- 2022GloCAL: Glocalized Curriculum-Aided Learning of Multiple Tasks with Application to Robotic Graspingcited by 0
- 2022Enhancing team performance with transfer-learning during real-world human-robot collaborationcited by 0
- 2023Few-Shot Image-to-Semantics Translation for Policy Transfer in Reinforcement Learningcited by 0
- 2023CRC-RL: A Novel Visual Feature Representation Architecture for Unsupervised Reinforcement Learningcited by 0
- 2025Toward Deployable Multi-Robot Collaboration via a Symbolically-Guided Decision Transformercited by 0
- 2025DeGuV: Depth-Guided Visual Reinforcement Learning for Generalization and Interpretability in Manipulationcited by 0
- 2025Taxonomy and Trends in Reinforcement Learning for Robotics and Control Systems: A Structured Reviewcited by 0
- 2026SG-VLA: Learning Spatially-Grounded Vision-Language-Action Models for Mobile Manipulation24 Mar 2026
- 2025Taxonomy and Trends in Reinforcement Learning for Robotics and Control Systems: A Structured Review11 Oct 2025
- 2025DeGuV: Depth-Guided Visual Reinforcement Learning for Generalization and Interpretability in Manipulation5 Sep 2025
- 2025Toward Deployable Multi-Robot Collaboration via a Symbolically-Guided Decision Transformer19 Aug 2025
- 2025AC-DiT: Adaptive Coordination Diffusion Transformer for Mobile Manipulation2 Jul 2025
- 2025From Experts to a Generalist: Toward General Whole-Body Control for Humanoid Robots15 Jun 2025
- 2025CoMo: Learning Continuous Latent Motion from Internet Videos for Scalable Robot Learning22 May 2025
- 2025HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Model13 Mar 2025
- 2025A Survey of Reinforcement Learning for Optimization in Automation13 Feb 2025
- 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulation18 Dec 2024
- 2024Lift3D Foundation Policy: Lifting 2D Large-Scale Pretrained Models for Robust 3D Robotic Manipulation27 Nov 2024
- 2024Bayesian optimization for robust robotic grasping using a sensorized compliant hand23 Oct 2024
15 more
- 2024Towards Real-World Efficiency: Domain Randomization in Reinforcement Learning for Pre-Capture of Free-Floating Moving Targets by Autonomous Robots10 Jun 2024
- 2024RoboMamba: Efficient Vision-Language-Action Model for Robotic Reasoning and Manipulation6 Jun 2024
- 2024A Self-Correcting Vision-Language-Action Model for Fast and Slow System Manipulation27 May 2024
- 2023ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulation24 Dec 2023
- 2023ImageManip: Image-based Robotic Manipulation with Affordance-guided Next View Selection13 Oct 2023
- 2023State Representations as Incentives for Reinforcement Learning Agents: A Sim2Real Analysis on Robotic Grasping21 Sep 2023
- 2023Using Implicit Behavior Cloning and Dynamic Movement Primitive to Facilitate Reinforcement Learning for Robot Motion Planning29 Jul 2023
- 2023CRC-RL: A Novel Visual Feature Representation Architecture for Unsupervised Reinforcement Learning31 Jan 2023
- 2023Few-Shot Image-to-Semantics Translation for Policy Transfer in Reinforcement Learning31 Jan 2023
- 2022Enhancing team performance with transfer-learning during real-world human-robot collaboration23 Nov 2022
- 2022Efficient Representations of Object Geometry for Reinforcement Learning of Interactive Grasping Policies20 Nov 2022
- 2022World Robot Challenge 2020 -- Partner Robot: A Data-Driven Approach for Room Tidying with Mobile Manipulator20 Jul 2022
- 2022GloCAL: Glocalized Curriculum-Aided Learning of Multiple Tasks with Application to Robotic Grasping14 Apr 2022
- 2022End-to-end Reinforcement Learning of Robotic Manipulation with Robust Keypoints Representation12 Feb 2022
- 2022Benchmarking Deep Reinforcement Learning Algorithms for Vision-based Robotics11 Jan 2022
- 2025HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Modelcited by 176
- 2024RoboMamba: Efficient Vision-Language-Action Model for Robotic Reasoning and Manipulationcited by 102
- 2026SG-VLA: Learning Spatially-Grounded Vision-Language-Action Models for Mobile Manipulationcited by 8
- 2026SG-VLA: Learning Spatially-Grounded Vision-Language-Action Models for Mobile Manipulation24 Mar 2026
- 2025HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Model13 Mar 2025
- 2024RoboMamba: Efficient Vision-Language-Action Model for Robotic Reasoning and Manipulation6 Jun 2024
- 2024Lift3D Foundation Policy: Lifting 2D Large-Scale Pretrained Models for Robust 3D Robotic Manipulationcited by 45
- 2025CoMo: Learning Continuous Latent Motion from Internet Videos for Scalable Robot Learningcited by 37
- 2025From Experts to a Generalist: Toward General Whole-Body Control for Humanoid Robotscited by 16
- 2022World Robot Challenge 2020 -- Partner Robot: A Data-Driven Approach for Room Tidying with Mobile Manipulatorcited by 5
- 2023ImageManip: Image-based Robotic Manipulation with Affordance-guided Next View Selectioncited by 5
- 2025A Survey of Reinforcement Learning for Optimization in Automationcited by 4
- 2022End-to-end Reinforcement Learning of Robotic Manipulation with Robust Keypoints Representationcited by 2
- 2022Efficient Representations of Object Geometry for Reinforcement Learning of Interactive Grasping Policiescited by 2
- 2023Using Implicit Behavior Cloning and Dynamic Movement Primitive to Facilitate Reinforcement Learning for Robot Motion Planningcited by 2
- 2024Towards Real-World Efficiency: Domain Randomization in Reinforcement Learning for Pre-Capture of Free-Floating Moving Targets by Autonomous Robotscited by 2
- 2024Bayesian optimization for robust robotic grasping using a sensorized compliant handcited by 2
- 2023State Representations as Incentives for Reinforcement Learning Agents: A Sim2Real Analysis on Robotic Graspingcited by 1
12 most cited of 19 All 19 (JSON)
- 2025Taxonomy and Trends in Reinforcement Learning for Robotics and Control Systems: A Structured Review11 Oct 2025
- 2025DeGuV: Depth-Guided Visual Reinforcement Learning for Generalization and Interpretability in Manipulation5 Sep 2025
- 2025From Experts to a Generalist: Toward General Whole-Body Control for Humanoid Robots15 Jun 2025
- 2025CoMo: Learning Continuous Latent Motion from Internet Videos for Scalable Robot Learning22 May 2025
- 2025A Survey of Reinforcement Learning for Optimization in Automation13 Feb 2025
- 2024Lift3D Foundation Policy: Lifting 2D Large-Scale Pretrained Models for Robust 3D Robotic Manipulation27 Nov 2024
- 2024Bayesian optimization for robust robotic grasping using a sensorized compliant hand23 Oct 2024
- 2024Towards Real-World Efficiency: Domain Randomization in Reinforcement Learning for Pre-Capture of Free-Floating Moving Targets by Autonomous Robots10 Jun 2024
- 2023ImageManip: Image-based Robotic Manipulation with Affordance-guided Next View Selection13 Oct 2023
- 2023State Representations as Incentives for Reinforcement Learning Agents: A Sim2Real Analysis on Robotic Grasping21 Sep 2023
- 2023Using Implicit Behavior Cloning and Dynamic Movement Primitive to Facilitate Reinforcement Learning for Robot Motion Planning29 Jul 2023
- 2023CRC-RL: A Novel Visual Feature Representation Architecture for Unsupervised Reinforcement Learning31 Jan 2023
12 newest of 19 All 19 (JSON)