A Review of Robot Learning for Manipulation: Challenges, Representations, and Algorithms
Not on the map. Why?
Cited by 22 in Offline RL and imitation learning from data, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
A key challenge in intelligent robotics is creating robots that are capable of directly interacting with the world around them to achieve their goals. The last decade has seen substantial growth in research on the problem of robot manipulation, which aims to exploit the increasing availability of affordable robot arms and grippers to create robots capable of directly interacting with the world to achieve their goals. Learning will be central to such autonomous systems, as the real world contains too much variation for a robot to expect to have an accurate model of its environment, the objects in it, or the skills required to manipulate them, in advance. We aim to survey a representative subset of that research which uses machine learning for manipulation. We describe a formalization of the robot manipulation learning problem that synthesizes existing research into a single coherent framework and highlight the many remaining research opportunities and challenges.
Key facts. Cited by 136 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 2; 2020: 2; 2021: 10; 2022: 17; 2023: 18; 2024: 28; 2025: 32; 2026: 27.
136 papers.
Sort:
By area:
- 2021How to Train Your Robot with Deep Reinforcement Learning; Lessons We've Learnedcited by 201
- 2024Deep Reinforcement Learning for Robotics: A Survey of Real-World Successescited by 153
- 2025SimpleVLA-RL: Scaling VLA Training via Reinforcement Learningcited by 141
- 2021ThriftyDAgger: Budget-Aware Novelty and Risk Gating for Interactive Imitation Learningcited by 98
- 2022DexPoint: Generalizable Point Cloud Reinforcement Learning for Sim-to-Real Dexterous Manipulationcited by 78
- 2024Exploring the Adversarial Vulnerabilities of Vision-Language-Action Models in Roboticscited by 68
- 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Surveycited by 66
- 2022See, Hear, and Feel: Smart Sensory Fusion for Robotic Manipulationcited by 61
- 2024Point Cloud Matters: Rethinking the Impact of Different Observation Spaces on Robot Learningcited by 45
- 2021Articulated Object Interaction in Unknown Scenes with Whole-Body Mobile Manipulationcited by 44
- 2023Chat with the Environment: Interactive Multimodal Perception Using Large Language Modelscited by 42
- 2025Reflective Planning: Vision-Language Models for Multi-Stage Long-Horizon Robotic Manipulationcited by 40
38 more
- 2020The EMPATHIC Framework for Task Learning from Implicit Human Feedbackcited by 38
- 2023Stabilize to Act: Learning to Coordinate for Bimanual Manipulationcited by 36
- 2024A Survey of Embodied Learning for Object-Centric Robotic Manipulationcited by 34
- 2025MAP-VLA: Memory-Augmented Prompting for Vision-Language-Action Model in Robotic Manipulationcited by 28
- 2022A System for Imitation Learning of Contact-Rich Bimanual Manipulation Policiescited by 26
- 2024Autoregressive Action Sequence Learning for Robotic Manipulationcited by 26
- 2023Differentially Private Attention Computationcited by 25
- 2024Ag2Manip: Learning Novel Manipulation Skills with Agent-Agnostic Visual and Action Representationscited by 23
- 2020Residual Learning from Demonstration: Adapting DMPs for Contact-rich Manipulationcited by 22
- 2022L2C2: Locally Lipschitz Continuous Constraint towards Stable and Smooth Reinforcement Learningcited by 22
- 2022Toward Compositional Generalization in Object-Oriented World Modelingcited by 22
- 2021Vision-driven Compliant Manipulation for Reliable, High-Precision Assembly Taskscited by 18
- 2022Real World Offline Reinforcement Learning with Realistic Data Sourcecited by 16
- 2021Zero-shot Task Adaptation using Natural Languagecited by 15
- 2025Vidarc: Embodied Video Diffusion Model for Closed-loop Controlcited by 15
- 2023A Human-Centered Safe Robot Reinforcement Learning Framework with Interactive Behaviorscited by 13
- 2023FastRLAP: A System for Learning High-Speed Driving via Deep RL and Autonomous Practicingcited by 13
- 2024SAFE-GIL: SAFEty Guided Imitation Learning for Robotic Systemscited by 13
- 2024Learning Variable Compliance Control From a Few Demonstrations for Bimanual Robot with Haptic Feedback Teleoperation Systemcited by 13
- 2025Touch begins where vision ends: Generalizable policies for contact-rich manipulationcited by 13
- 2025A Survey on Imitation Learning for Contact-Rich Tasks in Roboticscited by 12
- 2025InstaScene: Towards Complete 3D Instance Decomposition and Reconstruction from Cluttered Scenescited by 11
- 2021Learning to Infer Kinematic Hierarchies for Novel Object Instancescited by 10
- 2024Learning by Watching: A Review of Video-based Learning Approaches for Robot Manipulationcited by 10
- 2024Large Language Models for Orchestrating Bimanual Robotscited by 10
- 2025SeqVLA: Sequential Task Execution for Long-Horizon Manipulation with Completion-Aware Vision-Language-Action Modelcited by 10
- 2022Active Exploration for Robotic Manipulationcited by 9
- 2023Decision Making for Human-in-the-loop Robotic Agents via Uncertainty-Aware Reinforcement Learningcited by 9
- 2023ArrayBot: Reinforcement Learning for Generalizable Distributed Manipulation through Touchcited by 9
- 2024GenCHiP: Generating Robot Policy Code for High-Precision and Contact-Rich Manipulation Taskscited by 9
- 2025Dexplore: Scalable Neural Control for Dexterous Manipulation from Reference-Scoped Explorationcited by 9
- 2024RecoveryChaining: Learning Local Recovery Policies for Robust Manipulationcited by 8
- 2024Video2Reward: Generating Reward Function from Videos for Legged Robot Behavior Learningcited by 8
- 2025Grounding Actions in Camera Space: Observation-Centric Vision-Language-Action Policycited by 8
- 2025Score the Steps, Not Just the Goal: VLM-Based Subgoal Evaluation for Robotic Manipulationcited by 8
- 2025Guardian: Detecting Robotic Planning and Execution Errors with Vision-Language Modelscited by 8
- 2019Benchmark for Skill Learning from Demonstration: Impact of User Experience, Task Complexity, and Start Configuration on Performancecited by 7
- 2024HYPERmotion: Learning Hybrid Behavior Planning for Autonomous Loco-manipulationcited by 7
50 most cited of 136 All 136 (JSON)
- 2026What to Attend, What to Keep: Skill-Conditioned Visuotactile Representation with Progress-Guided Event Memory29 Sep 2026
- 2026Generative Action-Chunk Sampling for Adaptive Stiffness Control in Physical Human-Robot Collaboration26 Aug 2026
- 2026Bimanual Manipulation Within an 8 GB Budget: Zero-Copy Sensing and Quantized ACT on an Entry-Level Jetson4 Aug 2026
- 2026ConceptTree: Bringing Semantic Transparency to Black-Box Decision Making for Robotic Manipulation20 Jul 2026
- 2026Robustness of Robotic Manipulation: Foundations and Frontiers30 Jun 2026
- 2026Learning Cross-View Semantic Priors for Single-Reference Unseen Object Pose Estimation20 Jun 2026
- 2026ReGIL: Retrieval-Guided Imitation Learning from a Single Demonstration8 Jun 2026
- 2026Efficient Skill Grounding via Code Refactoring with Small Language Models6 Jun 2026
- 2026Closed-Loop Neural Activation Control in Vision-Language-Action Models29 May 2026
- 2026DyGRO-VLA: Cross-Task Scaling of Vision-Language-Action Models via Dynamic Grouped Residual Optimization17 May 2026
- 2026SADP: Subgoal-Aware Diffusion Policy for Long-Horizon Manipulation Learned from Foundation Model Generated Demonstrations16 May 2026
- 2026VEGA: Visual Encoder Grounding Alignment for Spatially-Aware Vision-Language-Action Models11 May 2026
38 more
- 2026Creative Robot Tool Use by Counterfactual Reasoning6 May 2026
- 2026QDTraj: Exploration of Diverse Trajectory Primitives for Articulated Objects Robotic Manipulation24 Apr 2026
- 2026Binomial Gradient-Based Meta-Learning for Enhanced Meta-Gradient Estimation14 Apr 2026
- 2026AnyUser: Translating Sketched User Intent into Domestic Robots6 Apr 2026
- 2026StageCraft: Execution Aware Mitigation of Distractor and Obstruction Failures in VLA Models21 Mar 2026
- 2026Offload or Overload: A Platform Measurement Study of Mobile Robotic Manipulation Workloads18 Mar 2026
- 2026VPWEM: Non-Markovian Visuomotor Policy with Working and Episodic Memory5 Mar 2026
- 2026Bi-HIL: Bilateral Control-Based Multimodal Hierarchical Imitation Learning via Subtask-Level Progress Rate and Keyframe Memory for Long-Horizon Contact-Rich Robotic Manipulation4 Mar 2026
- 2026Capability Thresholds and Manufacturing Topology: How Embodied Intelligence Triggers Phase Transitions in Economic Geography3 Mar 2026
- 2026Seeing Farther and Smarter: Value-Guided Multi-Path Reflection for VLM Policy Optimization22 Feb 2026
- 2026Revisiting Regularized Policy Optimization for Stable and Efficient Reinforcement Learning in Two-Player Games11 Feb 2026
- 2026Scalable Dexterous Robot Learning with AR-based Remote Human-Robot Interactions7 Feb 2026
- 2026VLM-Guided Experience Replay2 Feb 2026
- 2026E2HiL: Entropy-Guided Sample Selection for Efficient Real-World Human-in-the-Loop Reinforcement Learning27 Jan 2026
- 2026Boosting Deep Reinforcement Learning with Semantic Knowledge for Robotic Manipulators23 Jan 2026
- 2025Vidarc: Embodied Video Diffusion Model for Closed-loop Control19 Dec 2025
- 2025Embodied Co-Design for Rapidly Evolving Agents: Taxonomy, Frontiers, and Challenges4 Dec 2025
- 2025Guardian: Detecting Robotic Planning and Execution Errors with Vision-Language Models1 Dec 2025
- 2025Constant-Time Planning for Chaining Collision-free Motion to Manipulation Behaviors30 Nov 2025
- 2025Eq.Bot: Enhance Robotic Manipulation Learning via Group Equivariant Canonicalization19 Nov 2025
- 2025MAP-VLA: Memory-Augmented Prompting for Vision-Language-Action Model in Robotic Manipulation12 Nov 2025
- 2025Intuitive Programming, Adaptive Task Planning, and Dynamic Role Allocation in Human-Robot Collaboration11 Nov 2025
- 2025Score the Steps, Not Just the Goal: VLM-Based Subgoal Evaluation for Robotic Manipulation23 Sep 2025
- 2025SeqVLA: Sequential Task Execution for Long-Horizon Manipulation with Completion-Aware Vision-Language-Action Model17 Sep 2025
- 2025SimpleVLA-RL: Scaling VLA Training via Reinforcement Learning11 Sep 2025
- 2025Dexplore: Scalable Neural Control for Dexterous Manipulation from Reference-Scoped Exploration11 Sep 2025
- 2025Robotic Manipulation via Imitation Learning: Taxonomy, Evolution, Benchmark, and Challenges24 Aug 2025
- 2025Grounding Actions in Camera Space: Observation-Centric Vision-Language-Action Policy18 Aug 2025
- 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Survey18 Aug 2025
- 2025AR-VRM: Imitating Human Motions for Visual Robot Manipulation with Analogical Reasoning11 Aug 2025
- 2025Discovering and using Spelke segments21 Jul 2025
- 2025InstaScene: Towards Complete 3D Instance Decomposition and Reconstruction from Cluttered Scenes11 Jul 2025
- 2025Ark: An Open-source Python-based Framework for Robot Learning24 Jun 2025
- 2025Is an object-centric representation beneficial for robotic manipulation ?24 Jun 2025
- 2025Touch begins where vision ends: Generalizable policies for contact-rich manipulation16 Jun 2025
- 2025A Survey on Imitation Learning for Contact-Rich Tasks in Robotics16 Jun 2025
- 2025Few-Shot Test-Time Optimization Without Retraining for Semiconductor Recipe Generation and Beyond21 May 2025
- 2025Object-Centric Representations Improve Policy Generalization in Robot Manipulation16 May 2025
50 newest of 136 All 136 (JSON)
- 2021ThriftyDAgger: Budget-Aware Novelty and Risk Gating for Interactive Imitation Learningcited by 98
- 2022A System for Imitation Learning of Contact-Rich Bimanual Manipulation Policiescited by 26
- 2020Residual Learning from Demonstration: Adapting DMPs for Contact-rich Manipulationcited by 22
- 2022Real World Offline Reinforcement Learning with Realistic Data Sourcecited by 16
- 2021Zero-shot Task Adaptation using Natural Languagecited by 15
- 2024SAFE-GIL: SAFEty Guided Imitation Learning for Robotic Systemscited by 13
- 2025Touch begins where vision ends: Generalizable policies for contact-rich manipulationcited by 13
- 2025A Survey on Imitation Learning for Contact-Rich Tasks in Roboticscited by 12
- 2019Benchmark for Skill Learning from Demonstration: Impact of User Experience, Task Complexity, and Start Configuration on Performancecited by 7
- 2019Better-than-Demonstrator Imitation Learning via Automatically-Ranked Demonstrationscited by 5
- 2023DOMAIN: MilDly COnservative Model-BAsed OfflINe Reinforcement Learningcited by 4
- 2025On the Importance of Tactile Sensing for Imitation Learning: A Case Study on Robotic Match Lightingcited by 4
12 most cited of 20 All 20 (JSON)
- 2026ReGIL: Retrieval-Guided Imitation Learning from a Single Demonstration8 Jun 2026
- 2026Bi-HIL: Bilateral Control-Based Multimodal Hierarchical Imitation Learning via Subtask-Level Progress Rate and Keyframe Memory for Long-Horizon Contact-Rich Robotic Manipulation4 Mar 2026
- 2025Robotic Manipulation via Imitation Learning: Taxonomy, Evolution, Benchmark, and Challenges24 Aug 2025
- 2025Touch begins where vision ends: Generalizable policies for contact-rich manipulation16 Jun 2025
- 2025A Survey on Imitation Learning for Contact-Rich Tasks in Robotics16 Jun 2025
- 2025On the Importance of Tactile Sensing for Imitation Learning: A Case Study on Robotic Match Lighting18 Apr 2025
- 2025Online Imitation Learning for Manipulation via Decaying Relative Correction through Teleoperation19 Mar 2025
- 2024Problem Space Transformations for Out-of-Distribution Generalisation in Behavioural Cloning6 Nov 2024
- 2024SAFE-GIL: SAFEty Guided Imitation Learning for Robotic Systems8 Apr 2024
- 2024Conditional Neural Expert Processes for Learning Movement Primitives from Demonstration13 Feb 2024
- 2023DOMAIN: MilDly COnservative Model-BAsed OfflINe Reinforcement Learning16 Sep 2023
- 2023Decoupling Skill Learning from Robotic Control for Generalizable Object Manipulation7 Mar 2023
12 newest of 20 All 20 (JSON)
- 2025SimpleVLA-RL: Scaling VLA Training via Reinforcement Learningcited by 141
- 2024Exploring the Adversarial Vulnerabilities of Vision-Language-Action Models in Roboticscited by 68
- 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Surveycited by 66
- 2025MAP-VLA: Memory-Augmented Prompting for Vision-Language-Action Model in Robotic Manipulationcited by 28
- 2025SeqVLA: Sequential Task Execution for Long-Horizon Manipulation with Completion-Aware Vision-Language-Action Modelcited by 10
- 2025Grounding Actions in Camera Space: Observation-Centric Vision-Language-Action Policycited by 8
- 2026DyGRO-VLA: Cross-Task Scaling of Vision-Language-Action Models via Dynamic Grouped Residual Optimizationcited by 2
- 2026StageCraft: Execution Aware Mitigation of Distractor and Obstruction Failures in VLA Modelscited by 0
- 2026Closed-Loop Neural Activation Control in Vision-Language-Action Modelscited by 0
- 2026Closed-Loop Neural Activation Control in Vision-Language-Action Models29 May 2026
- 2026DyGRO-VLA: Cross-Task Scaling of Vision-Language-Action Models via Dynamic Grouped Residual Optimization17 May 2026
- 2026StageCraft: Execution Aware Mitigation of Distractor and Obstruction Failures in VLA Models21 Mar 2026
- 2025MAP-VLA: Memory-Augmented Prompting for Vision-Language-Action Model in Robotic Manipulation12 Nov 2025
- 2025SeqVLA: Sequential Task Execution for Long-Horizon Manipulation with Completion-Aware Vision-Language-Action Model17 Sep 2025
- 2025SimpleVLA-RL: Scaling VLA Training via Reinforcement Learning11 Sep 2025
- 2025Grounding Actions in Camera Space: Observation-Centric Vision-Language-Action Policy18 Aug 2025
- 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Survey18 Aug 2025
- 2024Exploring the Adversarial Vulnerabilities of Vision-Language-Action Models in Robotics18 Nov 2024
- 2025Vidarc: Embodied Video Diffusion Model for Closed-loop Controlcited by 15
- 2026VPWEM: Non-Markovian Visuomotor Policy with Working and Episodic Memorycited by 6
- 2026SADP: Subgoal-Aware Diffusion Policy for Long-Horizon Manipulation Learned from Foundation Model Generated Demonstrationscited by 1
- 2026Bimanual Manipulation Within an 8 GB Budget: Zero-Copy Sensing and Quantized ACT on an Entry-Level Jetsoncited by 0
- 2026Bimanual Manipulation Within an 8 GB Budget: Zero-Copy Sensing and Quantized ACT on an Entry-Level Jetson4 Aug 2026
- 2026SADP: Subgoal-Aware Diffusion Policy for Long-Horizon Manipulation Learned from Foundation Model Generated Demonstrations16 May 2026
- 2026VPWEM: Non-Markovian Visuomotor Policy with Working and Episodic Memory5 Mar 2026
- 2025Vidarc: Embodied Video Diffusion Model for Closed-loop Control19 Dec 2025
- 2025AR-VRM: Imitating Human Motions for Visual Robot Manipulation with Analogical Reasoningcited by 5
- 2026VEGA: Visual Encoder Grounding Alignment for Spatially-Aware Vision-Language-Action Modelscited by 2
- 2026VLM-Guided Experience Replaycited by 0
- 2026Creative Robot Tool Use by Counterfactual Reasoningcited by 0
- 2026VEGA: Visual Encoder Grounding Alignment for Spatially-Aware Vision-Language-Action Models11 May 2026
- 2026Creative Robot Tool Use by Counterfactual Reasoning6 May 2026
- 2026VLM-Guided Experience Replay2 Feb 2026
- 2025AR-VRM: Imitating Human Motions for Visual Robot Manipulation with Analogical Reasoning11 Aug 2025
- 2021How to Train Your Robot with Deep Reinforcement Learning; Lessons We've Learnedcited by 201
- 2024Deep Reinforcement Learning for Robotics: A Survey of Real-World Successescited by 153
- 2022DexPoint: Generalizable Point Cloud Reinforcement Learning for Sim-to-Real Dexterous Manipulationcited by 78
- 2022See, Hear, and Feel: Smart Sensory Fusion for Robotic Manipulationcited by 61
- 2024Point Cloud Matters: Rethinking the Impact of Different Observation Spaces on Robot Learningcited by 45
- 2021Articulated Object Interaction in Unknown Scenes with Whole-Body Mobile Manipulationcited by 44
- 2023Chat with the Environment: Interactive Multimodal Perception Using Large Language Modelscited by 42
- 2023Stabilize to Act: Learning to Coordinate for Bimanual Manipulationcited by 36
- 2024A Survey of Embodied Learning for Object-Centric Robotic Manipulationcited by 34
- 2024Autoregressive Action Sequence Learning for Robotic Manipulationcited by 26
- 2023Differentially Private Attention Computationcited by 25
- 2024Ag2Manip: Learning Novel Manipulation Skills with Agent-Agnostic Visual and Action Representationscited by 23
12 most cited of 93 All 93 (JSON)
- 2026What to Attend, What to Keep: Skill-Conditioned Visuotactile Representation with Progress-Guided Event Memory29 Sep 2026
- 2026Generative Action-Chunk Sampling for Adaptive Stiffness Control in Physical Human-Robot Collaboration26 Aug 2026
- 2026ConceptTree: Bringing Semantic Transparency to Black-Box Decision Making for Robotic Manipulation20 Jul 2026
- 2026Robustness of Robotic Manipulation: Foundations and Frontiers30 Jun 2026
- 2026Learning Cross-View Semantic Priors for Single-Reference Unseen Object Pose Estimation20 Jun 2026
- 2026Efficient Skill Grounding via Code Refactoring with Small Language Models6 Jun 2026
- 2026QDTraj: Exploration of Diverse Trajectory Primitives for Articulated Objects Robotic Manipulation24 Apr 2026
- 2026Binomial Gradient-Based Meta-Learning for Enhanced Meta-Gradient Estimation14 Apr 2026
- 2026AnyUser: Translating Sketched User Intent into Domestic Robots6 Apr 2026
- 2026Offload or Overload: A Platform Measurement Study of Mobile Robotic Manipulation Workloads18 Mar 2026
- 2026Capability Thresholds and Manufacturing Topology: How Embodied Intelligence Triggers Phase Transitions in Economic Geography3 Mar 2026
- 2026Seeing Farther and Smarter: Value-Guided Multi-Path Reflection for VLM Policy Optimization22 Feb 2026
12 newest of 93 All 93 (JSON)