mlsanityData to 14 Oct 2026

Generalized Robot Learning Framework

arXiv 2409.12061 ↗First posted 18 Sep 2024cs.RO cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Imitation based robot learning has recently gained significant attention in the robotics field due to its theoretical potential for transferability and generalizability. However, it remains notoriously costly, both in terms of hardware and data collection, and deploying it in real-world environments demands meticulous setup of robots and precise experimental conditions. In this paper, we present a low-cost robot learning framework that is both easily reproducible and transferable to various robots and environments. We demonstrate that deployable imitation learning can be successfully applied even to industrial-grade robots, not just expensive collaborative robotic arms. Furthermore, our results show that multi-task robot learning is achievable with simple network architectures and fewer demonstrations than previously thought necessary. As the current evaluating method is almost subjective when it comes to real-world manipulation tasks, we propose Voting Positive Rate (VPR) - a novel evaluation strategy that provides a more objective assessment of performance. We conduct an extensive comparison of success rates across various self-designed tasks to validate our approach. To foster collaboration and support the robot learning community, we have open-sourced all relevant datasets and model checkpoints, available at huggingface.co/ZhiChengAI.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 29 references that are in the map. First posted on arXiv 18 Sep 2024.

Builds on

20 of 29 references.

References · 20

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2023GPT-4 Technical Reportcited by 18,396
  5. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  6. 2016Feature Pyramid Networks for Object Detectioncited by 5,036
  7. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  8. 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
  9. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
  10. 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 725
  11. 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 523
  12. 2017Deep Imitation Learning for Complex Manipulation Tasks from Virtual Reality Teleoperationcited by 289
8 more
  1. 2023Language-Driven Representation Learning for Roboticscited by 165
  2. 2021Embodied Intelligence via Learning and Evolutioncited by 163
  3. 2020Learning to Generalize Across Long-Horizon Tasks from Human Demonstrationscited by 115
  4. 2024Scaling Cross-Embodied Learning: One Policy for Manipulation, Navigation, Locomotion and Aviationcited by 114
  5. 2023On Bringing Robots Homecited by 101
  6. 2020Strictly Batch Imitation Learning by Energy-based Distribution Matchingcited by 54
  7. 2020Towards Closing the Sim-to-Real Gap in Collaborative Multi-Robot Deep Reinforcement Learningcited by 6
  8. 2022Imitation Learning for Generalizable Self-driving Policy with Sim-to-real Transfercited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2022BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learning
  2. 2025RoboManipBaselines: A Unified Framework for Imitation Learning in Robotic Manipulation across Real and Simulation Environments
  3. 2024Offline Imitation Learning Through Graph Search and Retrieval
  4. 2025Robotic Manipulation via Imitation Learning: Taxonomy, Evolution, Benchmark, and Challenges
  5. 2021AW-Opt: Learning Robotic Skills with Imitation and Reinforcement at Scale
  6. 2022Learning and Retrieval from Prior Data for Skill-based Imitation Learning
  7. 2024Learning from 10 Demos: Generalisable and Sample-Efficient Policy Learning with Oriented Affordance Frames
  8. 2020Scalable Multi-Task Imitation Learning with Autonomous Improvement