mlsanityData to 14 Oct 2026

ARO: Large Language Model Supervised Robotics Text2Skill Autonomous Learning

arXiv 2403.15834 ↗First posted 23 Mar 2024cs.RO cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Robotics learning highly relies on human expertise and efforts, such as demonstrations, design of reward functions in reinforcement learning, performance evaluation using human feedback, etc. However, reliance on human assistance can lead to expensive learning costs and make skill learning difficult to scale. In this work, we introduce the Large Language Model Supervised Robotics Text2Skill Autonomous Learning (ARO) framework, which aims to replace human participation in the robot skill learning process with large-scale language models that incorporate reward function design and performance evaluation. We provide evidence that our approach enables fully autonomous robot skill learning, capable of completing partial tasks without human intervention. Furthermore, we also analyze the limitations of this approach in task understanding and optimization stability.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 15 references that are in the map. First posted on arXiv 23 Mar 2024.

Builds on

13 of 15 references.

References · 13

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  3. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  4. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
  5. 2016OpenAI Gymcited by 1,736
  6. 2018Soft Actor-Critic Algorithms and Applicationscited by 1,240
  7. 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 611
  8. 2023Eureka: Human-Level Reward Design via Coding Large Language Modelscited by 571
  9. 2023Language to Rewards for Robotic Skill Synthesiscited by 312
  10. 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 218
  11. 2019Soft Actor-Critic for Discrete Action Settingscited by 174
  12. 2023Text2Reward: Reward Shaping with Language Models for Reinforcement Learningcited by 160
1 more
  1. 2023Self-Refined Large Language Model as Automated Reward Function Designer for Deep Reinforcement Learning in Roboticscited by 36

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Towards Autonomous Reinforcement Learning for Real-World Robotic Manipulation with Large Language Models
  2. 2024Learning Reward for Robot Skills Using Large Language Models via Self-Alignment
  3. 2025Automated Hybrid Reward Scheduling via Large Language Models for Robotic Skill Learning
  4. 2023Conditionally Combining Robot Skills using Large Language Models
  5. 2025LAPP: Large Language Model Feedback for Preference-Driven Reinforcement Learning
  6. 2024Video-Language Critic: Transferable Reward Functions for Language-Conditioned Robotics
  7. 2024Efficient Language-instructed Skill Acquisition via Reward-Policy Co-Evolution
  8. 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Tasks