mlsanityData to 14 Oct 2026

RoboGene: Boosting VLA Pre-training via Diversity-Driven Agentic Framework for Real-World Task Generation

arXiv 2602.16444 ↗First posted 18 Feb 2026cs.RO cs.AI cs.LGcited by 1

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

The pursuit of general-purpose robotic manipulation is hindered by the scarcity of diverse, real-world interaction data. Unlike data collection from web in vision or language, robotic data collection is an active process incurring prohibitive physical costs. Consequently, automated task curation to maximize data value remains a critical yet under-explored challenge. Existing manual methods are unscalable and biased toward common tasks, while off-the-shelf foundation models often hallucinate physically infeasible instructions. To address this, we introduce RoboGene, an agentic framework designed to automate the generation of diverse, physically plausible manipulation tasks across single-arm, dual-arm, and mobile robots. RoboGene integrates three core components: diversity-driven sampling for broad task coverage, self-reflection mechanisms to enforce physical constraints, and human-in-the-loop refinement for continuous improvement. We conduct extensive quantitative analysis and large-scale real-world experiments, collecting datasets of 18k trajectories and introducing novel metrics to assess task quality, feasibility, and diversity. Results demonstrate that RoboGene significantly outperforms state-of-the-art foundation models (e.g., GPT-4o, Gemini 2.5 Pro). Furthermore, real-world experiments show that VLA models pre-trained with RoboGene achieve higher success rates and superior generalization, underscoring the importance of high-quality task generation. Our project is available at https://robogene-boost-vla.github.io.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 43 of its 60 references that are in the map. First posted on arXiv 18 Feb 2026.

Builds on

43 of 60 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025ManiTaskGen: A Comprehensive Task Generator for Benchmarking and Improving Vision-Language Agents on Embodied Decision-Making27 May

Other references · 42

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2024GPT-4o System Cardcited by 4,588
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  4. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  5. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  6. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
  7. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  8. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  9. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
  10. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
  11. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
  12. 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 783
30 more
  1. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
  2. 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 657
  3. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
  4. 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 410
  5. 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 407
  6. 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 405
  7. 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 339
  8. 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 303
  9. 2021Bridge Data: Boosting Generalization of Robotic Skills with Cross-Domain Datasetscited by 250
  10. 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 218
  11. 2025MolmoAct: Action Reasoning Models that can Reason in Spacecited by 197
  12. 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 175
  13. 2023RoboAgent: Generalization and Efficiency in Robot Manipulation via Semantic Augmentations and Action Chunkingcited by 169
  14. 2023Scaling Up and Distilling Down: Language-Guided Robot Skill Acquisitioncited by 159
  15. 2023GenSim: Generating Robotic Simulation Tasks via Large Language Modelscited by 125
  16. 2024DexMimicGen: Automated Data Generation for Bimanual Dexterous Manipulation via Imitation Learningcited by 116
  17. 2025GR-3 Technical Reportcited by 111
  18. 2024AgentGen: Enhancing Planning Abilities for Large Language Model based Agent via Environment and Task Generationcited by 83
  19. 2025RoboCOIN: An Open-Sourced Bimanual Robotic Data Collection for Integrated Manipulationcited by 78
  20. 2024GenSim2: Scaling Robot Data Generation with Multi-modal and Reasoning LLMscited by 52
  21. 2025RoboMIND 2.0: A Multimodal, Bimanual Mobile Manipulation Dataset for Generalizable Embodied Intelligencecited by 32
  22. 2024Bi-ACT: Bilateral Control-Based Imitation Learning via Action Chunking with Transformercited by 27
  23. 2025Video2Policy: Scaling up Manipulation Tasks in Simulation through Internet Videoscited by 26
  24. 2025MLA: A Multisensory Language-Action Model for Multimodal Understanding and Forecasting in Robotic Manipulationcited by 23
  25. 2024Discrete Policy: Learning Disentangled Action Space for Multi-Task Robotic Manipulationcited by 19
  26. 2025Phoenix: A Motion-based Self-Reflection Framework for Fine-grained Robotic Action Correctioncited by 16
  27. 2025XR-1: Towards Versatile Vision-Language-Action Models via Learning Unified Vision-Motion Representationscited by 15
  28. 2024Learning from Imperfect Demonstrations with Self-Supervision for Robotic Manipulationcited by 14
  29. 2024GRS: Generating Robotic Simulation Tasks from Real-World Imagescited by 13
  30. 2025AnyTask: an Automated Task and Data Generation Framework for Advancing Sim-to-Real Policy Learningcited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2023RoboCat: A Self-Improving Generalist Agent for Robotic Manipulation
  2. 2026AXIS: A Growable Community-Driven Data Engine for Scalable Robot Manipulation
  3. 2026ARSTAG: An Agentic Real2Sim2Real System for Task-Specific Robot Data Generation
  4. 2026AtomVLA: Scalable Post-Training for Robotic Manipulation via Predictive Latent World Models
  5. 2026JoyAI-RA 0.1: A Foundation Model for Robotic Autonomy
  6. 2026RoboEvolve: Co-Evolving Planner-Simulator for Robotic Manipulation with Limited Data
  7. 2026Unleashing More Actions via Action Compositional Training for VLA Models
  8. 2025InternData-A1: Pioneering High-Fidelity Synthetic Data for Pre-training Generalist Policy