RoboGene: Boosting VLA Pre-training via Diversity-Driven Agentic Framework for Real-World Task Generation
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
The pursuit of general-purpose robotic manipulation is hindered by the scarcity of diverse, real-world interaction data. Unlike data collection from web in vision or language, robotic data collection is an active process incurring prohibitive physical costs. Consequently, automated task curation to maximize data value remains a critical yet under-explored challenge. Existing manual methods are unscalable and biased toward common tasks, while off-the-shelf foundation models often hallucinate physically infeasible instructions. To address this, we introduce RoboGene, an agentic framework designed to automate the generation of diverse, physically plausible manipulation tasks across single-arm, dual-arm, and mobile robots. RoboGene integrates three core components: diversity-driven sampling for broad task coverage, self-reflection mechanisms to enforce physical constraints, and human-in-the-loop refinement for continuous improvement. We conduct extensive quantitative analysis and large-scale real-world experiments, collecting datasets of 18k trajectories and introducing novel metrics to assess task quality, feasibility, and diversity. Results demonstrate that RoboGene significantly outperforms state-of-the-art foundation models (e.g., GPT-4o, Gemini 2.5 Pro). Furthermore, real-world experiments show that VLA models pre-trained with RoboGene achieve higher success rates and superior generalization, underscoring the importance of high-quality task generation. Our project is available at https://robogene-boost-vla.github.io.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 43 of its 60 references that are in the map. First posted on arXiv 18 Feb 2026.
Builds on
43 of 60 references.
Closest ancestors · 1
Same direction, newest first
Other references · 42
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2024GPT-4o System Cardcited by 4,588
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
- 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 783
30 more
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 657
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 410
- 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 407
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 405
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 339
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 303
- 2021Bridge Data: Boosting Generalization of Robotic Skills with Cross-Domain Datasetscited by 250
- 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 218
- 2025MolmoAct: Action Reasoning Models that can Reason in Spacecited by 197
- 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 175
- 2023RoboAgent: Generalization and Efficiency in Robot Manipulation via Semantic Augmentations and Action Chunkingcited by 169
- 2023Scaling Up and Distilling Down: Language-Guided Robot Skill Acquisitioncited by 159
- 2023GenSim: Generating Robotic Simulation Tasks via Large Language Modelscited by 125
- 2024DexMimicGen: Automated Data Generation for Bimanual Dexterous Manipulation via Imitation Learningcited by 116
- 2025GR-3 Technical Reportcited by 111
- 2024AgentGen: Enhancing Planning Abilities for Large Language Model based Agent via Environment and Task Generationcited by 83
- 2025RoboCOIN: An Open-Sourced Bimanual Robotic Data Collection for Integrated Manipulationcited by 78
- 2024GenSim2: Scaling Robot Data Generation with Multi-modal and Reasoning LLMscited by 52
- 2025RoboMIND 2.0: A Multimodal, Bimanual Mobile Manipulation Dataset for Generalizable Embodied Intelligencecited by 32
- 2024Bi-ACT: Bilateral Control-Based Imitation Learning via Action Chunking with Transformercited by 27
- 2025Video2Policy: Scaling up Manipulation Tasks in Simulation through Internet Videoscited by 26
- 2025MLA: A Multisensory Language-Action Model for Multimodal Understanding and Forecasting in Robotic Manipulationcited by 23
- 2024Discrete Policy: Learning Disentangled Action Space for Multi-Task Robotic Manipulationcited by 19
- 2025Phoenix: A Motion-based Self-Reflection Framework for Fine-grained Robotic Action Correctioncited by 16
- 2025XR-1: Towards Versatile Vision-Language-Action Models via Learning Unified Vision-Motion Representationscited by 15
- 2024Learning from Imperfect Demonstrations with Self-Supervision for Robotic Manipulationcited by 14
- 2024GRS: Generating Robotic Simulation Tasks from Real-World Imagescited by 13
- 2025AnyTask: an Automated Task and Data Generation Framework for Advancing Sim-to-Real Policy Learningcited by 8
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2023RoboCat: A Self-Improving Generalist Agent for Robotic Manipulation
- 2026AXIS: A Growable Community-Driven Data Engine for Scalable Robot Manipulation
- 2026ARSTAG: An Agentic Real2Sim2Real System for Task-Specific Robot Data Generation
- 2026AtomVLA: Scalable Post-Training for Robotic Manipulation via Predictive Latent World Models
- 2026JoyAI-RA 0.1: A Foundation Model for Robotic Autonomy
- 2026RoboEvolve: Co-Evolving Planner-Simulator for Robotic Manipulation with Limited Data
- 2026Unleashing More Actions via Action Compositional Training for VLA Models
- 2025InternData-A1: Pioneering High-Fidelity Synthetic Data for Pre-training Generalist Policy