OXE-AugE: A Large-Scale Robot Augmentation of OXE for Scaling Cross-Embodiment Policy Learning
On the map: Vision-language-action models → Reinforcement learning and post-training
Abstract (arXiv)
Large and diverse datasets are needed for training generalist robot policies that have potential to control a variety of robot embodiments -- robot arm and gripper combinations -- across diverse tasks and environments. As re-collecting demonstrations and retraining for each new hardware platform are prohibitively costly, we show that existing robot data can be augmented for transfer and generalization. The Open X-Embodiment (OXE) dataset, which aggregates demonstrations from over 60 robot datasets, has been widely used as the foundation for training generalist policies. However, it is highly imbalanced: the top four robot types account for over 85% of its real data, which risks overfitting to robot-scene combinations. We present AugE-Toolkit, a scalable robot augmentation pipeline, and OXE-AugE, a high-quality open-source dataset that augments OXE with 9 different robot embodiments. OXE-AugE provides over 4.4 million trajectories, more than triple the size of the original OXE. We conduct a systematic study of how scaling robot augmentation impacts cross-embodiment learning. Results suggest that augmenting datasets with diverse arms and grippers improves policy performance not only on the augmented robots, but also on unseen robots and even the original robots under distribution shifts. In physical experiments, we demonstrate that state-of-the-art generalist policies such as OpenVLA and π0 benefit from fine-tuning on OXE-AugE, improving success rates by 24-45% on previously unseen robot-gripper combinations across four real-world manipulation tasks. Project website: https://OXE-AugE.github.io/.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in Reinforcement learning and post-training, one of 13 directions in Vision-language-action models. Builds on 101 of its 117 references that are in the map. First posted on arXiv 15 Dec 2025.
Builds on
101 of 117 references.
References · 101
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
38 more
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2022A Generalist Agentcited by 802
- 2018QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulationcited by 730
- 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 699
- 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 617
- 2017Sim-to-Real Transfer of Robotic Control with Dynamics Randomizationcited by 616
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
- 2022BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learningcited by 517
- 2020robosuite: A Modular Simulation Framework and Benchmark for Robot Learningcited by 484
- 2022VIMA: General Robot Manipulation with Multimodal Promptscited by 403
- 2016Learning Hand-Eye Coordination for Robotic Grasping with Deep Learning and Large-Scale Data Collectioncited by 312
- 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrationscited by 308
- 2019RoboNet: Large-Scale Multi-Robot Learningcited by 268
- 2021Bridge Data: Boosting Generalization of Robotic Skills with Cross-Domain Datasetscited by 248
- 2018Graph networks as learnable physics engines for inference and controlcited by 242
- 2022Real-World Robot Learning with Masked Visual Pre-trainingcited by 241
- 2022Interactive Language: Talking to Robots in Real Timecited by 217
- 2023Foundation Models in Robotics: Applications, Challenges, and the Futurecited by 212
- 2023ViNT: A Foundation Model for Visual Navigationcited by 210
- 2023Scaling Robot Learning with Semantically Imagined Experiencecited by 175
- 2023RoboAgent: Generalization and Efficiency in Robot Manipulation via Semantic Augmentations and Action Chunkingcited by 167
- 2022GNM: A General Navigation Model to Drive Any Robotcited by 161
- 2024EgoMimic: Scaling Imitation Learning via Egocentric Videocited by 160
- 2022Human-to-Robot Imitation in the Wildcited by 157
- 2023Open-World Object Manipulation using Pre-trained Vision-Language Modelscited by 155
- 2024Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformerscited by 145
- 2024Data Scaling Laws in Imitation Learning for Robotic Manipulationcited by 144
- 2017Using Simulation and Domain Adaptation to Improve Efficiency of Deep Robotic Graspingcited by 138
- 2022VIOLA: Imitation Learning for Vision-Based Manipulation with Object Proposal Priorscited by 135
- 2024Reconciling Reality through Simulation: A Real-to-Sim-to-Real Approach for Robust Manipulationcited by 135
- 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusioncited by 128
- 2020ACRONYM: A Large-Scale Grasp Dataset Based on Simulationcited by 115
- 2020One Policy to Control Them All: Shared Modular Policies for Agent-Agnostic Controlcited by 114
- 2022Towards An End-to-End Framework for Flow-Guided Video Inpaintingcited by 111
- 2023RoboCat: A Self-Improving Generalist Agent for Robotic Manipulationcited by 108
- 2024Scaling Cross-Embodied Learning: One Policy for Manipulation, Navigation, Locomotion and Aviationcited by 108
- 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skillscited by 104
50 most cited of 101 All 101 (JSON)
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learningcited by 94
- 2026Being-H0.5: Scaling Human-Centric Robot Learning for Cross-Embodiment Generalizationcited by 61
- 2026ABot-M0.5: Unified Mobility-and-Manipulation World Action Modelcited by 28
- 2026TTT-VLA: Test-Time Latent Prompt Optimization for Vision-Language-Action Modelscited by 7
- 2026Cloak: Zero-Shot Cross-Embodiment Manipulation by Masking the End-Effector from the VLAcited by 3
- 2026VLAFlow: A Unified Training Framework for Vision-Language-Action Models via Co-training and Future Latent Alignmentcited by 2
- 2026Why Latent Actions Fail, and How to Prevent Itcited by 1
- 2026RoboDream: Compositional World Models for Scalable Robot Data Synthesiscited by 1
- 2026XEWorld: Can Action-Conditioned World Models Generalize to Unseen Robot Embodiments?cited by 0
- 2026The Embodiment Gap in Robot Foundation Modelscited by 0
- 2026The Embodiment Gap in Robot Foundation Models19 Aug 2026
- 2026XEWorld: Can Action-Conditioned World Models Generalize to Unseen Robot Embodiments?6 Aug 2026
- 2026VLAFlow: A Unified Training Framework for Vision-Language-Action Models via Co-training and Future Latent Alignment2 Jul 2026
- 2026ABot-M0.5: Unified Mobility-and-Manipulation World Action Model1 Jul 2026
- 2026Cloak: Zero-Shot Cross-Embodiment Manipulation by Masking the End-Effector from the VLA22 Jun 2026
- 2026TTT-VLA: Test-Time Latent Prompt Optimization for Vision-Language-Action Models2 Jun 2026
- 2026RoboDream: Compositional World Models for Scalable Robot Data Synthesis1 Jun 2026
- 2026Why Latent Actions Fail, and How to Prevent It13 May 2026
- 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learning11 Feb 2026
- 2026Being-H0.5: Scaling Human-Centric Robot Learning for Cross-Embodiment Generalization19 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025Shortcut Learning in Generalist Robot Policies: The Role of Dataset Diversity and Fragmentation
- 2024Octo: An Open-Source Generalist Robot Policy
- 2026CEI: A Unified Interface for Cross-Embodiment Visuomotor Policy Learning in 3D Space
- 2026A Systematic Study of Data Modalities and Strategies for Co-training Large Behavior Models for Robot Manipulation
- 2026Latent Policy Steering: An Efficient and Flexible Framework for Cross-Embodiment Transfer ↗
- 2026RIO: Flexible Real-Time Robot I/O for Cross-Embodiment Robot Learning
- 2026Robots Need More than VLA and World Models
- 2026ArmnetBench v0.1: Parallel Real-World Evaluation of Manipulation Policies on a Low-Cost Arm Farm