ReWeight: Leveraging Human Data for VLA Post-Training via Demonstration Retrieval and Sample Weighting
On the map: Vision-language-action models → Human-video and latent-action pretraining
Abstract (arXiv)
Post-training vision-language-action (VLA) models for specific robots and tasks requires in-domain demonstrations, yet collecting diverse robot data is costly. Egocentric human demonstrations provide a scalable alternative, but directly mixing human and robot data can introduce cross-embodiment discrepancies and degrade policy performance. To address this challenge, we introduce ReWeight, a framework that incorporates human data into VLA post-training through demonstration-level retrieval and sample-level weighting. ReWeight learns a cross-embodiment visuomotor representation that combines visual observations with future actions to measure behavioral similarity between human and robot demonstrations. Based on optimal transport, it retrieves human demonstrations relevant to the target robot data and assigns larger weights to samples with smaller cross-embodiment discrepancies. We evaluate ReWeight using π0.5 across eight simulation tasks and four real-world tasks under both clean and randomized settings. In simulation, ReWeight improves the average success rate of post-trained π0.5 from 39% with only robot data and 44% with randomly mixed human-robot data to 57%. In the physical experimental setting, it achieves an average success rate of 68.8%, outperforming the baselines by 28.8% and 13.8%, respectively. Overall, ReWeight provides an effective paradigm for transforming abundant egocentric human experience into transferable supervision for robot learning. (Project webpage: https://reweight-vla.github.io/)
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Human-video and latent-action pretraining, one of 13 directions in Vision-language-action models. Builds on 15 of its 33 references that are in the map. First posted on arXiv 12 Sep 2026.
Builds on
15 of 33 references.
Closest ancestors · 5
Same direction, newest first
- 2026Being-H0.5: Scaling Human-Centric Robot Learning for Cross-Embodiment Generalization19 Jan
- 2025Emergence of Human to Robot Transfer in Vision-Language-Action Models27 Dec
- 2025Scalable Vision-Language-Action Model Pretraining for Robotic Manipulation with Real-Life Human Activity Videos24 Oct
- 2025Being-H0: Vision-Language-Action Pretraining from Large-Scale Human Videos21 Jul
- 2025EgoVLA: Learning Vision-Language-Action Models from Egocentric Human Videos16 Jul
Other references · 10
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
- 2026EgoVerse: An Egocentric Human Dataset for Robot Learning from Around the Worldcited by 57
- 2025HAND Me the Data: Fast Robot Adaptation via Hand Path Retrievalcited by 10
- 2025Data Retrieval with Importance Weights for Few-Shot Imitation Learningcited by 10
- 2026Rethinking Visual-Language-Action Model Scaling: Alignment, Mixture, and Regularizationcited by 7
- 2026SiMDex: Mining Similar Egocentric Videos for Cross-Embodiment Dexterous Manipulationcited by 3
- 2026Conservative Offline Robot Policy Learning via Posterior-Transition Reweightingcited by 2
- 2025LeVR: A Modular VR Teleoperation Framework for Imitation Learning in Dexterous Manipulationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025MiVLA: Towards Generalizable Vision-Language-Action Model with Human-Robot Mutual Imitation Pre-training
- 2026RoboDrop: Curating VLA Post-Training Data via Local Gradient Compatibility ↗
- 2026Graph-Reweighted Behavior Cloning with Human Interventions for Precise Robotic Manipulation
- 2026VLA-REPLICA: A Low-Cost, Reproducible Benchmark for Real-World Evaluation of Vision-Language-Action Models
- 2026ACE-Ego-0: Unifying Egocentric Human and Robotic Data for VLA Pretraining
- 2025MimicDreamer: Aligning Human and Robot Demonstrations for Scalable VLA Training
- 2026Beyond Data Scaling: Representation-Centric Continued Pre-training for Vision-Language-Action Models
- 2026DyPES-VLA: Learning Shared Dynamics Priors and Embodiment-Specific Control for Cross-Embodiment Manipulation