mlsanityData to 14 Oct 2026

Supervise What Survives: Geometry-Guided VLA Adaptation from Synthetic Robot Videos

arXiv 2606.24448 ↗First posted 23 Jun 2026cs.ROcited by 1

On the map: Vision-language-action models → 3D and spatial-aware VLA

Abstract (arXiv)

Vision-Language-Action (VLA) models require large-scale video-action pairs, yet real teleoperation remains scarce. While generated robot videos offer a scalable alternative, existing methods treat them as real robot data by recovering pseudo-actions from synthesized pixels. We argue that deriving low-level control from generated visuals is a mismatched abstraction. A video captures only geometry: the spatial trajectory representing the where of a task. A real demonstration captures control: the exact motor commands representing the how. Human-to-robot video generation preserves these unequally: the visible geometry survives the generation process, while the underlying control signals are lost. This Asymmetric Preservation Principle dictates a clean rule: this surviving geometry should solely supervise visual perception, leaving control to real demonstrations. Following this principle, we propose GRA (Geometry-guided Representation Alignment), which extracts the geometric content as future 2D end-effector waypoints, computed from the source human video through pose estimation, retargeting, simulation, and calibrated projection, and routes them to the VLA vision backbone via an auxiliary 2D head. The action head is trained on real demonstrations only. During fine-tuning, the waypoint loss persists as a spatial representation anchor that prevents the backbone from losing its geometric grounding. On real-robot tasks, GRA outperforms pseudo-action baselines under matched data budgets and narrows the gap to policies trained with substantially more real demonstrations, suggesting that correctly routed geometry bridges generated videos to robot policies more reliably than recovered actions.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in 3D and spatial-aware VLA, one of 13 directions in Vision-language-action models. Builds on 41 of its 46 references that are in the map. First posted on arXiv 23 Jun 2026.

Builds on

41 of 46 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policy15 Oct
  2. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Model27 Jan

Other references · 39

  1. 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
  2. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  3. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  4. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  5. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  6. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  7. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  8. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  9. 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
  10. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  11. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
  12. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
27 more
  1. 2022R3M: A Universal Visual Representation for Robot Manipulationcited by 694
  2. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
  3. 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 657
  4. 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrationscited by 327
  5. 2024Latent Action Pretraining from Videoscited by 321
  6. 2023Reconstructing Hands in 3D with Transformerscited by 306
  7. 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 289
  8. 2022Real-World Robot Learning with Masked Visual Pre-trainingcited by 245
  9. 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 213
  10. 2025DreamGen: Unlocking Generalization in Robot Learning through Video World Modelscited by 179
  11. 2023Language-Driven Representation Learning for Roboticscited by 165
  12. 2025HAMSTER: Hierarchical Action Models For Open-World Robot Manipulationcited by 130
  13. 2025Being-H0: Vision-Language-Action Pretraining from Large-Scale Human Videoscited by 102
  14. 2025Video Generators are Robot Policiescited by 92
  15. 2025Phantom: Training Robots Without Robots Using Only Human Videoscited by 70
  16. 2025Visual Imitation Enables Contextual Humanoid Controlcited by 68
  17. 2026Qwen-RobotManip Technical Report: Alignment Unlocks Scale for Robotic Manipulation Foundation Modelscited by 50
  18. 2025Masquerade: Learning from In-the-wild Human Videos using Data-Editingcited by 43
  19. 2025Don't Blind Your VLA: Aligning Visual Representations for OOD Generalizationcited by 35
  20. 2025Code2Video: A Code-centric Paradigm for Educational Video Generationcited by 27
  21. 2025MimicDreamer: Aligning Human and Robot Demonstrations for Scalable VLA Trainingcited by 25
  22. 2025EVOLVE-VLA: Test-Time Training from Environment Feedback for Vision-Language-Action Modelscited by 22
  23. 2025Mitty: Diffusion-based Human-to-Robot Video Generationcited by 14
  24. 2025H2R-Grounder: A Paired-Data-Free Paradigm for Translating Human Interaction Videos into Physically Grounded Robot Videoscited by 9
  25. 2025LuciBot: Automated Robot Policy Learning from Generated Videoscited by 4
  26. 2026Escaping the Diversity Trap in Robotic Manipulation via Anchor-Centric Adaptationcited by 4
  27. 2026ActionMap: Robot Policy Learning via Voxel Action Heatmapcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Robotic Manipulation is Vision-to-Geometry Mapping: Vision-Geometry Backbones over Language and Video Models
  2. 2026MotionVLA: Injecting Geometric Motion into Vision-Language-Action Model
  3. 2026A Sim-to-Real Integration Pipeline for Training and Deployment of Chunk-Based VLA Manipulation Policies
  4. 2025mimic-video: Video-Action Models for Generalizable Robot Control Beyond VLAs
  5. 2025Image Generation as a Visual Planner for Robotic Manipulation
  6. 2026From Fixed to Free Cameras: Calibration-Free View-Robust Vision-Language-Action Model
  7. 2026Veo-Act: Enhancing VLA Policies with Frontier Video Models
  8. 2026HABILIS Brain 0: Geometry-Change Supervision for Vision-Language-Action and Residual Flow Recovery