mlsanityData to 7 Oct 2026

HABILIS Brain 0: Geometry-Change Supervision for Vision-Language-Action and Residual Flow Recovery

arXiv 2609.25558 ↗First posted 22 Sep 2026cs.RO cs.LGcited by 0

On the map: Vision-language-action models → 3D and spatial-aware VLA

Abstract (arXiv)

Vision-language-action policies benefit from geometric supervision, but current-frame geometry alone does not explicitly describe the changes associated with manipulation. This design is motivated by the goal of learning an embodiment-agnostic visual interface that can be pretrained across robot and egocentric video before robot-specific action alignment. We introduce Geometry-Change VLA (GC-VLA), which learns to predict multiview future-current geometry-change tokens from current observations. Offline frame pairs define a nominal 0.5-second prediction horizon; future observations are used only to construct training targets. Stage 1 trains a geometry-change vision-language model (GC-VLM). Stage 2 introduces a continuous ActionExpert and aligns it with robot actions while stopping action-flow gradients at the VLM interface. Stage 3 enables these gradients to update the trainable VLM components jointly with the ActionExpert. Stage 4 freezes GC-VLA and applies Geometry-Conditioned Residual Flow (GCRF), using a binary intervention router and a single bounded residual velocity policy learned from closed-loop feedback. GC-VLA achieves 95.20% success on LIBERO, and GC-VLA with GCRF achieves 99.55%. Inference uses current observations and the learned GC representation without executing the offline target encoders.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in 3D and spatial-aware VLA, one of 13 directions in Vision-language-action models. Builds on 36 of its 37 references that are in the map. First posted on arXiv 22 Sep 2026.

Builds on

36 of 37 references.

References · 36

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  2. 2022Flow Matching for Generative Modelingcited by 5,426
  3. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  4. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  5. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  6. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  7. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  8. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  9. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
  10. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  11. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
  12. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
24 more
  1. 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
  2. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 274
  3. 2018Residual Reinforcement Learning for Robot Controlcited by 242
  4. 2025LIBERO-PRO: Towards Robust and Fair Evaluation of Vision-Language-Action Models Beyond Memorizationcited by 166
  5. 2023HoloAssist: an Egocentric Human Interaction Dataset for Interactive AI Assistants in the Real Worldcited by 159
  6. 2020Recovery RL: Safe Reinforcement Learning with Learned Recovery Zonescited by 156
  7. 2025SimpleVLA-RL: Scaling VLA Training via Reinforcement Learningcited by 141
  8. 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Modelcited by 140
  9. 2025FLARE: Robot Learning with Implicit World Modelingcited by 105
  10. 2023Guided Flows for Generative Modeling and Decision Makingcited by 99
  11. 2024FlowPolicy: Enabling Fast and Robust 3D Flow-based Policy via Consistency Flow Matching for Robot Manipulationcited by 99
  12. 2024FMB: a Functional Manipulation Benchmark for Generalizable Robotic Learningcited by 79
  13. 2025VideoVLA: Video Generators Can Be Generalizable Robot Manipulatorscited by 61
  14. 2026Being-H0.5: Scaling Human-Centric Robot Learning for Cross-Embodiment Generalizationcited by 61
  15. 2026Xiaomi-Robotics-0: An Open-Sourced Vision-Language-Action Model with Real-Time Executioncited by 42
  16. 2026ABot-M0.5: Unified Mobility-and-Manipulation World Action Modelcited by 28
  17. 2025RLinf-VLA: A Unified and Efficient Framework for Reinforcement Learning of Vision-Language-Action Modelscited by 26
  18. 2025SRPO: Self-Referential Policy Optimization for Vision-Language-Action Modelscited by 25
  19. 2026Hy-Embodied-0.5-VLA: From Vision-Language-Action Models to a Real-World Robot Learning Stackcited by 20
  20. 2026RFS: Reinforcement Learning with Residual Flow Steering for Dexterous Manipulationcited by 10
  21. 2026SimVLA: A Simple VLA Baseline for Robotic Manipulationcited by 10
  22. 2026Intercepting the Future: Latent-Space Predictive World Model for Dynamic VLA Manipulationcited by 9
  23. 2026HABIT: Human-Aware Behavior and Interaction Training Dataset for Robot Manipulationcited by 4
  24. 2026PhysBrain 1.0 Technical Reportcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026GeoBridge-VLA: Geometry-Aware Residual Adaptation for Vision-Language-Action Models
  2. 2026FOCAL-VLA: Subtask-Guided Geometry Distillation and Implicit World Modeling for Vision-Language-Action Models
  3. 2026G3VLA: Geometric inductive bias for Vision-Language-Action Models
  4. 2026GEAR-VLA: Learning Geometry-Aware Action Representations for Generalizable Robotic Manipulation
  5. 2026Two Bridges, One Pathway: From VLMs to Generalizable VLAs with Embodied Trajectory-Coupled Data
  6. 2026PriorVLA: Prior-Preserving Adaptation for Vision-Language-Action Models
  7. 2026MotionVLA: Injecting Geometric Motion into Vision-Language-Action Model
  8. 2025Spatial-Aware VLA Pretraining through Visual-Physical Alignment from Human Videos