HABILIS Brain 0: Geometry-Change Supervision for Vision-Language-Action and Residual Flow Recovery
On the map: Vision-language-action models → 3D and spatial-aware VLA
Abstract (arXiv)
Vision-language-action policies benefit from geometric supervision, but current-frame geometry alone does not explicitly describe the changes associated with manipulation. This design is motivated by the goal of learning an embodiment-agnostic visual interface that can be pretrained across robot and egocentric video before robot-specific action alignment. We introduce Geometry-Change VLA (GC-VLA), which learns to predict multiview future-current geometry-change tokens from current observations. Offline frame pairs define a nominal 0.5-second prediction horizon; future observations are used only to construct training targets. Stage 1 trains a geometry-change vision-language model (GC-VLM). Stage 2 introduces a continuous ActionExpert and aligns it with robot actions while stopping action-flow gradients at the VLM interface. Stage 3 enables these gradients to update the trainable VLM components jointly with the ActionExpert. Stage 4 freezes GC-VLA and applies Geometry-Conditioned Residual Flow (GCRF), using a binary intervention router and a single bounded residual velocity policy learned from closed-loop feedback. GC-VLA achieves 95.20% success on LIBERO, and GC-VLA with GCRF achieves 99.55%. Inference uses current observations and the learned GC representation without executing the offline target encoders.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in 3D and spatial-aware VLA, one of 13 directions in Vision-language-action models. Builds on 36 of its 37 references that are in the map. First posted on arXiv 22 Sep 2026.
Builds on
36 of 37 references.
References · 36
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
24 more
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
- 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 274
- 2018Residual Reinforcement Learning for Robot Controlcited by 242
- 2025LIBERO-PRO: Towards Robust and Fair Evaluation of Vision-Language-Action Models Beyond Memorizationcited by 166
- 2023HoloAssist: an Egocentric Human Interaction Dataset for Interactive AI Assistants in the Real Worldcited by 159
- 2020Recovery RL: Safe Reinforcement Learning with Learned Recovery Zonescited by 156
- 2025SimpleVLA-RL: Scaling VLA Training via Reinforcement Learningcited by 141
- 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Modelcited by 140
- 2025FLARE: Robot Learning with Implicit World Modelingcited by 105
- 2023Guided Flows for Generative Modeling and Decision Makingcited by 99
- 2024FlowPolicy: Enabling Fast and Robust 3D Flow-based Policy via Consistency Flow Matching for Robot Manipulationcited by 99
- 2024FMB: a Functional Manipulation Benchmark for Generalizable Robotic Learningcited by 79
- 2025VideoVLA: Video Generators Can Be Generalizable Robot Manipulatorscited by 61
- 2026Being-H0.5: Scaling Human-Centric Robot Learning for Cross-Embodiment Generalizationcited by 61
- 2026Xiaomi-Robotics-0: An Open-Sourced Vision-Language-Action Model with Real-Time Executioncited by 42
- 2026ABot-M0.5: Unified Mobility-and-Manipulation World Action Modelcited by 28
- 2025RLinf-VLA: A Unified and Efficient Framework for Reinforcement Learning of Vision-Language-Action Modelscited by 26
- 2025SRPO: Self-Referential Policy Optimization for Vision-Language-Action Modelscited by 25
- 2026Hy-Embodied-0.5-VLA: From Vision-Language-Action Models to a Real-World Robot Learning Stackcited by 20
- 2026RFS: Reinforcement Learning with Residual Flow Steering for Dexterous Manipulationcited by 10
- 2026SimVLA: A Simple VLA Baseline for Robotic Manipulationcited by 10
- 2026Intercepting the Future: Latent-Space Predictive World Model for Dynamic VLA Manipulationcited by 9
- 2026HABIT: Human-Aware Behavior and Interaction Training Dataset for Robot Manipulationcited by 4
- 2026PhysBrain 1.0 Technical Reportcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026GeoBridge-VLA: Geometry-Aware Residual Adaptation for Vision-Language-Action Models
- 2026FOCAL-VLA: Subtask-Guided Geometry Distillation and Implicit World Modeling for Vision-Language-Action Models
- 2026G3VLA: Geometric inductive bias for Vision-Language-Action Models
- 2026GEAR-VLA: Learning Geometry-Aware Action Representations for Generalizable Robotic Manipulation
- 2026Two Bridges, One Pathway: From VLMs to Generalizable VLAs with Embodied Trajectory-Coupled Data
- 2026PriorVLA: Prior-Preserving Adaptation for Vision-Language-Action Models
- 2026MotionVLA: Injecting Geometric Motion into Vision-Language-Action Model
- 2025Spatial-Aware VLA Pretraining through Visual-Physical Alignment from Human Videos