mlsanityData to 7 Oct 2026

Spatial Grafting: Grounding 3D Features for Flow-Matching Robot Policies

arXiv 2609.35249 ↗First posted 28 Sep 2026cs.RO cs.AI cs.CVcited by 0

On the map: World models → Embodied and robot world models

also in 2 more
Abstract (arXiv)

Pretrained robot manipulation policies such as vision-language-action models (VLAs) or world-action models (WAMs) leave interaction-relevant metric geometry implicit. Recent breakthroughs in spatial reconstruction can supply the necessary geometry reliably, but their features describe local shape without stating where it lies with respect to the robot. How best to deliver these features to a pretrained policy remains unresolved. We propose Spatial Grafting, a versatile, lightweight spatial module that binds frozen reconstruction features to metric, robot-relative geometry. Spatial Grafting constructs metric-grounded spatial tokens and injects them into the flow-matching action expert through cross-attention, without modifying the host's perceptual pathway, so the host retains the full benefit of its pretraining. We evaluate it more broadly than any geometry-aware policy we compare against: one graft architecture, with no per-host redesign, on two VLAs and two WAMs, across four simulation benchmarks that span short-horizon manipulation, visual robustness, clutter and long-horizon mobile manipulation, and on three real-robot platforms with single- and dual-arm configurations. On RoboTwin 2.0, a dual-arm manipulation benchmark, the graft improves every host across VLAs and WAMs. Grafted π0.5 gains 11.3% and 15.6% on clean and randomized scenes, reaching 94.0% and 92.4%, above the strongest published 3D-conditioned policy, WAM4D (93.8% and 89.9%). The margin widens as the horizon lengthens: on tasks from BEHAVIOR-1K, a dual-arm mobile manipulation challenge scored by average task progress, it surpasses the 2025 challenge winner on five of six tasks,by up to 0.47 Q-score, and exceeds a map-conditioned spatial policy on average across the three tasks both report.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 39 of its 43 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

39 of 43 references.

Closest ancestors · 9

Same direction, newest first

  1. 2026Learning 4D Geometric Priors for Inference-Efficient World Action Models6 Jul
  2. 2026WAM4D: Fast 4D World Action Model via Spatial Register Tokens12 Jun
  3. 2026Unified 4D World Action Modeling from Video Priors with Asynchronous Denoising29 Apr
  4. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
  5. 2026Causal World Modeling for Robot Control29 Jan
  6. 2025Motus: A Unified Latent Action World Model15 Dec
  7. 2025GWM: Towards Scalable Gaussian World Models for Robotic Manipulation25 Aug
  8. 2025DyWA: Dynamics-adaptive World Action Model for Generalizable Non-prehensile Manipulation21 Mar
  9. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusion7 Mar

Other references · 30

  1. 2022Flow Matching for Generative Modelingcited by 5,426
  2. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  3. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  4. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
  5. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  6. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
  7. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  8. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  9. 2024Depth Anything V2cited by 1,385
  10. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  11. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  12. 2024Grounding Image Matching in 3D with MASt3Rcited by 960
18 more
  1. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
  2. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  3. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
  4. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
  5. 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
  6. 20243D Diffuser Actor: Policy Diffusion with 3D Scene Representationscited by 278
  7. 2025MolmoAct: Action Reasoning Models that can Reason in Spacecited by 189
  8. 2023Act3D: 3D Feature Field Transformers for Multi-Task Robotic Manipulationcited by 135
  9. 2025Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Modelcited by 125
  10. 2025PointVLA: Injecting the 3D World into Vision-Language-Action Modelscited by 101
  11. 2025GeoVLA: Empowering 3D Representations in Vision-Language-Action Modelscited by 68
  12. 2025DepthVLA: Enhancing Vision-Language-Action Models with Depth-Aware Spatial Reasoningcited by 44
  13. 2025GeoPredict: Leveraging Predictive Kinematics and 3D Gaussian Geometry for Precise VLA Manipulationcited by 15
  14. 2025Task adaptation of Vision-Language-Action model: 1st Place Solution for the 2025 BEHAVIOR Challengecited by 13
  15. 2025GLaD: Geometric Latent Distillation for Vision-Language-Action Modelscited by 10
  16. 20263D-Mix for VLA: A Plug-and-Play Module for Integrating VGGT-based 3D Information into Vision-Language-Action Modelscited by 6
  17. 2026Understanding the Impact of Geometric Foundation Models on Vision-Language-Action Modelscited by 4
  18. 2026SERF: Spatiotemporal Environment and Robot Feature Map for Long-Horizon Mobile Manipulationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026GeoProp: Grounding Robot State in Vision for Generalist Manipulation
  2. 2025Improving Robotic Manipulation with Efficient Geometry-Aware Vision Encoder
  3. 2026SA-VLA: Spatially-Aware Flow-Matching for Vision-Language-Action Reinforcement Learning
  4. 2026VolumeDP: Modeling Volumetric Representation for Manipulation Policy Learning
  5. 2024ActionFlow: Equivariant, Accurate, and Efficient Policies with Spatially Symmetric Flow Matching
  6. 2025FlowRAM: Grounding Flow Matching Policy with Region-Aware Mamba Framework for Robotic Manipulation
  7. 2024FlowPolicy: Enabling Fast and Robust 3D Flow-based Policy via Consistency Flow Matching for Robot Manipulation
  8. 20263DWay: Generalizing Robot Manipulation via 3D Consistent Waypoints