mlsanityData to 7 Oct 2026

GeoProp: Grounding Robot State in Vision for Generalist Manipulation

arXiv 2607.07101 ↗First posted 8 Jul 2026cs.RO cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Proprioception is fundamental to robotic manipulation, yet standard fusion methods often treat it as an isolated vector lacking explicit alignment with visual tokens. Without a direct correspondence between 3D kinematics and 2D feature maps, manipulation policies struggle to ground the robot's state within the scene, frequently underperforming even vision-only baselines. To address this, we introduce GeoProp, a lightweight, plug-and-play adapter that aligns proprioception with vision through explicit geometric grounding and spatial feature sampling. GeoProp projects the robot state onto the image plane to sample localized visual features, constructing a grounded state token. It then injects state-derived spatial priors into the corresponding visual features via FiLM modulation. To capture motion intent, GeoProp further samples features at a short-horizon predicted coordinate derived from recent kinematics, providing look-ahead visual context. Across 67 tasks, GeoProp improves Diffusion Policy by 8.7% on 63 simulation tasks and pi_0 by 4.0% on the RoboTwin subset, and yields a 10.6% average gain across both policy families in the real world, while adding only 2-3% to the parameter count. These results demonstrate that GeoProp is a simple yet high-impact inductive bias for generalist embodied policies. Project page: https://alibaba-damo-academy.github.io/GeoProp/.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 42 of its 44 references that are in the map. First posted on arXiv 8 Jul 2026.

Builds on

42 of 44 references.

References · 42

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2017Proximal Policy Optimization Algorithmscited by 14,441
  3. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  4. 2015Continuous control with deep reinforcement learningcited by 3,279
  5. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  6. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  7. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  8. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  9. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  10. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  11. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
  12. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
30 more
  1. 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,168
  2. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  3. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
  4. 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 669
  5. 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
  6. 2022BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learningcited by 517
  7. 2023Where are we in the search for an Artificial Visual Cortex for Embodied Intelligence?cited by 215
  8. 2023Act3D: 3D Feature Field Transformers for Multi-Task Robotic Manipulationcited by 135
  9. 2024RVT-2: Learning Precise Manipulation from Few Demonstrationscited by 135
  10. 2025HAMSTER: Hierarchical Action Models For Open-World Robot Manipulationcited by 125
  11. 2025Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Modelcited by 125
  12. 2025RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twinscited by 117
  13. 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priorscited by 111
  14. 2024FlowPolicy: Enabling Fast and Robust 3D Flow-based Policy via Consistency Flow Matching for Robot Manipulationcited by 99
  15. 2024LLARVA: Vision-Action Instruction Tuning Enhances Robot Learningcited by 87
  16. 2024The Ingredients for Robotic Diffusion Transformerscited by 72
  17. 2024Theia: Distilling Diverse Vision Foundation Models for Robot Learningcited by 56
  18. 2025Do You Need Proprioceptive States in Visuomotor Policies?cited by 16
  19. 2025Contrastive Representation Regularization for Vision-Language-Action Modelscited by 16
  20. 2025XR-1: Towards Versatile Vision-Language-Action Models via Learning Unified Vision-Motion Representationscited by 15
  21. 2025GeoPredict: Leveraging Predictive Kinematics and 3D Gaussian Geometry for Precise VLA Manipulationcited by 15
  22. 2025GP3: A 3D Geometry-Aware Policy with Multi-View Images for Robotic Manipulationcited by 11
  23. 2025PEEK: Guiding and Minimal Image Representations for Zero-Shot Generalization of Robot Manipulation Policiescited by 11
  24. 2025AimBot: A Simple Auxiliary Visual Cue to Enhance Spatial Awareness of Visuomotor Policiescited by 10
  25. 2025Towards Scalable Spatial Intelligence via 2D-to-3D Data Liftingcited by 8
  26. 2026When would Vision-Proprioception Policies Fail in Robotic Manipulation?cited by 8
  27. 2025Robotic VLA Benefits from Joint Learning with Motion Image Diffusioncited by 7
  28. 2026On the Generalization Capacities of MLLMs for Spatial Intelligencecited by 7
  29. 2025Towards Proprioception-Aware Embodied Planning for Dual-Arm Humanoid Robotscited by 3
  30. 2025Proprioception Enhances Vision Language Model in Generating Captions and Subtask Segmentations for Robot Taskcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025VGGT-DP: Generalizable Robot Control via Vision Foundation Models
  2. 2026VolumeDP: Modeling Volumetric Representation for Manipulation Policy Learning
  3. 2026Spatial Grafting: Grounding 3D Features for Flow-Matching Robot Policies
  4. 2025Spatial RoboGrasp: Generalized Robotic Grasping Control Policy
  5. 2025MOVE: A Simple Motion-Based Data Collection Paradigm for Spatial Generalization in Robotic Manipulation
  6. 2025GeoManip: Geometric Constraints as General Interfaces for Robot Manipulation
  7. 2026SpatialVAM:Spatial-Aware Multi-View Video Diffusion as a Data-Efficient Robot Policy
  8. 2026Spatially Grounded Long-Horizon Task Planning in the Wild