mlsanityData to 7 Oct 2026

BIND: Binding 3D Robot Actions to 2D Image Features

arXiv 2609.38443 ↗First posted 29 Sep 2026cs.RO cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We introduce BIND, a new action representation for visuomotor robot policies that binds 3D robot actions to their corresponding 2D image features, yielding strong data efficiency gains and robustness to out-of-distribution object positions and camera viewpoints. The action heads of current robot policies are typically formulated as an MLP regression from a single global feature vector produced by a pre-trained vision encoder. This global formulation requires the policy network to discover, from demonstrations alone, the relationship between target robot actions and the image features they project onto. The consequence is that although modern image features are semantically descriptive, spatially robust, and even multiview-consistent, the policies built on them are brittle to subtle changes in camera viewpoint and object placement--and surprisingly data-inefficient. BIND closes this gap by supplying the action-feature relationship through camera geometry rather than learning: it discretizes a volume of candidate end effector positions, attaches each candidate to the pre-trained features at its projection in each camera view, and selects actions by scoring each candidate's position and image-bound feature combination. On a real robot, we study data efficiency and out-of-distribution robustness to unseen object positions and camera viewpoints, as well as general long-horizon task execution and dexterity. We find BIND to be highly data-efficient and robust: it achieves near-perfect success on tasks with as few as 5 demonstrations, and degrades gracefully under steep camera-viewpoint shifts and held-out object positions where coordinate-regression baselines completely fail.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 36 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

33 of 36 references.

References · 33

  1. 2017Attention Is All You Needcited by 59,932
  2. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  3. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  4. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
  5. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  6. 2025DINOv3cited by 1,297
  7. 2015End-to-End Training of Deep Visuomotor Policiescited by 847
  8. 2024PaliGemma: A versatile 3B VLM for transfercited by 679
  9. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  10. 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 617
  11. 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
  12. 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
21 more
  1. 2018Behavioral Cloning from Observationcited by 482
  2. 2026World Action Models are Zero-shot Policiescited by 411
  3. 2024Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robotscited by 373
  4. 2020Transporter Networks: Rearranging the Visual World for Robotic Manipulationcited by 342
  5. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 274
  6. 2017One-Shot Imitation Learningcited by 232
  7. 2023RVT: Robotic View Transformer for 3D Object Manipulationcited by 224
  8. 2025Unified Video Action Modelcited by 195
  9. 2023GELLO: A General, Low-Cost, and Intuitive Teleoperation Framework for Robot Manipulatorscited by 180
  10. 2024RVT-2: Learning Precise Manipulation from Few Demonstrationscited by 135
  11. 2021Coarse-to-Fine Q-attention: Efficient Learning for Visual Robotic Manipulation via Discretisationcited by 120
  12. 2025RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twinscited by 117
  13. 2023GNFactor: Multi-Task Real Robot Learning with Generalizable Neural Feature Fieldscited by 99
  14. 2025Motion Tracks: A Unified Representation for Human-Robot Transfer in Few-Shot Imitation Learningcited by 57
  15. 2024RAM: Retrieval-Based Affordance Transfer for Generalizable Zero-Shot Robotic Manipulationcited by 55
  16. 2026MolmoAct2: Action Reasoning Models for Real-world Deploymentcited by 45
  17. 2025ManiFlow: A General Robot Manipulation Policy via Consistency Flow Trainingcited by 43
  18. 2024RT-Affordance: Affordances are Versatile Intermediate Representations for Robot Manipulationcited by 40
  19. 2025UAD: Unsupervised Affordance Distillation for Generalization in Robotic Manipulationcited by 23
  20. 2026DynaFLIP: Rethinking Robotics Perception via Tri-Modal-Dynamics Guided Representationcited by 4
  21. 2026Fiducial Exoskeletons: Image-Centric Robot State Estimationcited by 1

Built on by

Not cited yet.