Learning 3D Affordances for Blade Insertion in Cluttered Stowing
Not on the map. Why?
Abstract (arXiv)
Many manipulation tasks require reasoning about free-space affordances: discovering volumes where an extended rigid tool can safely navigate, complementary to surface contact affordances for grasping. Robotic stowing is a canonical instance, where a blade must sweep items aside inside cluttered fabric bins to create insertion space. Production stow systems generate millions of such episodes, but standard approaches with unimodal data infer affordances as SE(3) pose distributions, a geometric question asked in the wrong domain. VulcanVoxel keeps inference spatial: a masked autoencoder over 3D occupancy fields reconstructs blade occupancy conditioned on scene geometry, computing feasibility locally at each voxel and recovering multi-modal predictions from unimodal data. Blade affordances are spatial objects, subsets of 3D space defined by geometric feasibility. Pose parameters carry no structure for reasoning whether unobserved placements are feasible, and standard generative objectives including flow matching faithfully learn the unimodal distribution produced by execution policies and cannot recover geometric alternatives. Trained on 10,000 real warehouse stow episodes without human annotation, VulcanVoxel achieves top-5 coverage of 0.89 versus 0.71 for the best pose-based baseline, with a distilled student providing RGB-to-voxel inference in 30 ms. vs. 1.4 s. for voxel-to-voxel. We have released a dataset of real blade insertion cycles with RGB-D observations and pose trajectories at https://www.armbench.com/blade_insertion. html.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 24 references that are in the map. First posted on arXiv 25 Jun 2026.
Builds on
22 of 24 references.
References · 22
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 357
- 2020Transporter Networks: Rearranging the Visual World for Robotic Manipulationcited by 342
- 2022Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and Segmentationcited by 341
- 20243D Diffuser Actor: Policy Diffusion with 3D Scene Representationscited by 278
- 2023Affordances from Human Videos as a Versatile Representation for Roboticscited by 221
- 2021Neural Descriptor Fields: SE(3)-Equivariant Object Representations for Manipulationcited by 204
- 2021Where2Act: From Pixels to Actions for Articulated 3D Objectscited by 179
- 2021VAT-Mart: Learning Visual Action Trajectory Proposals for Manipulating 3D ARTiculated Objectscited by 78
10 more
- 2023D3Fields: Dynamic 3D Descriptor Fields for Zero-Shot Generalizable Rearrangementcited by 35
- 2023Learning Environment-Aware Affordance for 3D Articulated Object Manipulation under Occlusionscited by 23
- 2025UAD: Unsupervised Affordance Distillation for Generalization in Robotic Manipulationcited by 23
- 2021GIFT: Generalizable Interaction-aware Functional Tool Affordances without Labelscited by 19
- 20253D FlowMatch Actor: Unified 3D Policy for Single- and Dual-Arm Manipulationcited by 19
- 2023CabiNet: Scaling Neural Collision Detection for Object Rearrangement with Procedural Scene Generationcited by 17
- 2025Adapt3R: Adaptive 3D Scene Representation for Domain Transfer in Imitation Learningcited by 16
- 20243D-MVP: 3D Multiview Pretraining for Robotic Manipulationcited by 10
- 2025Stow: Robotic Packing of Items into Fabric Podscited by 2
- 2025SAGA: Open-World Mobile Manipulation via Structured Affordance Groundingcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024UniAff: A Unified Representation of Affordances for Tool Usage and Articulation with Vision-Language Models
- 2026FloAff-Kitchen: Bridging Navigation and Manipulation via Canonical and Progressive Floor Affordance Learning
- 2025A0: An Affordance-Aware Hierarchical Model for General Robotic Manipulation
- 2026AffordSim: A Scalable Data Generator and Benchmark for Affordance-Aware Robotic Manipulation
- 2024AffordDP: Generalizable Diffusion Policy with Transferable Affordance
- 2026AffordanceVLA: A Vision-Language-Action Model Empowering Action Generation through Affordance-Aware Understanding
- 2026Affordance2Action: Task-Conditioned Scene-level Affordance Grounding for Real-Time Manipulation ↗
- 2026Task-Aware Bimanual Affordance Prediction via VLM-Guided Semantic-Geometric Reasoning