mlsanityData to 14 Oct 2026

GeneralVLA-2: Geometry-Aware Reconstruction and Governed Memory for Robot Planning

arXiv 2606.17480 ↗First posted 16 Jun 2026cs.CV cs.ROcited by 0

On the map: Vision-language-action models → 3D and spatial-aware VLA

Abstract (arXiv)

Generalist vision-language-action systems need object-centric 3D evidence and reusable manipulation experience to plan reliable robot trajectories. GeneralVLA provides a hierarchical interface for converting language and RGB-D observations into 3D end-effector paths, but two bottlenecks remain. First, monocular SAM3D-style object reconstruction can hallucinate pose and unseen geometry, while manipulation benefits from stable object shape when calibrated multi-view observations are available. Second, the original KnowledgeBank mainly retrieves semantically similar snippets and appends new knowledge, which makes it difficult to control memory quality, conflicts, confidence, and geometric relevance. To address the first challenge, we introduce GeoFuse-MV3D, a geometry-prior-guided MV-SAM3D reconstruction branch that verifies external geometry cues with input-view masks, applies soft visual-hull support, performs axis-wise refinement, and fuses only geometry while preserving appearance. To address the second challenge, we upgrade KnowledgeBank into a governed long-term memory system with explicit quality, confidence, lifecycle, verifier, and conflict metadata, together with precision-oriented retrieval. Finally, we evaluate the reconstruction branch on GSO-30 and the memory module on Terminal-Bench 2.0 and SWE-Bench Verified; GeoFuse-MV3D improves over the MV-SAM3D baseline by reducing CD and LPIPS by 2.20% and 2.02% while increasing PSNR and SSIM by 2.36% and 1.03%, and KnowledgeBank improves over ReasoningBank by 4.53% on Terminal-Bench SR and 3.73% on SWE-Bench resolve rate, while reducing AS by 4.95% and 5.65%, respectively. Code: https://github.com/AIGeeksGroup/GeneralVLA-2. Website: https://aigeeksgroup.github.io/GeneralVLA-2.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in 3D and spatial-aware VLA, one of 13 directions in Vision-language-action models. Builds on 13 of its 23 references that are in the map. First posted on arXiv 16 Jun 2026.

Builds on

13 of 23 references.

References · 13

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 2023Segment Anythingcited by 8,234
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  4. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  5. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  6. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
  7. 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
  8. 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 689
  9. 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 612
  10. 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 585
  11. 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Roboticscited by 251
  12. 2025HAMSTER: Hierarchical Action Models For Open-World Robot Manipulationcited by 130
1 more
  1. 2026MV-SAM3D: Adaptive Multi-View Fusion for Layout-Aware 3D Generationcited by 19

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026G3VLA: Geometric inductive bias for Vision-Language-Action Models
  2. 2026SAM3D-Guided Object-Centric Representation Alignment for Vision-Language-Action Models
  3. 2026StrataVLA: Hierarchical and Efficient 3D Geometric Grounding for Vision-Language-Action Models
  4. 2026GeneralVLA: Generalizable Vision-Language-Action Models with Knowledge-Guided Trajectory Planning
  5. 2026GeomVLA: Unifying Scene, Motion, and Action in 3D
  6. 2025OG-VLA: Orthographic Image Generation for 3D-Aware Vision-Language Action Model
  7. 20263DWay: Generalizing Robot Manipulation via 3D Consistent Waypoints
  8. 2026BridgeVLA++: A Data-Efficient, Generalizable, and Memory-Augmented Vision-Language-Action Framework for 3D Manipulation