mlsanityData to 7 Oct 2026

ArtiBench and ArtiBrain: Benchmarking Generalizable Vision-Language Articulated Object Manipulation

arXiv 2511.20330 ↗First posted 25 Nov 2025cs.RO cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Interactive articulated manipulation requires long-horizon, multi-step interactions with appliances while maintaining physical consistency. Existing vision-language and diffusion-based policies struggle to generalize across parts, instances, and categories. We first introduce ArtiBench, a five-level benchmark covering kitchen, storage, office, and tool environments. ArtiBench enables structured evaluation from cross-part and cross-instance variation to long-horizon multi-object tasks, revealing the core generalization challenges of articulated object manipulation. Building on this benchmark, we propose ArtiBrain, a modular framework that unifies high-level reasoning with adaptive low-level control. ArtiBrain uses a VLM-based Task Reasoner (GPT-4.1) to decompose and validate subgoals, and employs a Hybrid Controller that combines geometry-aware keyframe execution with affordance-guided diffusion for precise and interpretable manipulation. An Affordance Memory Bank continually accumulates successful execution episodes and propagates part-level actionable affordances to unseen articulated parts and configurations. Extensive experiments on ArtiBench show that our ArtiBrain significantly outperforms state-of-the-art multimodal and diffusion-based methods in robustness and generalization. Code and dataset will be released upon acceptance.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 44 of its 57 references that are in the map. First posted on arXiv 25 Nov 2025.

Builds on

44 of 57 references.

References · 44

  1. 2020Denoising Diffusion Implicit Modelscited by 9,655
  2. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  3. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  4. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  5. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
  6. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  7. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  8. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
  9. 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,029
  10. 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 850
  11. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
  12. 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 733
32 more
  1. 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 669
  2. 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
  3. 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 617
  4. 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
  5. 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
  6. 2022BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learningcited by 517
  7. 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
  8. 2022VIMA: General Robot Manipulation with Multimodal Promptscited by 403
  9. 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 313
  10. 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondencecited by 297
  11. 20243D Diffuser Actor: Policy Diffusion with 3D Scene Representationscited by 278
  12. 2025Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Modelscited by 216
  13. 2024RT-H: Action Hierarchies Using Languagecited by 204
  14. 2021ManiSkill: Generalizable Manipulation Skill Benchmark with Large-Scale Demonstrationscited by 193
  15. 2021iGibson 2.0: Object-Centric Simulation for Robot Learning of Everyday Household Taskscited by 191
  16. 2023ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulationcited by 157
  17. 2023Scaling Up and Distilling Down: Language-Guided Robot Skill Acquisitioncited by 156
  18. 2024BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulationcited by 140
  19. 2024THE COLOSSEUM: A Benchmark for Evaluating Generalization for Robotic Manipulationcited by 128
  20. 2023RoboCat: A Self-Improving Generalist Agent for Robotic Manipulationcited by 108
  21. 2021Skill Induction and Planning with Latent Languagecited by 99
  22. 2014Reducing the Barrier to Entry of Complex Robotic Software: a MoveIt! Case Studycited by 86
  23. 2024Manipulate-Anything: Automating Real-World Robots using Vision-Language Modelscited by 82
  24. 2022VLMbench: A Compositional Benchmark for Vision-and-Language Manipulationcited by 68
  25. 2024Point-SAM: Promptable 3D Segmentation Model for Point Cloudscited by 49
  26. 2025Embodied-Reasoner: Synergizing Visual Search, Reasoning, and Action for Embodied Interactive Taskscited by 43
  27. 2022IFOR: Iterative Flow Minimization for Robotic Object Rearrangementcited by 42
  28. 2023M2T2: Multi-Task Masked Transformer for Object-centric Pick and Placecited by 40
  29. 2025Diffusion Models for Robotic Manipulation: A Surveycited by 39
  30. 2024Towards Generalizable Vision-Language Robotic Manipulation: A Benchmark and LLM-guided 3D Policycited by 37
  31. 2024AffordDP: Generalizable Diffusion Policy with Transferable Affordancecited by 35
  32. 2025AnchorDP3: 3D Affordance Guided Sparse Diffusion Policy for Robotic Manipulationcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026GSAM: A Generalizable and Safe Robotic Framework for Articulated Object Manipulation
  2. 2025From Seeing to Doing: Bridging Reasoning and Decision for Robotic Manipulation
  3. 2026Guava: Distilling Frontier VLMs into a Compact Agent through a Robotic Manipulation Harness
  4. 2025OmniManip: Towards General Robotic Manipulation via Object-Centric Interaction Primitives as Spatial Constraints
  5. 2023SAGE: Bridging Semantic and Actionable Parts for GEneralizable Manipulation of Articulated Objects
  6. 2025Embodied-R1: Reinforced Embodied Reasoning for General Robotic Manipulation
  7. 2026Training-Free Interaction-Aligned Visual Token Pruning for Efficient Embodied Manipulation
  8. 2025AOMGen: Photoreal, Physics-Consistent Demonstration Generation for Articulated Object Manipulation