ArtiBench and ArtiBrain: Benchmarking Generalizable Vision-Language Articulated Object Manipulation
Not on the map. Why?
Abstract (arXiv)
Interactive articulated manipulation requires long-horizon, multi-step interactions with appliances while maintaining physical consistency. Existing vision-language and diffusion-based policies struggle to generalize across parts, instances, and categories. We first introduce ArtiBench, a five-level benchmark covering kitchen, storage, office, and tool environments. ArtiBench enables structured evaluation from cross-part and cross-instance variation to long-horizon multi-object tasks, revealing the core generalization challenges of articulated object manipulation. Building on this benchmark, we propose ArtiBrain, a modular framework that unifies high-level reasoning with adaptive low-level control. ArtiBrain uses a VLM-based Task Reasoner (GPT-4.1) to decompose and validate subgoals, and employs a Hybrid Controller that combines geometry-aware keyframe execution with affordance-guided diffusion for precise and interpretable manipulation. An Affordance Memory Bank continually accumulates successful execution episodes and propagates part-level actionable affordances to unseen articulated parts and configurations. Extensive experiments on ArtiBench show that our ArtiBrain significantly outperforms state-of-the-art multimodal and diffusion-based methods in robustness and generalization. Code and dataset will be released upon acceptance.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 44 of its 57 references that are in the map. First posted on arXiv 25 Nov 2025.
Builds on
44 of 57 references.
References · 44
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,029
- 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 850
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 733
32 more
- 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 669
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
- 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 617
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
- 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
- 2022BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learningcited by 517
- 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
- 2022VIMA: General Robot Manipulation with Multimodal Promptscited by 403
- 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 313
- 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondencecited by 297
- 20243D Diffuser Actor: Policy Diffusion with 3D Scene Representationscited by 278
- 2025Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Modelscited by 216
- 2024RT-H: Action Hierarchies Using Languagecited by 204
- 2021ManiSkill: Generalizable Manipulation Skill Benchmark with Large-Scale Demonstrationscited by 193
- 2021iGibson 2.0: Object-Centric Simulation for Robot Learning of Everyday Household Taskscited by 191
- 2023ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulationcited by 157
- 2023Scaling Up and Distilling Down: Language-Guided Robot Skill Acquisitioncited by 156
- 2024BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulationcited by 140
- 2024THE COLOSSEUM: A Benchmark for Evaluating Generalization for Robotic Manipulationcited by 128
- 2023RoboCat: A Self-Improving Generalist Agent for Robotic Manipulationcited by 108
- 2021Skill Induction and Planning with Latent Languagecited by 99
- 2014Reducing the Barrier to Entry of Complex Robotic Software: a MoveIt! Case Studycited by 86
- 2024Manipulate-Anything: Automating Real-World Robots using Vision-Language Modelscited by 82
- 2022VLMbench: A Compositional Benchmark for Vision-and-Language Manipulationcited by 68
- 2024Point-SAM: Promptable 3D Segmentation Model for Point Cloudscited by 49
- 2025Embodied-Reasoner: Synergizing Visual Search, Reasoning, and Action for Embodied Interactive Taskscited by 43
- 2022IFOR: Iterative Flow Minimization for Robotic Object Rearrangementcited by 42
- 2023M2T2: Multi-Task Masked Transformer for Object-centric Pick and Placecited by 40
- 2025Diffusion Models for Robotic Manipulation: A Surveycited by 39
- 2024Towards Generalizable Vision-Language Robotic Manipulation: A Benchmark and LLM-guided 3D Policycited by 37
- 2024AffordDP: Generalizable Diffusion Policy with Transferable Affordancecited by 35
- 2025AnchorDP3: 3D Affordance Guided Sparse Diffusion Policy for Robotic Manipulationcited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026GSAM: A Generalizable and Safe Robotic Framework for Articulated Object Manipulation
- 2025From Seeing to Doing: Bridging Reasoning and Decision for Robotic Manipulation
- 2026Guava: Distilling Frontier VLMs into a Compact Agent through a Robotic Manipulation Harness
- 2025OmniManip: Towards General Robotic Manipulation via Object-Centric Interaction Primitives as Spatial Constraints
- 2023SAGE: Bridging Semantic and Actionable Parts for GEneralizable Manipulation of Articulated Objects
- 2025Embodied-R1: Reinforced Embodied Reasoning for General Robotic Manipulation
- 2026Training-Free Interaction-Aligned Visual Token Pruning for Efficient Embodied Manipulation
- 2025AOMGen: Photoreal, Physics-Consistent Demonstration Generation for Articulated Object Manipulation