GSAM: A Generalizable and Safe Robotic Framework for Articulated Object Manipulation
Not on the map. Why?
Abstract (arXiv)
Articulated object manipulation is a unique challenge for service robots. Existing methods employ end-to-end policy learning, visionmotion planning, and large-language/visual-language model (LLM/VLM), but often overlook the diversity of articulated objects and the complexity of interactions between end-effector and handle, leading to limited generalization and destructive collisions. To address this, we propose GSAM, a generalizable and safe robotic framework for articulated object manipulation. Specifically, a vision-based perceiver generates the kinematic parameters. Considering that pre-trained markers in perceiver yield raw estimations that may deviate from commonsense, we present a f ine-tuned VLM-based refiner, using chain-of-thought (COT) commonsense reasoning to refine perception. To prevent destructive collisions, we design an interaction constraint function generator, integrating articulated object, interaction pose, and obstacle avoidance knowledge into a base. LLM then functionalize these constraints and apply them to trajectory and posture planning. A kinematic-aware manipulation planner verifies reachability for trajectory and posture. Experiments on 50 hinge tasks across 5 object categories and 50 randomly initialized end-effectorhandle configurations show that GSAM reduces standard deviation by 3.1% and improves manipulation success rate by 36.0% compared to the best baseline, respectively demonstrating the superior object generalization and interaction safety of GSAM in practical scenarios.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 42 references that are in the map. First posted on arXiv 29 May 2026.
Builds on
28 of 42 references.
References · 28
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023Segment Anythingcited by 8,158
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2018QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulationcited by 730
- 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 521
- 2022VIP: Towards Universal Visual Reward and Representation via Value-Implicit Pre-Trainingcited by 384
- 2024Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robotscited by 373
- 2016Learning Hand-Eye Coordination for Robotic Grasping with Deep Learning and Large-Scale Data Collectioncited by 312
- 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulationcited by 305
16 more
- 2023MimicPlay: Long-Horizon Imitation Learning by Watching Human Playcited by 214
- 2023GELLO: A General, Low-Cost, and Intuitive Teleoperation Framework for Robot Manipulatorscited by 180
- 2021Where2Act: From Pixels to Actions for Articulated 3D Objectscited by 179
- 2022Human-to-Robot Imitation in the Wildcited by 157
- 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 115
- 2021ManipulaTHOR: A Framework for Visual Object Manipulationcited by 101
- 2021Error-Aware Imitation Learning from Teleoperation Data for Mobile Manipulationcited by 59
- 2022OPD: Single-view 3D Openable Part Detectioncited by 52
- 2023Deep Imitation Learning for Humanoid Loco-manipulation through Human Teleoperationcited by 49
- 2023OPDMulti: Openable Part Detection for Multiple Objectscited by 38
- 2023Understanding 3D Object Interaction from a Single Imagecited by 33
- 2024A3VLM: Actionable Articulation-Aware Vision Language Modelcited by 33
- 2023Kinematic-aware Prompting for Generalizable Articulated Object Manipulation with LLMscited by 19
- 2025ArticuBot: Learning Universal Articulated Object Manipulation Policy via Large Scale Simulationcited by 10
- 2024MoMa-Pos: An Efficient Object-Kinematic-Aware Base Placement Optimization Framework for Mobile Manipulationcited by 3
- 2024BestMan: A Modular Mobile Manipulator Platform for Embodied AI with Unified Simulation-Hardware APIscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025ArtiBench and ArtiBrain: Benchmarking Generalizable Vision-Language Articulated Object Manipulation
- 2025OmniManip: Towards General Robotic Manipulation via Object-Centric Interaction Primitives as Spatial Constraints
- 2026WBAG: A Whole-Body and Attached-Geometry Safety Framework for Vision-Language-Action Manipulation
- 2024Towards Generalizable Vision-Language Robotic Manipulation: A Benchmark and LLM-guided 3D Policy
- 2025From Seeing to Doing: Bridging Reasoning and Decision for Robotic Manipulation
- 2023ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulation
- 2026ManipArena: Comprehensive Real-world Evaluation of Reasoning-Oriented Generalist Robot Manipulation
- 2025REALM: A Real-to-Sim Validated Benchmark for Generalization in Robotic Manipulation