mlsanityData to 7 Oct 2026

Language-Guided Grasping under Partial Observation for Mobile Manipulation in Field Inspection and Maintenance

arXiv 2603.07866 ↗First posted 9 Mar 2026cs.RO cs.LG cs.SYcited by 0

Not on the map. Why?

Abstract (arXiv)

Offshore inspection and maintenance have increasingly been using legged robots for routine sensing, yet many useful interventions still require physical interaction with tools, containers, and task-relevant objects. Employing robots for these tasks can reduce operators' exposure in confined, elevated, or potentially explosive areas. This paper presents a language-guided grasping pipeline for a legged mobile manipulator operating under partial observation. An operator defines the target, the system grounds it in RGB with open-vocabulary detection and promptable segmentation, extracts an object-centric RGB-D point cloud, improves sparse geometry through depth compensation and point-cloud completion, and selects a 6-DoF grasp using collision, clearance, reachability, and approach constraints. The system is implemented on a quadruped robot with an arm and evaluated in two cluttered tabletop scenes motivated by small-object retrieval during inspection and maintenance. Across paired trials, the proposed pipeline achieved 9/10 successful grasps, compared with 3/10 for a view-dependent deployment baseline. In this controlled setting, object-centric completion and execution-aware selection reduced approach collisions and improved the reliability of language-guided grasping for supervised field manipulation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 29 references that are in the map. First posted on arXiv 9 Mar 2026.

Builds on

19 of 29 references.

References · 19

  1. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  2. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  3. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
  4. 2021PoinTr: Diverse Point Cloud Completion with Geometry-Aware Transformerscited by 284
  5. 2021Contact-GraspNet: Efficient 6-DoF Grasp Generation in Cluttered Scenescited by 213
  6. 2022AnyGrasp: Robust and Efficient Grasp Perception in Spatial and Temporal Domainscited by 205
  7. 2017Grasp Pose Detection in Point Cloudscited by 107
  8. 2021Synergies Between Affordance and Geometry: 6-DoF Grasp Detection via Implicit Representationscited by 107
  9. 2013Data-Driven Grasp Synthesis - A Surveycited by 104
  10. 20196-DOF Grasping for Target-driven Object Manipulation in Cluttercited by 70
  11. 2024RoboGSim: A Real2Sim2Real Robotic Gaussian Splatting Simulatorcited by 50
  12. 2024GraspSplats: Efficient Manipulation with 3D Feature Splattingcited by 41
7 more
  1. 2016High precision grasp pose detection in dense cluttercited by 33
  2. 2023nvblox: GPU-Accelerated Incremental Signed Distance Field Mappingcited by 23
  3. 2025AffordGrasp: In-Context Affordance Reasoning for Open-Vocabulary Task-Oriented Grasping in Cluttercited by 20
  4. 2024ICGNet: A Unified Approach for Instance-Centric Graspingcited by 16
  5. 2022GE-Grasp: Efficient Target-Oriented Grasping in Dense Cluttercited by 8
  6. 2024Open-Vocabulary Part-Based Graspingcited by 6
  7. 2026MGPC: Multimodal Network for Generalizable Point Cloud Completion With Modality Dropout and Progressive Decodingcited by 2

Built on by

Not cited yet.