Learning Object-Centric Spatial Reasoning for Sequential Manipulation in Cluttered Environments
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Robotic manipulation in cluttered environments presents a critical challenge for automation. Recent large-scale, end-to-end models demonstrate impressive capabilities but often lack the data efficiency and modularity required for retrieving objects in dense clutter. In this work, we argue for a paradigm of specialized, decoupled systems and present Unveiler, a framework that explicitly separates high-level spatial reasoning from low-level action execution. Unveiler's core is a lightweight, transformer-based Spatial Relationship Encoder (SRE) that sequentially identifies the most critical obstacle for removal. This discrete decision is then passed to a rotation-invariant Action Decoder for execution. We demonstrate that this decoupled architecture is not only more computationally efficient in terms of parameter count and inference time, but also significantly outperforms both classic end-to-end policies and modern, large-model-based baselines in retrieving targets from dense clutter. The SRE is trained in two stages: imitation learning from heuristic demonstrations provides sample-efficient initialization, after which PPO fine-tuning enables the policy to discover removal strategies that surpass the heuristic in dense clutter. Our results, achieving up to 97.6% success in partially occluded and 90.0% in fully occluded scenarios in simulation, make a case for the power of specialized, object-centric reasoning in complex manipulation tasks. Additionally, we demonstrate that the SRE's spatial reasoning transfers zero-shot to real scenes, and validate the full system on a physical robot requiring only geometric workspace calibration; no learned components are retrained.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 24 of its 33 references that are in the map. First posted on arXiv 3 Mar 2026.
Builds on
24 of 33 references.
References · 24
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2024GPT-4o System Cardcited by 4,467
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2022VIMA: General Robot Manipulation with Multimodal Promptscited by 403
- 2020Transporter Networks: Rearranging the Visual World for Robotic Manipulationcited by 342
- 2022VIOLA: Imitation Learning for Vision-Based Manipulation with Object Proposal Priorscited by 135
12 more
- 2018Learning Synergies between Pushing and Grasping with Self-supervised Deep Reinforcement Learningcited by 121
- 2023Learning Generalizable Manipulation Policies with Object-Centric 3D Representationscited by 60
- 2023A Joint Modeling of Vision-Language-Action for Target-oriented Grasping in Cluttercited by 33
- 2024ThinkGrasp: A Vision-Language System for Strategic Part Grasping in Cluttercited by 20
- 2019A Deep Learning Approach to Grasping the Invisiblecited by 18
- 2021Efficient learning of goal-oriented push-grasping synergy in cluttercited by 10
- 2023Deep Reinforcement Learning for Robotic Pushing and Picking in Cluttered Environmentcited by 10
- 2024Learning by Watching: A Review of Video-based Learning Approaches for Robot Manipulationcited by 10
- 2022Learning Object Relations with Graph Neural Networks for Target-Driven Grasping in Dense Cluttercited by 6
- 2022Self-Supervised Learning for Joint Pushing and Grasping Policies in Highly Cluttered Environmentscited by 4
- 2024OVGNet: A Unified Visual-Linguistic Framework for Open-Vocabulary Robotic Graspingcited by 4
- 2024MPGNet: Learning Move-Push-Grasping Synergy for Target-Oriented Grasping in Occluded Scenescited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Learning Spatial-Aware Manipulation Ordering
- 2025EmbodiedCoder: Parameterized Embodied Mobile Manipulation via Modern Coding Model
- 2025SEM: Enhancing Spatial Understanding for Robust Robot Manipulation
- 2026RoBoSR: Structured Scene Representations for Embodied Robotic Reasoning ↗
- 2025From Seeing to Doing: Bridging Reasoning and Decision for Robotic Manipulation
- 2026GSR: Learning Structured Reasoning for Embodied Manipulation ↗
- 2025Incentivizing Multimodal Reasoning in Large Models for Direct Robot Manipulation
- 2026LENS: LLM-guided Environment Simplification for Planning and Control in Clutter ↗