Grasp-Then-Plan with Failure Attribution: A Closed Two-Stage Framework for Precise and Generalizable Robotic Manipulation
Not on the map. Why?
Abstract (arXiv)
In robotic manipulation, the tight coupling between grasping and motion planning often obscures the true source of failure, leading to inefficient trial-and-error. To enable efficient long-horizon manipulation, we propose GTP-FA (Grasp-Then-Plan with Failure Attribution), a task-oriented two-stage grasp-then-plan framework that generates grasp candidates and performs downstream motion planning conditioned on the selected grasp. Given a failed manipulation trajectory, we learn a failure attribution model that generalizes to unseen grasps and produces a stable distribution over failure modes for diagnosis-guided optimization. Based on these attribution results, we then optimize both modules in a diagnosis-driven manner: on the grasping side, we inject task-level priors and risk penalties into grasp candidate scoring and optimization to suppress unstable or task-incompatible grasps; on the planning side, we target high-risk initial states through data collection and fine-tuning to address genuine planning bottlenecks. We evaluate the proposed framework in both simulation and real-robot experiments, and show that GTP-FA improves the corresponding base learners across RL, IL, diffusion-policy, and VLA-based settings, achieving substantially higher overall task success rates.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 35 references that are in the map. First posted on arXiv 2 Jun 2026.
Builds on
31 of 35 references.
References · 31
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023Efficient Online Reinforcement Learning with Offline Datacited by 332
- 2025π*0.6: a VLA That Learns From Experiencecited by 280
- 20196-DOF GraspNet: Variational Grasp Generation for Object Manipulationcited by 237
- 2023LIV: Language-Image Representations and Rewards for Robotic Controlcited by 180
- 2024Data Scaling Laws in Imitation Learning for Robotic Manipulationcited by 144
- 2023RoboCLIP: One Demonstration is Enough to Learn Robot Policiescited by 128
- 2022SE(3)-DiffusionFields: Learning smooth cost functions for joint grasp and motion optimization through diffusioncited by 125
- 2024AHA: A Vision-Language-Model for Detecting and Reasoning Over Failures in Robotic Manipulationcited by 118
- 2024CoPa: General Robotic Manipulation through Spatial Constraints of Parts with Foundation Modelscited by 97
- 2024LLARVA: Vision-Action Instruction Tuning Enhances Robot Learningcited by 87
19 more
- 2024Unpacking Failure Modes of Generative Policies: Runtime Monitoring of Consistency and Progresscited by 63
- 2024Policy Decorator: Model-Agnostic Online Refinement for Large Policy Modelcited by 60
- 2021CaTGrasp: Learning Category-Level Task-Relevant Grasping in Clutter from Simulationcited by 49
- 2024Grasp as You Say: Language-guided Dexterous Grasp Generationcited by 39
- 2025FailSafe: Reasoning and Recovery from Failures in Vision-Language-Action Modelscited by 33
- 2022Neural Grasp Distance Fields for Robot Manipulationcited by 31
- 2025STARE-VLA: Progressive Stage-Aware Reinforcement for Fine-Tuning Vision-Language-Action Modelscited by 24
- 2024FoundationGrasp: Generalizable Task-Oriented Grasping with Foundation Modelscited by 16
- 2025RoboDexVLM: Visual Language Model-Enabled Task Planning and Motion Control for Dexterous Robot Manipulationcited by 15
- 2023Task-Oriented Grasp Prediction with Visual-Language Inputscited by 14
- 2024Reverse Forward Curriculum Learning for Extreme Sample and Demonstration Efficiency in Reinforcement Learningcited by 12
- 2024Generalizing 6-DoF Grasp Detection via Domain Prior Knowledgecited by 11
- 2025Multi-Stage Manipulation with Demonstration-Augmented Reward, Policy, and World Model Learningcited by 10
- 2025Subtask-Aware Visual Reward Learning from Segmented Demonstrationscited by 7
- 2025Fail2Progress: Learning from Real-World Robot Failures with Stein Variational Inferencecited by 7
- 2024KOI: Accelerating Online Imitation Learning via Hybrid Key-state Guidancecited by 6
- 2025Universal Dexterous Functional Grasping via Demonstration-Editing Reinforcement Learningcited by 4
- 2023Multimodal Detection and Identification of Robot Manipulation Failurescited by 2
- 2025GraspCorrect: Robotic Grasp Correction via Vision-Language Model-Guided Feedbackcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Learning Actionable Manipulation Recovery via Counterfactual Failure Synthesis
- 2026Foresight: Failure Detection for Long-Horizon Robotic Manipulation with Action-Conditioned World Model Latents
- 2026ManiDreams: An Open-Source Library for Robust Object Manipulation via Uncertainty-aware Task-specific Intuitive Physics
- 2024FMB: a Functional Manipulation Benchmark for Generalizable Robotic Learning
- 2026From Reaction to Anticipation: Proactive Failure Recovery through Agentic Task Graph for Robotic Manipulation
- 2025RoboGrasp: A Universal Grasping Policy for Robust Robotic Control
- 2025RoboHiMan: A Hierarchical Evaluation Paradigm for Compositional Generalization in Long-Horizon Manipulation
- 2025RoboPilot: Generalizable Dynamic Robotic Manipulation with Dual-thinking Modes