mlsanityData to 7 Oct 2026

Grasp-Then-Plan with Failure Attribution: A Closed Two-Stage Framework for Precise and Generalizable Robotic Manipulation

arXiv 2606.03385 ↗First posted 2 Jun 2026cs.RO cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

In robotic manipulation, the tight coupling between grasping and motion planning often obscures the true source of failure, leading to inefficient trial-and-error. To enable efficient long-horizon manipulation, we propose GTP-FA (Grasp-Then-Plan with Failure Attribution), a task-oriented two-stage grasp-then-plan framework that generates grasp candidates and performs downstream motion planning conditioned on the selected grasp. Given a failed manipulation trajectory, we learn a failure attribution model that generalizes to unseen grasps and produces a stable distribution over failure modes for diagnosis-guided optimization. Based on these attribution results, we then optimize both modules in a diagnosis-driven manner: on the grasping side, we inject task-level priors and risk penalties into grasp candidate scoring and optimization to suppress unstable or task-incompatible grasps; on the planning side, we target high-risk initial states through data collection and fine-tuning to address genuine planning bottlenecks. We evaluate the proposed framework in both simulation and real-robot experiments, and show that GTP-FA improves the corresponding base learners across RL, IL, diffusion-policy, and VLA-based settings, achieving substantially higher overall task success rates.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 35 references that are in the map. First posted on arXiv 2 Jun 2026.

Builds on

31 of 35 references.

References · 31

  1. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  2. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  3. 2023Efficient Online Reinforcement Learning with Offline Datacited by 332
  4. 2025π*0.6: a VLA That Learns From Experiencecited by 280
  5. 20196-DOF GraspNet: Variational Grasp Generation for Object Manipulationcited by 237
  6. 2023LIV: Language-Image Representations and Rewards for Robotic Controlcited by 180
  7. 2024Data Scaling Laws in Imitation Learning for Robotic Manipulationcited by 144
  8. 2023RoboCLIP: One Demonstration is Enough to Learn Robot Policiescited by 128
  9. 2022SE(3)-DiffusionFields: Learning smooth cost functions for joint grasp and motion optimization through diffusioncited by 125
  10. 2024AHA: A Vision-Language-Model for Detecting and Reasoning Over Failures in Robotic Manipulationcited by 118
  11. 2024CoPa: General Robotic Manipulation through Spatial Constraints of Parts with Foundation Modelscited by 97
  12. 2024LLARVA: Vision-Action Instruction Tuning Enhances Robot Learningcited by 87
19 more
  1. 2024Unpacking Failure Modes of Generative Policies: Runtime Monitoring of Consistency and Progresscited by 63
  2. 2024Policy Decorator: Model-Agnostic Online Refinement for Large Policy Modelcited by 60
  3. 2021CaTGrasp: Learning Category-Level Task-Relevant Grasping in Clutter from Simulationcited by 49
  4. 2024Grasp as You Say: Language-guided Dexterous Grasp Generationcited by 39
  5. 2025FailSafe: Reasoning and Recovery from Failures in Vision-Language-Action Modelscited by 33
  6. 2022Neural Grasp Distance Fields for Robot Manipulationcited by 31
  7. 2025STARE-VLA: Progressive Stage-Aware Reinforcement for Fine-Tuning Vision-Language-Action Modelscited by 24
  8. 2024FoundationGrasp: Generalizable Task-Oriented Grasping with Foundation Modelscited by 16
  9. 2025RoboDexVLM: Visual Language Model-Enabled Task Planning and Motion Control for Dexterous Robot Manipulationcited by 15
  10. 2023Task-Oriented Grasp Prediction with Visual-Language Inputscited by 14
  11. 2024Reverse Forward Curriculum Learning for Extreme Sample and Demonstration Efficiency in Reinforcement Learningcited by 12
  12. 2024Generalizing 6-DoF Grasp Detection via Domain Prior Knowledgecited by 11
  13. 2025Multi-Stage Manipulation with Demonstration-Augmented Reward, Policy, and World Model Learningcited by 10
  14. 2025Subtask-Aware Visual Reward Learning from Segmented Demonstrationscited by 7
  15. 2025Fail2Progress: Learning from Real-World Robot Failures with Stein Variational Inferencecited by 7
  16. 2024KOI: Accelerating Online Imitation Learning via Hybrid Key-state Guidancecited by 6
  17. 2025Universal Dexterous Functional Grasping via Demonstration-Editing Reinforcement Learningcited by 4
  18. 2023Multimodal Detection and Identification of Robot Manipulation Failurescited by 2
  19. 2025GraspCorrect: Robotic Grasp Correction via Vision-Language Model-Guided Feedbackcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Learning Actionable Manipulation Recovery via Counterfactual Failure Synthesis
  2. 2026Foresight: Failure Detection for Long-Horizon Robotic Manipulation with Action-Conditioned World Model Latents
  3. 2026ManiDreams: An Open-Source Library for Robust Object Manipulation via Uncertainty-aware Task-specific Intuitive Physics
  4. 2024FMB: a Functional Manipulation Benchmark for Generalizable Robotic Learning
  5. 2026From Reaction to Anticipation: Proactive Failure Recovery through Agentic Task Graph for Robotic Manipulation
  6. 2025RoboGrasp: A Universal Grasping Policy for Robust Robotic Control
  7. 2025RoboHiMan: A Hierarchical Evaluation Paradigm for Compositional Generalization in Long-Horizon Manipulation
  8. 2025RoboPilot: Generalizable Dynamic Robotic Manipulation with Dual-thinking Modes