mlsanityData to 7 Oct 2026

Future Predictive Success-or-Failure Classification for Long-Horizon Robotic Tasks

arXiv 2404.03415 ↗First posted 4 Apr 2024cs.RO cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Automating long-horizon tasks with a robotic arm has been a central research topic in robotics. Optimization-based action planning is an efficient approach for creating an action plan to complete a given task. Construction of a reliable planning method requires a design process of conditions, e.g., to avoid collision between objects. The design process, however, has two critical issues: 1) iterative trials--the design process is time-consuming due to the trial-and-error process of modifying conditions, and 2) manual redesign--it is difficult to cover all the necessary conditions manually. To tackle these issues, this paper proposes a future-predictive success-or-failure-classification method to obtain conditions automatically. The key idea behind the proposed method is an end-to-end approach for determining whether the action plan can complete a given task instead of manually redesigning the conditions. The proposed method uses a long-horizon future-prediction method to enable success-or-failure classification without the execution of an action plan. This paper also proposes a regularization term called transition consistency regularization to provide easy-to-predict feature distribution. The regularization term improves future prediction and classification performance. The effectiveness of our method is demonstrated through classification and robotic-manipulation experiments.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 34 references that are in the map. First posted on arXiv 4 Apr 2024.

Builds on

21 of 34 references.

References · 21

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
  4. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
  5. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
  6. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,221
  7. 2022Planning with Diffusion for Flexible Behavior Synthesiscited by 1,023
  8. 2020Mastering Atari with Discrete World Modelscited by 990
  9. 2016Learning Hand-Eye Coordination for Robotic Grasping with Deep Learning and Large-Scale Data Collectioncited by 312
  10. 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrationscited by 308
  11. 20196-DOF GraspNet: Variational Grasp Generation for Object Manipulationcited by 237
  12. 2017Robotic Pick-and-Place of Novel Objects in Clutter with Multi-Affordance Grasping and Cross-Domain Image Matchingcited by 124
9 more
  1. 2021Learning Generalizable Robotic Reward Functions from "In-The-Wild" Human Videoscited by 116
  2. 2013Deep Learning for Detecting Robotic Graspscited by 114
  3. 2020Deep Visual Reasoning: Learning to Predict Action Sequences for Task and Motion Planning from an Initial Scene Imagecited by 45
  4. 2021Value Function Spaces: Skill-Centric State Abstractions for Long-Horizon Reasoningcited by 25
  5. 2018Learning Awareness Modelscited by 13
  6. 2020FINO-Net: A Deep Multimodal Sensor Fusion Framework for Manipulation Failure Detectioncited by 13
  7. 2020Robust Task and Motion Planning for Long-Horizon Architectural Construction Planningcited by 6
  8. 2022Visually Grounded Task and Motion Planning for Mobile Manipulationcited by 5
  9. 2020What went wrong?: Identification of Everyday Object Manipulation Anomaliescited by 3

Built on by

Not cited yet.