Future Predictive Success-or-Failure Classification for Long-Horizon Robotic Tasks
Not on the map. Why?
Abstract (arXiv)
Automating long-horizon tasks with a robotic arm has been a central research topic in robotics. Optimization-based action planning is an efficient approach for creating an action plan to complete a given task. Construction of a reliable planning method requires a design process of conditions, e.g., to avoid collision between objects. The design process, however, has two critical issues: 1) iterative trials--the design process is time-consuming due to the trial-and-error process of modifying conditions, and 2) manual redesign--it is difficult to cover all the necessary conditions manually. To tackle these issues, this paper proposes a future-predictive success-or-failure-classification method to obtain conditions automatically. The key idea behind the proposed method is an end-to-end approach for determining whether the action plan can complete a given task instead of manually redesigning the conditions. The proposed method uses a long-horizon future-prediction method to enable success-or-failure classification without the execution of an action plan. This paper also proposes a regularization term called transition consistency regularization to provide easy-to-predict feature distribution. The regularization term improves future prediction and classification performance. The effectiveness of our method is demonstrated through classification and robotic-manipulation experiments.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 34 references that are in the map. First posted on arXiv 4 Apr 2024.
Builds on
21 of 34 references.
References · 21
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
- 2018Learning Latent Dynamics for Planning from Pixelscited by 1,221
- 2022Planning with Diffusion for Flexible Behavior Synthesiscited by 1,023
- 2020Mastering Atari with Discrete World Modelscited by 990
- 2016Learning Hand-Eye Coordination for Robotic Grasping with Deep Learning and Large-Scale Data Collectioncited by 312
- 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrationscited by 308
- 20196-DOF GraspNet: Variational Grasp Generation for Object Manipulationcited by 237
- 2017Robotic Pick-and-Place of Novel Objects in Clutter with Multi-Affordance Grasping and Cross-Domain Image Matchingcited by 124
9 more
- 2021Learning Generalizable Robotic Reward Functions from "In-The-Wild" Human Videoscited by 116
- 2013Deep Learning for Detecting Robotic Graspscited by 114
- 2020Deep Visual Reasoning: Learning to Predict Action Sequences for Task and Motion Planning from an Initial Scene Imagecited by 45
- 2021Value Function Spaces: Skill-Centric State Abstractions for Long-Horizon Reasoningcited by 25
- 2018Learning Awareness Modelscited by 13
- 2020FINO-Net: A Deep Multimodal Sensor Fusion Framework for Manipulation Failure Detectioncited by 13
- 2020Robust Task and Motion Planning for Long-Horizon Architectural Construction Planningcited by 6
- 2022Visually Grounded Task and Motion Planning for Mobile Manipulationcited by 5
- 2020What went wrong?: Identification of Everyday Object Manipulation Anomaliescited by 3
Built on by
Not cited yet.