mlsanityData to 7 Oct 2026

UF-RNN: Real-Time Adaptive Motion Generation Using Uncertainty-Driven Foresight Prediction

arXiv 2510.10217 ↗First posted 11 Oct 2025cs.RO cs.AIcited by 0

On the map: Offline RL and imitation learning from data → Robot learning from demonstration

Abstract (arXiv)

Training robots to operate effectively in environments with uncertain states, such as ambiguous object properties or unpredictable interactions, remains a longstanding challenge in robotics. Imitation learning methods typically rely on successful examples and often neglect failure scenarios where uncertainty is most pronounced. To address this limitation, we propose the Uncertainty-driven Foresight Recurrent Neural Network (UF-RNN), a model that combines standard time-series prediction with an active "Foresight" module. This module performs internal simulations of multiple future trajectories and refines the hidden state to minimize predicted variance, enabling the model to selectively explore actions under high uncertainty. We evaluate UF-RNN on a door-opening task in both simulation and a real-robot setting, demonstrating that, despite the absence of explicit failure demonstrations, the model exhibits robust adaptation by leveraging self-induced chaotic dynamics in its latent space. When guided by the Foresight module, these chaotic properties stimulate exploratory behaviors precisely when the environment is ambiguous, yielding improved success rates compared to conventional stochastic RNN baselines. These findings suggest that integrating uncertainty-driven foresight into imitation learning pipelines can significantly enhance a robot's ability to handle unpredictable real-world conditions.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Robot learning from demonstration, one of 13 directions in Offline RL and imitation learning from data. Builds on 16 of its 33 references that are in the map. First posted on arXiv 11 Oct 2025.

Builds on

16 of 33 references.

References · 16

  1. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
  2. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  3. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
  4. 2017Curiosity-driven Exploration by Self-supervised Predictioncited by 1,173
  5. 2015End-to-End Training of Deep Visuomotor Policiescited by 847
  6. 2020robosuite: A Modular Simulation Framework and Benchmark for Robot Learningcited by 484
  7. 2018An Algorithmic Perspective on Imitation Learningcited by 455
  8. 2015A Recurrent Latent Variable Model for Sequential Datacited by 362
  9. 2019Self-Supervised Exploration via Disagreementcited by 263
  10. 2017DART: Noise Injection for Robust Imitation Learningcited by 187
  11. 2024Estimating Epistemic and Aleatoric Uncertainty with a Single Modelcited by 52
  12. 2020Reinforcement Learning through Active Inferencecited by 47
4 more
  1. 2017Deep Active Inferencecited by 44
  2. 2024Learning to Open and Traverse Doors with a Legged Manipulatorcited by 14
  3. 2023Deep Predictive Learning: Motion Learning Concept inspired by Cognitive Roboticscited by 7
  4. 2022Deep Active Visual Attention for Real-time Robot Motion Generation: Emergence of Tool-body Assimilation and Adaptive Tool-usecited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025RISE: Robust Imitation through Stochastic Encoding
  2. 2026Learning Foresight without Explicit Trajectories for 3D Diffusion Policies
  3. 2026When to Trust Imagination: Adaptive Action Execution for World Action Models
  4. 2024Uncertainty-Aware Deployment of Pre-trained Language-Conditioned Imitation Learning Policies
  5. 2026InternVLA-A1.5: Unifying Understanding, Latent Foresight, and Action for Compositional Generalization
  6. 2025Inference-Time Enhancement of Generative Robot Policies via Predictive World Modeling
  7. 2020Learning to Plan Optimistically: Uncertainty-Guided Deep Exploration via Latent Model Ensembles
  8. 2026Where Should Action Generation Begin? A Learnable Source Prior for Generative Robot Policies