DRAE: Dynamic Retrieval-Augmented Expert Networks for Lifelong Learning and Task Adaptation in Robotics
On the map: Retrieval-augmented generation → Agentic RAG, agents and memory
Abstract (arXiv)
We introduce Dynamic Retrieval-Augmented Expert Networks (DRAE), a groundbreaking architecture that addresses the challenges of lifelong learning, catastrophic forgetting, and task adaptation by combining the dynamic routing capabilities of Mixture-of-Experts (MoE); leveraging the knowledge-enhancement power of Retrieval-Augmented Generation (RAG); incorporating a novel hierarchical reinforcement learning (RL) framework; and coordinating through ReflexNet-SchemaPlanner-HyperOptima (RSHO).DRAE dynamically routes expert models via a sparse MoE gating mechanism, enabling efficient resource allocation while leveraging external knowledge through parametric retrieval (P-RAG) to augment the learning process. We propose a new RL framework with ReflexNet for low-level task execution, SchemaPlanner for symbolic reasoning, and HyperOptima for long-term context modeling, ensuring continuous adaptation and memory retention. Experimental results show that DRAE significantly outperforms baseline approaches in long-term task retention and knowledge reuse, achieving an average task success rate of 82.5% across a set of dynamic robotic manipulation tasks, compared to 74.2% for traditional MoE models. Furthermore, DRAE maintains an extremely low forgetting rate, outperforming state-of-the-art methods in catastrophic forgetting mitigation. These results demonstrate the effectiveness of our approach in enabling flexible, scalable, and efficient lifelong learning for robotics.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Agentic RAG, agents and memory, one of 15 directions in Retrieval-augmented generation. Builds on 34 of its 58 references that are in the map. First posted on arXiv 7 Jul 2025.
Builds on
34 of 58 references.
References · 34
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,584
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2016Progressive Neural Networkscited by 1,361
- 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,330
22 more
- 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,105
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 740
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 703
- 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 485
- 2016The Option-Critic Architecturecited by 448
- 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarkingcited by 354
- 2017FeUdal Networks for Hierarchical Reinforcement Learningcited by 337
- 2024HybridRAG: Integrating Knowledge Graphs and Vector Retrieval Augmented Generation for Efficient Information Extractioncited by 93
- 2024DRAMA: An Efficient End-to-end Motion Planner for Autonomous Driving with Mambacited by 87
- 2024Blended RAG: Improving RAG (Retriever-Augmented Generation) Accuracy with Semantic Search and Hybrid Query-Based Retrieverscited by 84
- 2023SkillDiffuser: Interpretable Hierarchical Planning via Skill Abstractions in Diffusion-Based Task Executioncited by 70
- 2023DexArt: Benchmarking Generalizable Dexterous Manipulation with Articulated Objectscited by 66
- 2024Sparse Diffusion Policy: A Sparse, Reusable, and Flexible Policy for Robot Learningcited by 57
- 2023SPOC: Imitating Shortest Paths in Simulation Enables Effective Navigation and Manipulation in the Real Worldcited by 48
- 2021Lifelong Robotic Reinforcement Learning by Retaining Experiencescited by 34
- 2024Learning from Massive Human Videos for Universal Humanoid Pose Controlcited by 29
- 2023Enhancing NeRF akin to Enhancing LLMs: Generalizable NeRF Transformer with Mixture-of-View-Expertscited by 27
- 2023Catastrophic Forgetting in Deep Learning: A Comprehensive Taxonomycited by 24
- 2024Human-Aware Vision-and-Language Navigation: Bridging Simulation to Reality with Dynamic Human Interactionscited by 19
- 2024Learning More Generalized Experts by Merging Experts in Mixture-of-Expertscited by 12
- 2024T2M-X: Learning Expressive Text-to-Motion Generation from Partially Annotated Datacited by 4
Built on by
Citing papers per year: 2025: 4; 2026: 4.
8 papers.
- 2025Robust Finetuning of Vision-Language-Action Robot Policies via Parameter Mergingcited by 22
- 2025ExpReS-VLA: Specializing Vision-Language-Action Models Through Experience Replay and Retrievalcited by 7
- 2025Dynamic Nested Hierarchies: Pioneering Self-Evolution in Machine Learning Architectures for Lifelong Intelligencecited by 1
- 2025FT-NCFM: An Influence-Aware Data Distillation Framework for Efficient VLA Modelscited by 1
- 2026Theoretical Foundations of Continual Learning via Drift-Plus-Penaltycited by 1
- 2026ARIS: Agentic and Relationship Intelligence System for Social Robotscited by 0
- 2026Don't Fool Me Twice: Adapting to Adversity in the Wild with Experience-Driven Reasoningcited by 0
- 2026LivingRAG: Augmenting Graph RAG with Experiencecited by 0
- 2026LivingRAG: Augmenting Graph RAG with Experience26 Aug 2026
- 2026Theoretical Foundations of Continual Learning via Drift-Plus-Penalty7 Jun 2026
- 2026Don't Fool Me Twice: Adapting to Adversity in the Wild with Experience-Driven Reasoning29 May 2026
- 2026ARIS: Agentic and Relationship Intelligence System for Social Robots1 May 2026
- 2025Robust Finetuning of Vision-Language-Action Robot Policies via Parameter Merging9 Dec 2025
- 2025FT-NCFM: An Influence-Aware Data Distillation Framework for Efficient VLA Models20 Nov 2025
- 2025Dynamic Nested Hierarchies: Pioneering Self-Evolution in Machine Learning Architectures for Lifelong Intelligence18 Nov 2025
- 2025ExpReS-VLA: Specializing Vision-Language-Action Models Through Experience Replay and Retrieval9 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2024Optimizing Robotic Manipulation with Decision-RWKV: A Recurrent Sequence Modeling Approach for Lifelong Learning
- 2026LiMoDE: Rethinking Lifelong Robot Manipulation from a Mixture-of-Dynamic-Experts Perspective
- 2024Retrieval-Augmented Hierarchical in-Context Reinforcement Learning and Hindsight Modular Reflections for Task Planning with LLMs
- 2026Dynamic Mixture of Latent Memories for Self-Evolving Agents
- 2026RA-VLA: Retrieval-Augmented VLA for Test-Time Adaptation
- 2026RoboHarn-Evo: Evolving Hierarchical Physical Knowledge for Self-Improving Robotic Manipulation
- 2026Hierarchical Skill Retrieval for Data-Efficient Adaptation of Vision-Language-Action Models
- 2025Dynamic Expert Specialization: Towards Catastrophic Forgetting-Free Multi-Domain MoE Adaptation