mlsanityData to 14 Oct 2026

Blockchain-assisted Demonstration Cloning for Multi-Agent Deep Reinforcement Learning

arXiv 2501.10938 ↗First posted 19 Jan 2025cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Multi-Agent Deep Reinforcement Learning (MDRL) is a promising research area in which agents learn complex behaviors in cooperative or competitive environments. However, MDRL comes with several challenges that hinder its usability, including sample efficiency, curse of dimensionality, and environment exploration. Recent works proposing Federated Reinforcement Learning (FRL) to tackle these issues suffer from problems related to model restrictions and maliciousness. Other proposals using reward shaping require considerable engineering and could lead to local optima. In this paper, we propose a novel Blockchain-assisted Multi-Expert Demonstration Cloning (MEDC) framework for MDRL. The proposed method utilizes expert demonstrations in guiding the learning of new MDRL agents, by suggesting exploration actions in the environment. A model sharing framework on Blockchain is designed to allow users to share their trained models, which can be allocated as expert models to requesting users to aid in training MDRL systems. A Consortium Blockchain is adopted to enable traceable and autonomous execution without the need for a single trusted entity. Smart Contracts are designed to manage users and models allocation, which are shared using IPFS. The proposed framework is tested on several applications, and is benchmarked against existing methods in FRL, Reward Shaping, and Imitation Learning-assisted RL. The results show the outperformance of the proposed framework in terms of learning speed and resiliency to faulty and malicious models.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 54 references that are in the map. First posted on arXiv 19 Jan 2025.

Builds on

21 of 54 references.

References · 21

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 2,026
  3. 2020Knowledge Distillation: A Surveycited by 1,603
  4. 2019Dota 2 with Large Scale Deep Reinforcement Learningcited by 1,103
  5. 2017Overcoming Exploration in Reinforcement Learning with Demonstrationscited by 340
  6. 2017Leveraging Demonstrations for Deep Reinforcement Learning on Robotics Problems with Sparse Rewardscited by 319
  7. 2019Emergent Tool Use From Multi-Agent Autocurriculacited by 313
  8. 2021Federated Learning for Internet of Things: A Comprehensive Surveycited by 252
  9. 2018Deep Reinforcement Learning for Multi-Agent Systems: A Review of Challenges, Solutions and Applicationscited by 127
  10. 2020Learning to Utilize Shaping Rewards: A New Approach of Reward Shapingcited by 114
  11. 2018PRIMAL: Pathfinding via Reinforcement and Imitation Multi-Agent Learningcited by 90
  12. 2021Federated Reinforcement Learning: Techniques, Applications, and Open Challengescited by 81
9 more
  1. 2018In-Edge AI: Intelligentizing Mobile Edge Computing, Caching and Communication by Federated Learningcited by 80
  2. 2019Lifelong Federated Reinforcement Learning: A Learning Architecture for Navigation in Cloud Robotic Systemscited by 78
  3. 2021Federated Learning Meets Blockchain in Edge Computing: Opportunities and Challengescited by 76
  4. 2014IPFS - Content Addressed, Versioned, P2P File Systemcited by 70
  5. 2020PRIMAL2: Pathfinding via Reinforcement and Imitation Multi-Agent Learning -- Lifelongcited by 63
  6. 2021Fault-Tolerant Federated Reinforcement Learning with Theoretical Guaranteecited by 54
  7. 2019Federated Transfer Reinforcement Learning for Autonomous Drivingcited by 44
  8. 2020Federated Multi-Agent Actor-Critic Learning for Age Sensitive Mobile Edge Computingcited by 9
  9. 2022Reward Shaping Using Convolutional Neural Networkcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Large Language Model Federated Learning with Blockchain and Unlearning for Cross-Organizational Collaboration
  2. 2025Incentive-Based Federated Learning: Architectural Elements and Future Directions
  3. 2025FedHPD: Heterogeneous Federated Reinforcement Learning via Policy Distillation
  4. 2024Beyond Joint Demonstrations: Personalized Expert Guidance for Efficient Multi-Agent Reinforcement Learning
  5. 2022On Decentralizing Federated Reinforcement Learning in Multi-Robot Scenarios
  6. 2025Towards Transparent and Incentive-Compatible Collaboration in Decentralized LLM Multi-Agent Systems: A Blockchain-Driven Approach
  7. 2023MACCA: Offline Multi-agent Reinforcement Learning with Causal Credit Assignment
  8. 2025Enabling Regulatory Multi-Agent Collaboration: Architecture, Challenges, and Solutions