mlsanityData to 14 Oct 2026

Reinforcement Learning-driven Data-intensive Workflow Scheduling for Volunteer Edge-Cloud

arXiv 2407.01428 ↗First posted 1 Jul 2024cs.DC cs.AIcited by 5

On the map: Deep reinforcement learning methods → RL for energy, networks and operations

Abstract (arXiv)

In recent times, Volunteer Edge-Cloud (VEC) has gained traction as a cost-effective, community computing paradigm to support data-intensive scientific workflows. However, due to the highly distributed and heterogeneous nature of VEC resources, centralized workflow task scheduling remains a challenge. In this paper, we propose a Reinforcement Learning (RL)-driven data-intensive scientific workflow scheduling approach that takes into consideration: i) workflow requirements, ii) VEC resources' preference on workflows, and iii) diverse VEC resource policies, to ensure robust resource allocation. We formulate the long-term average performance optimization problem as a Markov Decision Process, which is solved using an event-based Asynchronous Advantage Actor-Critic RL approach. Our extensive simulations and testbed implementations demonstrate our approach's benefits over popular baseline strategies in terms of workflow requirement satisfaction, VEC preference satisfaction, and available VEC resource utilization.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in RL for energy, networks and operations, one of 15 directions in Deep reinforcement learning methods. Builds on 1 of its 32 references that are in the map. First posted on arXiv 1 Jul 2024.

Builds on

1 of 32 references.

References · 1

  1. 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,258

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 2.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Cloud Workflow Scheduling Based on Graph Attention-Driven Hierarchical Reinforcement Learning
  2. 2025Research on Edge Computing and Cloud Collaborative Resource Scheduling Optimization Based on Deep Reinforcement Learning
  3. 2026Deft Scheduling of Dynamic Cloud Workflows with Varying Deadlines via Mixture-of-Experts
  4. 2024Cost-Aware Dynamic Cloud Workflow Scheduling using Self-Attention and Evolutionary Reinforcement Learning
  5. 2026Decentralized Task Scheduling in Distributed Systems: A Deep Reinforcement Learning Approach
  6. 2024Towards using Reinforcement Learning for Scaling and Data Replication in Cloud Systems
  7. 2025Multi-Agent Reinforcement Learning for Adaptive Resource Orchestration in Cloud-Native Clusters
  8. 2026On the Role of DAG topology in Energy-Aware Cloud Scheduling : A GNN-Based Deep Reinforcement Learning Approach