mlsanityData to 14 Oct 2026

Multi-market value-stacking: Battery control for combined imbalance participation and non-uniform FCR bidding

arXiv 2605.23964 ↗First posted 12 May 2026eess.SY cs.AI cs.SYcited by 0

Not on the map. Why?

Abstract (arXiv)

The growing share of Renewable Energy Sources (RES) in modern power systems increases both grid imbalances and frequency deviations, reinforcing the need for ancillary services such as Frequency Containment Reserve (FCR) and passive balancing. Battery Energy Storage Systems (BESS) are well-suited for these services, but prior research typically relies on uniform FCR bids that remain constant throughout the control period. Such static bids fail to fully exploit BESS flexibility, as they do not balance the trade-off between reserving energy for FCR delivery and using it for imbalance arbitrage, limiting the achievable value in value-stacking settings. To address this limitation, we propose a two-stage control framework for the European context that introduces non-uniform FCR bids. In the first stage, we derive a time-varying bid sequence using data-driven Monte Carlo (MC) optimization. In the second stage, a Deep Reinforcement Learning (DRL) agent leverages the residual flexibility for real-time imbalance trading while proactively managing the State of Energy (SoE) to ensure compliance with FCR requirements. The framework is presented as a proof of concept, highlighting the potential benefits of time-varying bidding strategies. By incorporating daily cycle budgets and time-varying reserve commitments, our approach achieves a 7.56% profit increase compared to uniform baselines. These results show that non-uniform bidding can unlock additional value by more effectively aligning reserve obligations with rapidly changing imbalance opportunities.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 27 references that are in the map. First posted on arXiv 12 May 2026.

Builds on

6 of 27 references.

References · 6

  1. 2015Deep Reinforcement Learning with Double Q-learningcited by 1,745
  2. 2017Energy Storage Arbitrage in Real-Time Markets via Reinforcement Learningcited by 14
  3. 2013Impact of Low Rotational Inertia on Power System Stability and Operationcited by 5
  4. 2023Distributional Reinforcement Learning-based Energy Arbitrage Strategies in Imbalance Settlement Mechanismcited by 5
  5. 2024Coordinated Trading Strategies for Battery Storage in Reserve and Spot Marketscited by 1
  6. 2025Joint Bidding on Intraday and Frequency Containment Reserve Marketscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Temporal-Aware Deep Reinforcement Learning for Energy Storage Bidding in Energy and Contingency Reserve Markets
  2. 2024Large Language Model Assisted Optimal Bidding of BESS in FCAS Market: An AI-agent based Approach
  3. 2025Price Aware Power Split Control in Heterogeneous Battery Storage Systems ↗
  4. 2024Predicting and Publishing Accurate Imbalance Prices Using Monte Carlo Tree Search
  5. 2026Optimal design of solar-battery hybrid resources considering multi-market participation under weather and price uncertainty ↗
  6. 2024Attentive Convolutional Deep Reinforcement Learning for Optimizing Solar-Storage Systems in Real-Time Electricity Markets
  7. 2024Adaptive BESS and Grid Setpoints Optimization: A Model-Free Framework for Efficient Battery Management under Dynamic Tariff Pricing
  8. 2024Control Policy Correction Framework for Reinforcement Learning-based Energy Arbitrage Strategies