The Bidding Games: Reinforcement Learning for MEV Extraction on Polygon Blockchain
On the map: Deep reinforcement learning methods → Adversarial robustness and RL in finance
Abstract (arXiv)
In blockchain networks, the strategic ordering of transactions within blocks has emerged as a significant source of profit extraction, known as Maximal Extractable Value (MEV). The transition from spam-based Priority Gas Auctions (PGA) to structured auction mechanisms like Polygon Atlas has transformed MEV extraction from public bidding wars into sealed-bid competitions under extreme time constraints. While this shift reduces network congestion, it introduces complex strategic challenges where searchers must make optimal bidding decisions within a sub-second window without knowledge of competitor behavior or presence. Traditional equilibrium-based game-theoretic models struggle in this high-frequency, partially observable environment. While auction theory provides equilibrium solutions for sealed-bid formats under incomplete information, these models typically assume known bidder value distributions and stationary competition--assumptions that are difficult to satisfy in dynamic, sub-second auctions where competitor presence and strategies evolve rapidly. We present a reinforcement learning framework for MEV extraction on Polygon Atlas and make three contributions: (1) A novel simulation environment that accurately models the stochastic arrival of arbitrage opportunities and probabilistic competition in Atlas auctions; (2) A PPO-based bidding agent optimized for real-time constraints, capable of adaptive strategy formulation in continuous action spaces while maintaining production-ready inference speeds; (3) Empirical validation demonstrating our history-conditioned agent achieves 49% Maximum-Profit Capture when deployed alongside existing searchers and a 43% relative profit improvement over the historical market leader in counterfactual replacement, significantly outperforming static bidding strategies.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Adversarial robustness and RL in finance, one of 15 directions in Deep reinforcement learning methods. Builds on 13 of its 60 references that are in the map. First posted on arXiv 16 Oct 2025.
Builds on
13 of 60 references.
References · 13
- 2017Real-Time Bidding by Reinforcement Learning in Display Advertisingcited by 91
- 2018Real-Time Bidding with Multi-Agent Reinforcement Learning in Display Advertisingcited by 65
- 2024Trajectory-wise Iterative Reinforcement Learning Framework for Auto-biddingcited by 9
- 2024Learning to Play Against Unknown Opponentscited by 3
- 2024Shill-Proof Auctionscited by 2
- 2025Prior-Independent Bidding Strategies for First-Price Auctionscited by 2
- 2023User Response in Ad Auctions: An MDP Formulation of Long-Term Revenue Optimizationcited by 1
- 2023Strategic Bidding Wars in On-chain Auctionscited by 1
- 2024Who Wins Ethereum Block Building Auctions and Why?cited by 1
- 2025On the Welfare of EIP-1559 with Patient Bidderscited by 1
- 2025Transaction Fee Mechanism Design for Leaderless Blockchain Protocolscited by 1
- 2025Equilibrium Computation in First-Price Auctions with Correlated Priorscited by 1
1 more
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Survey on Strategic Mining in Blockchain: A Reinforcement Learning Approach
- 2026ViperQ: Order Flow Pattern Recognition via Auction Market Theory for Reinforcement Learning Trading
- 2024Algorithmic Collusion And The Minimum Price Markov Game ↗
- 2026When AI Agents Meet MEV: Cross-Chain Arbitrage in the Agentic Economy
- 2026A3M: Adaptive, Adversarial and Multi-Objective Learning for Strategic Bidding in Repeated Auctions
- 2024Bitcoin under Volatile Block Rewards: How Mempool Statistics Can Influence Bitcoin Mining ↗
- 2026SAiFE-gym: Model-based Environments for Automated Market Making with Concentrated Liquidity
- 2024Deep Reinforcement Learning for Sequential Combinatorial Auctions