mlsanityData to 14 Oct 2026

Generative Auto-Bidding with Unified Modeling and Exploration

arXiv 2605.19457 ↗First posted 19 May 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Automated bidding is central to modern digital advertising. Early rule-based methods lacked adaptability, while subsequent Reinforcement Learning approaches modeled bidding as a Markov Decision Process but struggled with long-term dependencies. Recent generative models show promise, yet they lack explicit mechanisms to balance exploration and safety, relying solely on action perturbations or trajectory guidance without a safety fallback. This results in inefficient exploration and elevated financial risk for advertising platforms. To address this gap, we propose GUIDE (Generative Auto-Bidding with Unified Modeling and Exploration), a framework that synergistically integrates directed exploration with a safe fallback mechanism. GUIDE employs a Decision Transformer (DT) to jointly model historical bidding actions and environmental state transitions. A Q-value module guides the DT's exploration via regularization constraints, while an Inverse Dynamics Module (IDM) leverages DT-predicted future states to infer robust, behaviorally consistent actions as a safe policy fallback. The Q-value module then adaptively selects the final action between these two options, balancing exploration and safety. Together, these components form an integrated "explore-safeguard-select" pipeline that unifies efficiency and safety. We conduct extensive experiments on public datasets, in simulated auction environments, and through large-scale online deployment on Taobao, a leading Chinese advertising platform. Results show GUIDE consistently outperforms state-of-the-art baselines across all scenarios. In real-world deployment, GUIDE achieves notable gains: +4.10% ad GMV, +1.40% ad clicks, +1.66% ad cost, and +3.52% ad ROI, demonstrating its effectiveness and strong industrial applicability.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 42 references that are in the map. First posted on arXiv 19 May 2026.

Builds on

22 of 42 references.

References · 22

  1. 2020Scaling Laws for Neural Language Modelscited by 6,586
  2. 2020Conservative Q-Learning for Offline Reinforcement Learningcited by 1,809
  3. 2021Offline Reinforcement Learning with Implicit Q-Learningcited by 1,293
  4. 2021A Minimalist Approach to Offline Reinforcement Learningcited by 899
  5. 2019Benchmarking Batch Deep Reinforcement Learning Algorithmscited by 111
  6. 2017Online Convex Optimization with Stochastic Constraintscited by 95
  7. 2017Real-Time Bidding by Reinforcement Learning in Display Advertisingcited by 91
  8. 2023MADiff: Offline Multi-agent Learning with Diffusion Modelscited by 75
  9. 2018Real-Time Bidding with Multi-Agent Reinforcement Learning in Display Advertisingcited by 65
  10. 2025What Makes a Good Diffusion Planner for Decision Making?cited by 38
  11. 2019Bid Optimization by Multivariable Control in Display Advertisingcited by 37
  12. 2013Real-time Bidding for Online Advertising: Measurement and Analysiscited by 32
10 more
  1. 2022Sustainable Online Reinforcement Learning for Auto-biddingcited by 29
  2. 2024AuctionNet: A Novel Benchmark for Decision-Making in Large-Scale Gamescited by 28
  3. 2025Generative Auto-Bidding with Value-Guided Explorationscited by 23
  4. 2016Feedback Control of Real-Time Display Advertisingcited by 22
  5. 2021A Cooperative-Competitive Multi-Agent Framework for Auto-bidding in Online Advertisingcited by 22
  6. 2025RTBAgent: A LLM-based Agent System for Real-Time Biddingcited by 14
  7. 2024Trajectory-wise Iterative Reinforcement Learning Framework for Auto-biddingcited by 9
  8. 2025Optimal Return-to-Go Guided Decision Transformer for Auto-Bidding in Advertisementcited by 4
  9. 2025Expert-Guided Diffusion Planner for Auto-Biddingcited by 2
  10. 2025Bid2X: Revealing Dynamics of Bidding Environment in Online Advertising from A Foundation Model Lenscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026AHBid: An Adaptable Hierarchical Bidding Framework for Cross-Channel Advertising
  2. 2024AIGB: Generative Auto-bidding via Conditional Diffusion Modeling
  3. 2026Q-Regularized Generative Auto-Bidding: From Suboptimal Trajectories to Optimal Policies
  4. 2026DRIVE: Distributional and Retrieval-Augmented Bidding with Value Evaluation
  5. 2026AIGB-R1: Self-Evolving Generative Auto-Bidding via Hierarchical Planner-Executor Optimization
  6. 2025Enhancing Generative Auto-bidding with Offline Reward Evaluation and Policy Search
  7. 2026OneBid: A Unified Auto-Bidding Foundation Model for Diverse oCPX Advertising Scenarios
  8. 2025Generative Large-Scale Pre-trained Models for Automated Ad Bidding Optimization