AHBid: An Adaptable Hierarchical Bidding Framework for Cross-Channel Advertising
On the map: Deep reinforcement learning methods → RL theory and sample complexity
Abstract (arXiv)
In online advertising, the inherent complexity and dynamic nature of advertising environments necessitate the use of auto-bidding services to assist advertisers in bid optimization. This complexity is further compounded in multi-channel scenarios, where effective allocation of budgets and constraints across channels with distinct behavioral patterns becomes critical for optimizing return on investment. Current approaches predominantly rely on either optimization-based strategies or reinforcement learning techniques. However, optimization-based methods lack flexibility in adapting to dynamic market conditions, while reinforcement learning approaches often struggle to capture essential historical dependencies and observational patterns within the constraints of Markov Decision Process frameworks. To address these limitations, we propose AHBid, an Adaptable Hierarchical Bidding framework that integrates generative planning with real-time control. The framework employs a high-level generative planner based on diffusion models to dynamically allocate budgets and constraints by effectively capturing historical context and temporal patterns. We introduce a constraint enforcement mechanism to ensure compliance with specified constraints, along with a trajectory refinement mechanism that enhances adaptability to environmental changes through the utilization of historical data. The system further incorporates a control-based bidding algorithm that synergistically combines historical knowledge with real-time information, significantly improving both adaptability and operational efficacy. Extensive experiments conducted on large-scale offline datasets and through online A/B tests demonstrate the effectiveness of AHBid, yielding a 13.57% increase in overall return compared to existing baselines.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL theory and sample complexity, one of 15 directions in Deep reinforcement learning methods. Builds on 17 of its 40 references that are in the map. First posted on arXiv 26 Feb 2026.
Builds on
17 of 40 references.
References · 17
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2022Is Conditional Generative Modeling all you need for Decision-Making?cited by 516
- 2023AdaptDiffuser: Diffusion Models as Adaptive Self-evolving Plannerscited by 149
- 2023Diffusion Model is an Effective Planner and Data Synthesizer for Multi-Task Reinforcement Learningcited by 115
- 2018Budget Constrained Bidding by Model-free Reinforcement Learning in Display Advertisingcited by 61
- 2019Bid Optimization by Multivariable Control in Display Advertisingcited by 37
- 2018Deep Reinforcement Learning for Sponsored Search Real-time Biddingcited by 34
- 2022Sustainable Online Reinforcement Learning for Auto-biddingcited by 29
- 2024Auto-bidding and Auctions in Online Advertising: A Surveycited by 26
- 2021Stochastic Bandits for Multi-platform Budget Optimization in Online Advertisingcited by 25
- 2025Generative Auto-Bidding with Value-Guided Explorationscited by 23
5 more
- 2020Online Joint Bid/Daily Budget Optimization of Internet Advertising Campaignscited by 16
- 2023Model-based Constrained MDP for Budget Allocation in Sequential Incentive Marketingcited by 15
- 2023Multi-channel Autobidding with Budget and ROI Constraintscited by 14
- 2021Multi-Agent Cooperative Bidding Games for Multi-Objective Optimization in e-Commercial Sponsored Searchcited by 7
- 2025An Adaptable Budget Planner for Enhancing Budget-Constrained Auto-Bidding in Online Advertisingcited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026HOBA: Hierarchical On-Policy Bidding Agents for Adaptive Online Advertising
- 2023HiBid: A Cross-Channel Constrained Bidding System with Budget Allocation by Hierarchical Offline Deep Reinforcement Learning
- 2026Generative Auto-Bidding with Unified Modeling and Exploration
- 2024Hierarchical Multi-agent Meta-Reinforcement Learning for Cross-channel Bidding
- 2024AIGB: Generative Auto-bidding via Conditional Diffusion Modeling
- 2025Expert-Guided Diffusion Planner for Auto-Bidding
- 2026AIGB-R1: Self-Evolving Generative Auto-Bidding via Hierarchical Planner-Executor Optimization
- 2026JD-BP: A Joint-Decision Generative Framework for Auto-Bidding and Pricing