OneBid: A Unified Auto-Bidding Foundation Model for Diverse oCPX Advertising Scenarios
New in Offline RL and imitation learning from data; no direction yet. Offline RL and imitation learning from data
Abstract (arXiv)
Auto-bidding is central to computational advertising, where strategies must maximize advertisers' conversion value under economic constraints. It has evolved from rule-based controllers to reinforcement learning and generative methods such as Decision Transformer (DT). Yet these methods increasingly mismatch the prevailing optimized cost-per-X (oCPX) paradigm, which spans heterogeneous scenarios (e.g., registration, purchase), each served by a separate model, leading to fragmented pipelines and underexploring cross-scenario modeling. Inspired by foundation models like LLMs, unifying these oCPX scenarios into one model raises three challenges: multi-objective control, scalable capacity under strict latency, and safe offline policy improvement. We present OneBid, a unified auto-bidding foundation model that learns a reusable backbone from heterogeneous oCPX logs and adapts it to scenario-specific deployments via offline post-training. Building on DT, OneBid extends single Return-to-Go conditioning to two atomic signals, Return-to-Go for conversion value and Cost-to-Go for cost ratio, plus value-aware regularization on next-action prediction. To absorb distributional heterogeneity, we design a sequence-level Mixture-of-Experts architecture, where shared experts encode cross-scenario knowledge and sparsely-routed experts capture scenario-specific patterns at low latency, yielding consistent scaling with model size and data. During post-training, we align the backbone with scenario preferences via Critic-guided Relative Offline Policy optimization (CROP): a learned critic scores candidate actions group-relatively, avoiding the unsafe online exploration of GRPO-style fine-tuning while constraining policy shift to reduce OOD risk. Validated via online A/B tests and fully deployed at Kuaishou, OneBid delivers an overall +2.2% ADVV gain on oCPX Ads, peaking at +13.1% in the ROAS scenario.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 46 references that are in the map. First posted on arXiv 18 Sep 2026.
Builds on
25 of 46 references.
References · 25
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 1,631
- 2021Offline Reinforcement Learning with Implicit Q-Learningcited by 1,293
- 2018Off-Policy Deep Reinforcement Learning without Explorationcited by 1,241
- 2019Advantage-Weighted Regression: Simple and Scalable Off-Policy Reinforcement Learningcited by 782
- 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 637
13 more
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
- 2025π*0.6: a VLA That Learns From Experiencecited by 303
- 2023Constrained Decision Transformer for Offline Safe Reinforcement Learningcited by 69
- 2018Real-Time Bidding with Multi-Agent Reinforcement Learning in Display Advertisingcited by 65
- 2017Optimized Cost per Click in Taobao Display Advertisingcited by 57
- 20251000 Layer Networks for Self-Supervised RL: Scaling Depth Can Enable New Goal-Reaching Capabilitiescited by 45
- 2016Display Advertising with Real-Time Bidding (RTB) and Behavioural Targetingcited by 42
- 2019Bid Optimization by Multivariable Control in Display Advertisingcited by 37
- 2022Sustainable Online Reinforcement Learning for Auto-biddingcited by 29
- 2021A Cooperative-Competitive Multi-Agent Framework for Auto-bidding in Online Advertisingcited by 22
- 2018Bidding Machine: Learning to Bid for Directly Optimizing Profits in Display Advertisingcited by 21
- 2019AiAds: Automated and Intelligent Advertising System for Sponsored Searchcited by 10
- 2026Generative Recommendation for Large-Scale Advertisingcited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Generative Auto-Bidding with Unified Modeling and Exploration
- 2024AIGB: Generative Auto-bidding via Conditional Diffusion Modeling
- 2026DRIVE: Distributional and Retrieval-Augmented Bidding with Value Evaluation
- 2026AHBid: An Adaptable Hierarchical Bidding Framework for Cross-Channel Advertising
- 2026AIGB-R1: Self-Evolving Generative Auto-Bidding via Hierarchical Planner-Executor Optimization
- 2025Generative Large-Scale Pre-trained Models for Automated Ad Bidding Optimization
- 2023Offline Reinforcement Learning for Optimizing Production Bidding Policies
- 2026HOBA: Hierarchical On-Policy Bidding Agents for Adaptive Online Advertising