mlsanityData to 14 Oct 2026

Multi-objective Aligned Bidword Generation Model for E-commerce Search Advertising

arXiv 2506.03827 ↗First posted 4 Jun 2025cs.CL cs.AI cs.IRcited by 1

On the map: LLM alignment / RLHF / preference optimisation → Preference alignment for recommenders and RAG

Abstract (arXiv)

Retrieval systems primarily address the challenge of matching user queries with the most relevant advertisements, playing a crucial role in e-commerce search advertising. The diversity of user needs and expressions often produces massive long-tail queries that cannot be matched with merchant bidwords or product titles, which results in some advertisements not being recalled, ultimately harming user experience and search efficiency. Existing query rewriting research focuses on various methods such as query log mining, query-bidword vector matching, or generation-based rewriting. However, these methods often fail to simultaneously optimize the relevance and authenticity of the user's original query and rewrite and maximize the revenue potential of recalled ads. In this paper, we propose a Multi-objective aligned Bidword Generation Model (MoBGM), which is composed of a discriminator, generator, and preference alignment module, to address these challenges. To simultaneously improve the relevance and authenticity of the query and rewrite and maximize the platform revenue, we design a discriminator to optimize these key objectives. Using the feedback signal of the discriminator, we train a multi-objective aligned bidword generator that aims to maximize the combined effect of the three objectives. Extensive offline and online experiments show that our proposed algorithm significantly outperforms the state of the art. After deployment, the algorithm has created huge commercial value for the platform, further verifying its feasibility and robustness.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Preference alignment for recommenders and RAG, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 22 of its 43 references that are in the map. First posted on arXiv 4 Jun 2025.

Builds on

22 of 43 references.

References · 22

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2022Training language models to follow instructions with human feedbackcited by 15,971
  4. 2017Proximal Policy Optimization Algorithmscited by 15,215
  5. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  6. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  7. 2020Scaling Laws for Neural Language Modelscited by 6,586
  8. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  9. 2024SimPO: Simple Preference Optimization with a Reference-Free Rewardcited by 963
  10. 2023A General Theoretical Paradigm to Understand Learning from Human Preferencescited by 912
  11. 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedbackcited by 759
  12. 2020Question Rewriting for Conversational Question Answeringcited by 93
10 more
  1. 2019Deep Reinforcement Learning for Multi-objective Optimizationcited by 90
  2. 2015A Hierarchical Recurrent Encoder-Decoder For Generative Context-Aware Query Suggestioncited by 68
  3. 2023Large Language Model based Long-tail Query Rewriting in Taobao Searchcited by 62
  4. 2021Diversity driven Query Rewriting in Search Advertisingcited by 15
  5. 2025Generative Retrieval and Alignment Model: A New Paradigm for E-commerce Retrievalcited by 13
  6. 2019An end-to-end Generative Retrieval Method for Sponsored Search Engine --Decoding Efficiently into a Closed Target Domaincited by 12
  7. 2023A Multi-Granularity Matching Attention Network for Query Intent Classification in E-commerce Retrievalcited by 8
  8. 2019RPM-Oriented Query Rewriting Framework for E-commerce Keyword-Based Sponsored Searchcited by 5
  9. 2021Triangular Bidword Generation for Sponsored Search Auctioncited by 5
  10. 2024A Semi-supervised Multi-channel Graph Convolutional Network for Query Classification in E-commercecited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026UniPolicy: Unified Objective-Specific Policies for Generative Search Advertising
  2. 2024Ad Auctions for LLMs via Retrieval Augmented Generation
  3. 2024Generative Retrieval with Preference Optimization for E-commerce Search
  4. 2026Next-Gen Sponsored Search: Crafting the Perfect Query with Inventory-Aware RAG (InvAwr-RAG) Based GenAI
  5. 2026Relevance Matters: A Multi-Task and Multi-Stage Large Language Model Approach for E-commerce Query Rewriting ↗
  6. 2025HCMRM: A High-Consistency Multimodal Relevance Model for Search Ads
  7. 2026VARG: Value-Aware and Ranking-Aligned Generative Retrieval for Dynamic E-commerce Search
  8. 2026GenFacet: End-to-End Generative Faceted Search via Multi-Task Preference Alignment in E-Commerce ↗