Unifying Ranking and Generation in Query Auto-Completion via Retrieval-Augmented Generation and Multi-Objective Alignment
On the map: Retrieval-augmented generation → Generation and context integration
Abstract (arXiv)
Query Auto-Completion (QAC) suggests query completions as users type, helping them articulate intent and reach results more efficiently. Existing approaches face fundamental challenges: traditional retrieve-and-rank pipelines have limited long-tail coverage and require extensive feature engineering, while recent generative methods suffer from hallucination and safety risks. We present a unified framework that reformulates QAC as end-to-end list generation through Retrieval-Augmented Generation (RAG) and multi-objective Direct Preference Optimization (DPO). Our approach combines three key innovations: (1) reformulating QAC as end-to-end list generation with multi-objective optimization; (2) defining and deploying a suite of rule-based, model-based, and LLM-as-judge verifiers for QAC, and using them in a comprehensive methodology that combines RAG, multi-objective DPO, and iterative critique-revision for high-quality synthetic data; (3) a hybrid serving architecture enabling efficient production deployment under strict latency constraints. Evaluation on a large-scale commercial search platform demonstrates substantial improvements: offline metrics show gains across all dimensions, human evaluation yields +0.40 to +0.69 preference scores, and a controlled online experiment achieves 5.44% reduction in keystrokes and 3.46% increase in suggestion adoption, validating that unified generation with RAG and multi-objective alignment provides an effective solution for production QAC. This work represents a paradigm shift to end-to-end generation powered by large language models, RAG, and multi-objective alignment, establishing a production-validated framework that can benefit the broader search and recommendation industry.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Generation and context integration, one of 15 directions in Retrieval-augmented generation. Builds on 16 of its 58 references that are in the map. First posted on arXiv 1 Feb 2026.
Builds on
16 of 58 references.
References · 16
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2017Deep reinforcement learning from human preferencescited by 3,846
- 2020Learning to summarize from human feedbackcited by 2,562
- 2024KTO: Model Alignment as Prospect Theoretic Optimizationcited by 256
- 2015A Hierarchical Recurrent Encoder-Decoder For Generative Context-Aware Query Suggestioncited by 68
- 2023Knowledge-Augmented Large Language Models for Personalized Contextual Query Suggestioncited by 43
- 2018Personalized Language Model for Query Auto-Completioncited by 25
- 2019On Application of Learning to Rank for E-Commerce Searchcited by 24
- 2018Personalized neural language models for real-world query auto completioncited by 10
- 2020Efficient Neural Query Auto Completioncited by 10
- 2020Efficient and Effective Query Auto-Completioncited by 4
4 more
- 2024QueryExplorer: An Interactive Query Generation Assistant for Search and Explorationcited by 4
- 2025Personalized Query Auto-Completion for Long and Short-Term Interests with Adaptive Detoxification Generationcited by 4
- 2021High Quality Related Search Query Suggestions using Deep Reinforcement Learningcited by 3
- 2021Deep Pairwise Learning To Rank For Search Autocompletecited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025From Ranking to Selection: A Simple but Efficient Dynamic Passage Selector for Retrieval Augmented Generation
- 2024A Survey of Query Optimization in Large Language Models
- 2026Better Together: Complementary Query Rewriting Under a Strong RAG Baseline
- 2025Aligning Extraction and Generation for Robust Retrieval-Augmented Generation
- 2025From Prompting to Alignment: A Generative Framework for Query Recommendation
- 2025RAGSmith: A Framework for Finding the Optimal Composition of Retrieval-Augmented Generation Methods Across Datasets
- 2026CAR: Query-Guided Confidence-Aware Reranking for Retrieval-Augmented Generation
- 2025Single LLM, Multiple Roles: A Unified Retrieval-Augmented Generation Framework Using Role-Specific Token Optimization