NExT-Search: Rebuilding User Feedback Ecosystem for Generative AI Search
On the map: LLM alignment / RLHF / preference optimisation → Preference alignment for recommenders and RAG
Abstract (arXiv)
Generative AI search is reshaping information retrieval by offering end-to-end answers to complex queries, reducing users' reliance on manually browsing and summarizing multiple web pages. However, while this paradigm enhances convenience, it disrupts the feedback-driven improvement loop that has historically powered the evolution of traditional Web search. Web search can continuously improve their ranking models by collecting large-scale, fine-grained user feedback (e.g., clicks, dwell time) at the document level. In contrast, generative AI search operates through a much longer search pipeline, spanning query decomposition, document retrieval, and answer generation, yet typically receives only coarse-grained feedback on the final answer. This introduces a feedback loop disconnect, where user feedback for the final output cannot be effectively mapped back to specific system components, making it difficult to improve each intermediate stage and sustain the feedback loop. In this paper, we envision NExT-Search, a next-generation paradigm designed to reintroduce fine-grained, process-level feedback into generative AI search. NExT-Search integrates two complementary modes: User Debug Mode, which allows engaged users to intervene at key stages; and Shadow User Mode, where a personalized user agent simulates user preferences and provides AI-assisted feedback for less interactive users. Furthermore, we envision how these feedback signals can be leveraged through online adaptation, which refines current search outputs in real-time, and offline update, which aggregates interaction logs to periodically fine-tune query decomposition, retrieval, and generation models. By restoring human control over key stages of the generative AI search pipeline, we believe NExT-Search offers a promising direction for building feedback-rich AI search systems that can evolve continuously alongside human feedback.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Preference alignment for recommenders and RAG, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 12 of its 43 references that are in the map. First posted on arXiv 20 May 2025.
Builds on
12 of 43 references.
References · 12
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
- 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Modelscited by 452
- 2023Evaluating Verifiability in Generative Search Enginescited by 303
- 2022Dense Text Retrieval based on Pretrained Language Models: A Surveycited by 136
- 2017A Deep Relevance Matching Model for Ad-hoc Retrievalcited by 126
- 2024Bias and Unfairness in Information Retrieval Systems: New Challenges in the LLM Eracited by 98
- 2023Comparing Traditional and LLM-based Search for Consumer Choice: A Randomized Experimentcited by 36
- 2023Advancing the Search Frontier with AI Agentscited by 12
- 2024Adaptive Self-Supervised Learning Strategies for Dynamic On-Device LLM Personalizationcited by 5
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025Characterizing Web Search in The Age of Generative AIcited by 5
- 2026Learning to Retrieve from Agent Trajectoriescited by 3
- 2026How Generative AI Disrupts Search: An Empirical Study of Google Search, Gemini, and AI Overviewscited by 2
- 2026ITER: Interaction-Aware Retrieval for Agentic Searchcited by 1
- 2026ITER: Interaction-Aware Retrieval for Agentic Search28 Aug 2026
- 2026How Generative AI Disrupts Search: An Empirical Study of Google Search, Gemini, and AI Overviews30 Apr 2026
- 2026Learning to Retrieve from Agent Trajectories30 Mar 2026
- 2025Characterizing Web Search in The Age of Generative AI13 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2025Information Retrieval in the Age of Generative AI: The RGB Model
- 2025Think Before You Retrieve: Learning Test-Time Adaptive Search with Small Language Models
- 2025Toward an AI-Native Internet: Rethinking the Web Architecture for Semantic Retrieval
- 2026Enhancing LLMs through human feedback: a journey towards self-improvement
- 2025Exploring Training and Inference Scaling Laws in Generative Retrieval
- 2025RAVine: Reality-Aligned Evaluation for Agentic Search
- 2026AgenticGEO: A Self-Evolving Agentic System for Generative Engine Optimization
- 2026OneSearch-V2: The Latent Reasoning Enhanced Self-distillation Generative Search Framework