mlsanityData to 14 Oct 2026

Proactive Guidance of Multi-Turn Conversation in Industrial Search

arXiv 2505.24251 ↗First posted 30 May 2025cs.CL cs.IRcited by 1

Not on the map. Why?

Abstract (arXiv)

The evolution of Large Language Models (LLMs) has significantly advanced multi-turn conversation systems, emphasizing the need for proactive guidance to enhance users' interactions. However, these systems face challenges in dynamically adapting to shifts in users' goals and maintaining low latency for real-time interactions. In the Baidu Search AI assistant, an industrial-scale multi-turn search system, we propose a novel two-phase framework to provide proactive guidance. The first phase, Goal-adaptive Supervised Fine-Tuning (G-SFT), employs a goal adaptation agent that dynamically adapts to user goal shifts and provides goal-relevant contextual information. G-SFT also incorporates scalable knowledge transfer to distill insights from LLMs into a lightweight model for real-time interaction. The second phase, Click-oriented Reinforcement Learning (C-RL), adopts a generate-rank paradigm, systematically constructs preference pairs from user click signals, and proactively improves click-through rates through more engaging guidance. This dual-phase architecture achieves complementary objectives: G-SFT ensures accurate goal tracking, while C-RL optimizes interaction quality through click signal-driven reinforcement learning. Extensive experiments demonstrate that our framework achieves 86.10% accuracy in offline evaluation (+23.95% over baseline) and 25.28% CTR in online deployment (149.06% relative improvement), while reducing inference latency by 69.55% through scalable knowledge distillation.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 16 of its 27 references that are in the map. First posted on arXiv 30 May 2025.

Builds on

16 of 27 references.

References · 16

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2024The Llama 3 Herd of Modelscited by 14,715
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  5. 2016Diverse Beam Search: Decoding Diverse Solutions from Neural Sequence Modelscited by 301
  6. 2021ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generationcited by 260
  7. 2019ERNIE 2.0: A Continual Pre-training Framework for Language Understandingcited by 231
  8. 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
  9. 2024Direct Preference Optimization with an Offsetcited by 122
  10. 2021Advances and Challenges in Conversational Recommender Systems: A Surveycited by 118
  11. 2016Learning End-to-End Goal-Oriented Dialogcited by 104
  12. 2024A Multi-Agent Conversational Recommender Systemcited by 43
4 more
  1. 2022A Unified Multi-task Learning Framework for Multi-goal Conversational Recommender Systemscited by 32
  2. 2023A Large Language Model Enhanced Conversational Recommender Systemcited by 31
  3. 2019Harnessing Evolution of Multi-Turn Conversations for Effective Answer Retrievalcited by 10
  4. 2024Incorporating External Knowledge and Goal Guidance for LLM-based Conversational Recommender Systemscited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Agentic Conversational Search with Contextualized Reasoning via Reinforcement Learning
  2. 2025Reinforcement Fine-Tuning for Reasoning towards Multi-Step Multi-Source Search in Large Language Models
  3. 2025A Survey on Multi-Turn Interaction Capabilities of Large Language Models
  4. 2026Decoupling Strategy and Execution in Task-Focused Dialogue via Goal-Oriented Preference Optimization
  5. 2025AI-SearchPlanner: Modular Agentic Search via Pareto-Optimal Multi-Objective Reinforcement Learning
  6. 2024Learning to Clarify: Multi-turn Conversations with Action-Based Contrastive Self-Training
  7. 2025Prompt reinforcing for long-term planning of large language models
  8. 2025Grounded in Reality: Learning and Deploying Proactive LLM from Offline Logs