OnePred: Next-Query Prediction via Recursive Intent Memory in Multi-Turn Conversations
Not on the map. Why?
Abstract (arXiv)
Although large language model (LLM) conversational systems process millions of multi-turn dialogues daily, they remain fundamentally reactive: they respond only after the user types a query. A key step toward proactive interaction is next-query prediction, which anticipates the user's subsequent query based solely on the preceding dialogue. Progress on this task is hindered by the lack of dedicated benchmarks and a fundamental efficiency--quality trade-off: naively concatenating full dialogue history incurs linearly growing token consumption, while truncating to the latest turn discards crucial cross-turn context. Our key insight is that accurate prediction does not require re-reading raw history; it suffices to track the user's evolving intent trajectory across topics, unresolved needs, and interest shifts. We propose OnePred, which maintains a recursively updated memory as its sole cross-turn context, bounding the per-turn cost independently of conversation length. We train the model via a two-stage reinforcement learning pipeline that first teaches what to predict, then what to compress, shaping the memory into a prediction-oriented intent chain. To establish a rigorous testbed, we introduce NQP-Bench, spanning three diverse subsets. Experiments demonstrate that OnePred reduces per-turn token consumption by up to 22× compared to full-history inputs while consistently exceeding all baselines in prediction quality, with larger gains on longer conversations. Our code is publicly available at https://github.com/ZBWpro/OnePred.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 19 of its 36 references that are in the map. First posted on arXiv 22 May 2026.
Builds on
19 of 36 references.
References · 19
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2024WildChat: 1M ChatGPT Interaction Logs in the Wildcited by 629
- 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 587
- 2023LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Datasetcited by 461
- 2025MemAgent: Reshaping Long-Context LLM with Multi-Conv RL-based Memory Agentcited by 246
- 2025MEM1: Learning to Synergize Memory and Reasoning for Efficient Long-Horizon Agentscited by 238
- 2023Augmenting Language Models with Long-Term Memorycited by 189
- 2019Proactive Human-Machine Conversation with Explicit Conversation Goalscited by 88
- 2015A Hierarchical Recurrent Encoder-Decoder For Generative Context-Aware Query Suggestioncited by 68
7 more
- 2023A Survey on Proactive Dialogue Systems: Problems, Methods, and Prospectscited by 66
- 2017Learning to Attend, Copy, and Generate for Session-Based Query Suggestioncited by 22
- 2025ShareChat: A Dataset of Chatbot Conversations in the Wildcited by 15
- 2025OneSug: The Unified End-to-End Generative Framework for E-commerce Query Suggestioncited by 14
- 2025CTR-Guided Generative Query Suggestion in Conversational Searchcited by 9
- 2025From Clicks to Preference: A Multi-stage Alignment Framework for Generative Query Suggestion in Conversational Systemcited by 9
- 2025LLM-Driven Preference Data Synthesis for Proactive Prediction of the Next User Utterance in Human-Machine Dialoguecited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024Regressing the Relative Future: Efficient Policy Optimization for Multi-turn RLHF
- 2026SOMA: Efficient Multi-turn LLM Serving via Small Language Model
- 2026You Changed Your Mind, The Model Didn't: Demystifying Intent in Multi-Turn Dialogue
- 2026MemOps: Benchmarking Lifecycle Memory Operations in Long-Horizon Conversations
- 2026SeDT: Sentence-Transformer Decision-Transformer Conditioning for Multi-Turn Conversation Reliability
- 2026Agentic Conversational Search with Contextualized Reasoning via Reinforcement Learning
- 2026Back to Basics: Let Conversational Agents Remember with Just Retrieval and Generation
- 2025A Simple Yet Strong Baseline for Long-Term Conversational Memory of LLM Agents