mlsanityData to 7 Oct 2026

DuCCAE: A Hybrid Engine for Immersive Conversation via Collaboration, Augmentation, and Evolution

arXiv 2603.19248 ↗First posted 25 Feb 2026cs.CL cs.AIcited by 1

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Immersive conversational systems in production face a persistent trade-off between responsiveness and long-horizon task capability. Real-time interaction is achievable for lightweight turns, but requests involving planning and tool invocation (e.g., search and media generation) produce heavy-tail execution latency that degrades turn-taking, persona consistency, and user trust. To address this challenge, we propose DuCCAE (Conversation while Collaboration with Augmentation and Evolution), a hybrid engine for immersive conversation deployed within Baidu Search, serving millions of users. DuCCAE decouples real-time response generation from asynchronous agentic execution and synchronizes them via a shared state that maintains session context and execution traces, enabling asynchronous results to be integrated back into the ongoing dialogue. The system orchestrates five subsystems-Info, Conversation, Collaboration, Augmentation, and Evolution-to support multi-agent collaboration and continuous improvement. We evaluate DuCCAE through a comprehensive framework that combines offline benchmarking on the Du-Interact dataset and large-scale production evaluation within Baidu Search. Experimental results demonstrate that DuCCAE outperforms strong baselines in agentic execution reliability and dialogue quality while reducing latency to fit strict real-time budgets. Crucially, deployment metrics since June 2025 confirm substantial real-world effectiveness, evidenced by a tripling of Day-7 user retention to 34.2% and a surge in the complex task completion rate to 65.2%. Our hybrid architecture successfully preserves conversational continuity while enabling reliable agentic execution, offering practical guidelines for deploying scalable agentic systems in industrial settings.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 32 of its 74 references that are in the map. First posted on arXiv 25 Feb 2026.

Builds on

32 of 74 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025Spoken Conversational Agents with Large Language Models2 Dec
  2. 2025ALAS: A Stateful Multi-LLM Agent Framework for Disruption-Aware Planning18 May
  3. 2025AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges15 May
  4. 2025Plan-and-Act: Improving Planning of Agents for Long-Horizon Tasks12 Mar
  5. 2024Asynchronous Tool Usage for Real-Time Agents28 Oct
  6. 2024Agents Thinking Fast and Slow: A Talker-Reasoner Architecture10 Oct
  7. 2024The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Survey17 Apr

Other references · 25

  1. 2024From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judgecited by 480
  2. 2014Deep Speech: Scaling up end-to-end speech recognitioncited by 354
  3. 2025Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directionscited by 257
  4. 2025Scaling Long-Horizon LLM Agent via Context-Foldingcited by 136
  5. 2025Dispider: Enabling Video LLMs with Active Real-Time Interaction via Disentangled Perception, Decision, and Reactioncited by 122
  6. 2024AIOS: LLM Agent Operating Systemcited by 94
  7. 2024Searching for Best Practices in Retrieval-Augmented Generationcited by 83
  8. 2024Let's Go Real Talk: Spoken Dialogue Model for Face-to-Face Conversationcited by 40
  9. 2025Guided Self-Evolving LLMs with Minimal Human Supervisioncited by 33
  10. 2025Embodied AI: From LLMs to World Modelscited by 23
  11. 2024A Survey of Conversational Searchcited by 22
  12. 2024TALK-Act: Enhance Textural-Awareness for 2D Speaking Avatar Reenactment with Diffusion Modelcited by 19
13 more
  1. 2024EmpathyEar: An Open-source Avatar Multimodal Empathetic Chatbotcited by 17
  2. 2022MNER-QG: An End-to-End MRC framework for Multimodal Named Entity Recognition with Query Groundingcited by 16
  3. 2024ReSyncer: Rewiring Style-based Generator for Unified Audio-Visually Synced Facial Performercited by 16
  4. 2021Identifying Untrustworthy Samples: Data Filtering for Open-domain Dialogues with Bayesian Optimizationcited by 15
  5. 2021Learning to Select Context in a Hierarchical and Global Perspective for Open-domain Dialogue Generationcited by 14
  6. 2026The Orchestration of Multi-Agent Systems: Architectures, Protocols, and Enterprise Adoptioncited by 13
  7. 2025Mitigating Response Delays in Free-Form Conversations with LLM-powered Intelligent Virtual Agentscited by 12
  8. 2025When to Reason: Semantic Router for vLLMcited by 12
  9. 2024Chameleon: Adaptive Caching and Scheduling for Many-Adapter LLM Inference Environmentscited by 9
  10. 2025LLIA -- Enabling Low-Latency Interactive Avatars: Real-Time Audio-Driven Portrait Video Generation with Diffusion Modelscited by 7
  11. 2025PAIRS: Parametric-Verified Adaptive Information Retrieval and Selection for Efficient RAGcited by 3
  12. 2026The Six Sigma Agent: Achieving Enterprise-Grade Reliability in LLM Systems Through Consensus-Driven Decomposed Executioncited by 3
  13. 2025Hi-Reco: High-Fidelity Real-Time Conversational Digital Humanscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Beyond Static Dialogues: Benchmarking Realistic, Heterogeneous, and Evolving Long-Term Memory
  2. 2026OdysseyArena: Benchmarking Large Language Models For Long-Horizon, Active and Inductive Interactions
  3. 2025Scaling Synthetic Task Generation for Agents via Exploration
  4. 2026ToolRACER: A Robust Agentic Conversation Emulation Resource for Agent Training and Evaluation
  5. 2026H2HMem: A Multimodal Memory Benchmark for Agents in Human-Human Interactions
  6. 2026Conversational Capture: A Trajectory-Level Framework for Evaluating Generative Engine Optimization in Multi-turn Human-Agent Interaction
  7. 2026VitaBench 2.0: Evaluating Personalized and Proactive Agents in Long-Term User Interactions
  8. 2023Voice2Action: Language Models as Agent for Efficient Real-Time Interaction in Virtual Reality