mlsanityData to 7 Oct 2026

TiCo: Time-Controllable Spoken Dialogue Model

arXiv 2603.22267 ↗First posted 23 Mar 2026cs.CL cs.AI eess.AScited by 1

Not on the map. Why?

Abstract (arXiv)

We introduce TiCo, a time-controllable spoken dialogue model (SDM) that follows time-constrained instructions (e.g., "Please generate a response lasting about 15 seconds") and generates spoken responses with controllable duration. This capability is valuable for real-world spoken language systems such as voice assistants and interactive agents, where controlling response duration can improve interaction quality. However, despite their strong ability to generate natural spoken responses, existing models lack time awareness and struggle to follow duration-related instructions. To systematically evaluate this, we introduce TiCo-Bench, the first benchmark for time-controllable instruction following in SDMs, on which existing open-source and commercial models frequently fail to satisfy explicit time constraints. TiCo addresses this limitation by enabling an SDM to estimate elapsed speaking time during generation through Spoken Time Markers (STM) (e.g., <10.6 seconds>). These markers help the model maintain awareness of time and adjust the remaining content to meet the target duration. TiCo is post-trained efficiently without question-answer paired data, relying on self-generation and reinforcement learning with verifiable reward. Experimental results show that TiCo reduces duration error by 2.7x over its backbone and 1.6x over the strongest baseline, while preserving response quality.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 71 of its 82 references that are in the map. First posted on arXiv 23 Mar 2026.

Builds on

71 of 82 references.

References · 71

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2018Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarizationcited by 1,308
  3. 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 988
  4. 2024Length-Controlled AlpacaEval: A Simple Way to Debias Automatic Evaluatorscited by 865
  5. 2020FastSpeech 2: Fast and High-Quality End-to-End Text to Speechcited by 710
  6. 2019LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speechcited by 639
  7. 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 611
  8. 2024Moshi: a speech-text foundation model for real-time dialoguecited by 536
  9. 2023SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilitiescited by 518
  10. 2025Qwen3-Omni Technical Reportcited by 451
  11. 2022UTMOS: UTokyo-SaruLab System for VoiceMOS Challenge 2022cited by 381
  12. 2025L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learningcited by 381
38 more
  1. 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 345
  2. 2021Speech Resynthesis from Discrete Disentangled Self-Supervised Representationscited by 243
  3. 2024GLM-4-Voice: Towards Intelligent and Human-Like End-to-End Spoken Chatbotcited by 218
  4. 2025Kimi-Audio Technical Reportcited by 210
  5. 2025VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interactioncited by 191
  6. 2025ProRL: Prolonged Reinforcement Learning Expands Reasoning Boundaries in Large Language Modelscited by 187
  7. 2024LLaMA-Omni: Seamless Speech Interaction with Large Language Modelscited by 169
  8. 2025CosyVoice 3: Towards In-the-wild Speech Generation via Scaling-up and Post-trainingcited by 142
  9. 2024Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLMcited by 135
  10. 2022Generative Spoken Dialogue Language Modelingcited by 125
  11. 2024Spirit LM: Interleaved Spoken and Written Language Modelcited by 123
  12. 2025On The Landscape of Spoken Language Models: A Comprehensive Surveycited by 116
  13. 2024Mini-Omni2: Towards Open-source GPT-4o with Vision, Speech and Duplex Capabilitiescited by 104
  14. 2025Step-Audio 2 Technical Reportcited by 101
  15. 2023Textually Pretrained Speech Language Modelscited by 99
  16. 2025Full-Duplex-Bench: A Benchmark to Evaluate Full-duplex Spoken Dialogue Models on Turn-taking Capabilitiescited by 94
  17. 2024WavChat: A Survey of Spoken Dialogue Modelscited by 88
  18. 2025On-Policy RL Meets Off-Policy Experts: Harmonizing Supervised Fine-Tuning and Reinforcement Learning via Dynamic Weightingcited by 88
  19. 2024Recent Advances in Speech Language Models: A Surveycited by 85
  20. 2025IndexTTS2: A Breakthrough in Emotionally Expressive and Duration-Controlled Auto-Regressive Zero-Shot Text-to-Speechcited by 85
  21. 2025LLaMA-Omni2: LLM-based Real-time Spoken Chatbot with Autoregressive Streaming Speech Synthesiscited by 75
  22. 2024Beyond Turn-Based Interfaces: Synchronous LLMs as Full-Duplex Dialogue Agentscited by 69
  23. 2024TimeMarker: A Versatile Video-LLM for Long and Short Video Understanding with Superior Temporal Localization Abilitycited by 69
  24. 2025Baichuan-Audio: A Unified Framework for End-to-End Speech Interactioncited by 68
  25. 2024SLAM-Omni: Timbre-Controllable Voice Interaction System with Single-Stage Trainingcited by 58
  26. 2025MiMo-Audio: Audio Language Models are Few-Shot Learnerscited by 58
  27. 2026PersonaPlex: Voice and Role Control for Full Duplex Conversational Speech Modelscited by 57
  28. 2024Explaining Length Bias in LLM-Based Preference Evaluationscited by 48
  29. 2025DeSTA2.5-Audio: Toward General-Purpose Large Audio Language Model with Self-Generated Cross-Modal Alignmentcited by 47
  30. 2022Enhanced Direct Speech-to-Speech Translation Using Self-supervised Pre-training and Data Augmentationcited by 43
  31. 2025Recent Advances in Discrete Speech Tokens: A Reviewcited by 42
  32. 2025Full-Duplex-Bench-v2: A Multi-Turn Evaluation Framework for Duplex Dialogue Systems with an Automated Examinercited by 38
  33. 2025Discrete Audio Tokens: More Than a Survey!cited by 37
  34. 2025LFM2 Technical Reportcited by 31
  35. 2025URO-Bench: Towards Comprehensive Evaluation for End-to-End Spoken Dialogue Modelscited by 29
  36. 2024Codec-SUPERB: An In-Depth Analysis of Sound Codec Modelscited by 25
  37. 2025STITCH: Simultaneous Thinking and Talking with Chunked Reasoning for Spoken Language Modelscited by 25
  38. 2024Towards Controllable Speech Synthesis in the Era of Large Language Models: A Systematic Surveycited by 22

50 most cited of 71 All 71 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.