TiCo: Time-Controllable Spoken Dialogue Model
Not on the map. Why?
Abstract (arXiv)
We introduce TiCo, a time-controllable spoken dialogue model (SDM) that follows time-constrained instructions (e.g., "Please generate a response lasting about 15 seconds") and generates spoken responses with controllable duration. This capability is valuable for real-world spoken language systems such as voice assistants and interactive agents, where controlling response duration can improve interaction quality. However, despite their strong ability to generate natural spoken responses, existing models lack time awareness and struggle to follow duration-related instructions. To systematically evaluate this, we introduce TiCo-Bench, the first benchmark for time-controllable instruction following in SDMs, on which existing open-source and commercial models frequently fail to satisfy explicit time constraints. TiCo addresses this limitation by enabling an SDM to estimate elapsed speaking time during generation through Spoken Time Markers (STM) (e.g., <10.6 seconds>). These markers help the model maintain awareness of time and adjust the remaining content to meet the target duration. TiCo is post-trained efficiently without question-answer paired data, relying on self-generation and reinforcement learning with verifiable reward. Experimental results show that TiCo reduces duration error by 2.7x over its backbone and 1.6x over the strongest baseline, while preserving response quality.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 71 of its 82 references that are in the map. First posted on arXiv 23 Mar 2026.
Builds on
71 of 82 references.
References · 71
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2018Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarizationcited by 1,308
- 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 988
- 2024Length-Controlled AlpacaEval: A Simple Way to Debias Automatic Evaluatorscited by 865
- 2020FastSpeech 2: Fast and High-Quality End-to-End Text to Speechcited by 710
- 2019LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speechcited by 639
- 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 611
- 2024Moshi: a speech-text foundation model for real-time dialoguecited by 536
- 2023SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilitiescited by 518
- 2025Qwen3-Omni Technical Reportcited by 451
- 2022UTMOS: UTokyo-SaruLab System for VoiceMOS Challenge 2022cited by 381
- 2025L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learningcited by 381
38 more
- 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 345
- 2021Speech Resynthesis from Discrete Disentangled Self-Supervised Representationscited by 243
- 2024GLM-4-Voice: Towards Intelligent and Human-Like End-to-End Spoken Chatbotcited by 218
- 2025Kimi-Audio Technical Reportcited by 210
- 2025VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interactioncited by 191
- 2025ProRL: Prolonged Reinforcement Learning Expands Reasoning Boundaries in Large Language Modelscited by 187
- 2024LLaMA-Omni: Seamless Speech Interaction with Large Language Modelscited by 169
- 2025CosyVoice 3: Towards In-the-wild Speech Generation via Scaling-up and Post-trainingcited by 142
- 2024Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLMcited by 135
- 2022Generative Spoken Dialogue Language Modelingcited by 125
- 2024Spirit LM: Interleaved Spoken and Written Language Modelcited by 123
- 2025On The Landscape of Spoken Language Models: A Comprehensive Surveycited by 116
- 2024Mini-Omni2: Towards Open-source GPT-4o with Vision, Speech and Duplex Capabilitiescited by 104
- 2025Step-Audio 2 Technical Reportcited by 101
- 2023Textually Pretrained Speech Language Modelscited by 99
- 2025Full-Duplex-Bench: A Benchmark to Evaluate Full-duplex Spoken Dialogue Models on Turn-taking Capabilitiescited by 94
- 2024WavChat: A Survey of Spoken Dialogue Modelscited by 88
- 2025On-Policy RL Meets Off-Policy Experts: Harmonizing Supervised Fine-Tuning and Reinforcement Learning via Dynamic Weightingcited by 88
- 2024Recent Advances in Speech Language Models: A Surveycited by 85
- 2025IndexTTS2: A Breakthrough in Emotionally Expressive and Duration-Controlled Auto-Regressive Zero-Shot Text-to-Speechcited by 85
- 2025LLaMA-Omni2: LLM-based Real-time Spoken Chatbot with Autoregressive Streaming Speech Synthesiscited by 75
- 2024Beyond Turn-Based Interfaces: Synchronous LLMs as Full-Duplex Dialogue Agentscited by 69
- 2024TimeMarker: A Versatile Video-LLM for Long and Short Video Understanding with Superior Temporal Localization Abilitycited by 69
- 2025Baichuan-Audio: A Unified Framework for End-to-End Speech Interactioncited by 68
- 2024SLAM-Omni: Timbre-Controllable Voice Interaction System with Single-Stage Trainingcited by 58
- 2025MiMo-Audio: Audio Language Models are Few-Shot Learnerscited by 58
- 2026PersonaPlex: Voice and Role Control for Full Duplex Conversational Speech Modelscited by 57
- 2024Explaining Length Bias in LLM-Based Preference Evaluationscited by 48
- 2025DeSTA2.5-Audio: Toward General-Purpose Large Audio Language Model with Self-Generated Cross-Modal Alignmentcited by 47
- 2022Enhanced Direct Speech-to-Speech Translation Using Self-supervised Pre-training and Data Augmentationcited by 43
- 2025Recent Advances in Discrete Speech Tokens: A Reviewcited by 42
- 2025Full-Duplex-Bench-v2: A Multi-Turn Evaluation Framework for Duplex Dialogue Systems with an Automated Examinercited by 38
- 2025Discrete Audio Tokens: More Than a Survey!cited by 37
- 2025LFM2 Technical Reportcited by 31
- 2025URO-Bench: Towards Comprehensive Evaluation for End-to-End Spoken Dialogue Modelscited by 29
- 2024Codec-SUPERB: An In-Depth Analysis of Sound Codec Modelscited by 25
- 2025STITCH: Simultaneous Thinking and Talking with Chunked Reasoning for Spoken Language Modelscited by 25
- 2024Towards Controllable Speech Synthesis in the Era of Large Language Models: A Systematic Surveycited by 22
50 most cited of 71 All 71 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.