Covo-Audio Technical Report
Not on the map. Why?
Abstract (arXiv)
In this work, we present Covo-Audio, a 7B-parameter end-to-end LALM that directly processes continuous audio inputs and generates audio outputs within a single unified architecture. Through large-scale curated pretraining and targeted post-training, Covo-Audio achieves state-of-the-art or competitive performance among models of comparable scale across a broad spectrum of tasks, including speech-text modeling, spoken dialogue, speech understanding, audio understanding, and full-duplex voice interaction. Extensive evaluations demonstrate that the pretrained foundation model exhibits strong speech-text comprehension and semantic reasoning capabilities on multiple benchmarks, outperforming representative open-source models of comparable scale. Furthermore, Covo-Audio-Chat, the dialogue-oriented variant, demonstrates strong spoken conversational abilities, including understanding, contextual reasoning, instruction following, and generating contextually appropriate and empathetic responses, validating its applicability to real-world conversational assistant scenarios. Covo-Audio-Chat-FD, the evolved full-duplex model, achieves substantially superior performance on both spoken dialogue capabilities and full-duplex interaction behaviors, demonstrating its competence in practical robustness. To mitigate the high cost of deploying end-to-end LALMs for natural conversational systems, we propose an intelligence-speaker decoupling strategy that separates dialogue intelligence from voice rendering, enabling flexible voice customization with minimal text-to-speech (TTS) data while preserving dialogue performance. Overall, our results highlight the strong potential of 7B-scale models to integrate sophisticated audio intelligence with high-level semantic reasoning, and suggest a scalable path toward more capable and versatile LALMs.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 72 of its 85 references that are in the map. First posted on arXiv 10 Feb 2026.
Builds on
72 of 85 references.
References · 72
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2017Neural Discrete Representation Learningcited by 4,650
- 2024GPT-4o System Cardcited by 4,467
38 more
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
- 2017VoxCeleb: a large-scale speaker identification datasetcited by 714
- 2025Qwen2.5-Omni Technical Reportcited by 704
- 2024Phi-4 Technical Reportcited by 675
- 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 636
- 2024Qwen2-Audio Technical Reportcited by 543
- 2024Moshi: a speech-text foundation model for real-time dialoguecited by 536
- 2025Qwen3-Omni Technical Reportcited by 451
- 2025SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Modelcited by 307
- 2024CosyVoice 2: Scalable Streaming Speech Synthesis with Large Language Modelscited by 282
- 2024MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmarkcited by 281
- 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 245
- 2024GLM-4-Voice: Towards Intelligent and Human-Like End-to-End Spoken Chatbotcited by 218
- 2024AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehensioncited by 215
- 2025Kimi-Audio Technical Reportcited by 210
- 2025Audio Flamingo 3: Advancing Audio Intelligence with Fully Open Large Audio Language Modelscited by 210
- 2024Mini-Omni: Language Models Can Hear, Talk While Thinking in Streamingcited by 204
- 2024LLaMA-Omni: Seamless Speech Interaction with Large Language Modelscited by 169
- 2024Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLMcited by 135
- 2025Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilitiescited by 127
- 2024Spirit LM: Interleaved Spoken and Written Language Modelcited by 123
- 2025Emu3.5: Native Multimodal Models are World Learnerscited by 119
- 2025X-Omni: Reinforcement Learning Makes Discrete Autoregressive Image Generative Models Great Againcited by 105
- 2025MMSU: A Massive Multi-task Spoken Language Understanding and Reasoning Benchmarkcited by 101
- 2025Step-Audio 2 Technical Reportcited by 101
- 2020The Zero Resource Speech Benchmark 2021: Metrics and baselines for unsupervised spoken language modelingcited by 100
- 2023Textually Pretrained Speech Language Modelscited by 99
50 most cited of 72 All 72 (JSON)
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Escape the Language Prior: Mitigating Late-Stage Modality Collapse in Audio Reasoning via Modality-Aware Policy Optimizationcited by 2
- 2026Audio-DeepThinker: Progressive Reasoning-Aware Reinforcement Learning for High-Quality Chain-of-Thought Emergence in Audio Language Modelscited by 1
- 2026Never Stop Thinking: Continuous-Time Language Agentscited by 1
- 2026A frontend-backend architecture for tool calls in full-duplex speech modelscited by 1
- 2026S3-Bench: Evaluating Speech Interaction Models as Scientific Voice Assistantscited by 0
- 2026RoleBreak: Benchmarking Long-Horizon Role-Playing Robustness in Spoken Dialoguecited by 0
- 2026MISHAP-Bench: A Hallucination Benchmark for Large Audio-Language Modelscited by 0
- 2026MISHAP-Bench: A Hallucination Benchmark for Large Audio-Language Models27 Sep 2026
- 2026A frontend-backend architecture for tool calls in full-duplex speech models16 Sep 2026
- 2026RoleBreak: Benchmarking Long-Horizon Role-Playing Robustness in Spoken Dialogue15 Sep 2026
- 2026S3-Bench: Evaluating Speech Interaction Models as Scientific Voice Assistants9 Sep 2026
- 2026Never Stop Thinking: Continuous-Time Language Agents11 Jul 2026
- 2026Escape the Language Prior: Mitigating Late-Stage Modality Collapse in Audio Reasoning via Modality-Aware Policy Optimization26 May 2026
- 2026Audio-DeepThinker: Progressive Reasoning-Aware Reinforcement Learning for High-Quality Chain-of-Thought Emergence in Audio Language Models20 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025AU-Harness: An Open-Source Toolkit for Holistic Evaluation of Audio LLMs
- 2026The Evolving Bottleneck in Speech Generation: Interface Co-design and Staged Alignment from CosyVoice to Qwen-Audio-3.0-TTS ↗
- 2026Continuous Audio Thinking for Large Audio Language Models
- 2023AudioChatLlama: Towards General-Purpose Speech Abilities for LLMs
- 2026Alignment Is All You Need: Instruction-Free Training for General Audio-Language Models
- 2026Do Audio LLMs Listen Before They Act? Diagnosing Acoustic-Context Gating in Voice Agents
- 2026BayLing-Duplex: Native Full-Duplex Speech Dialogue with a Single Autoregressive LLM
- 2025Step-Audio-AQAA: a Fully End-to-End Expressive Large Audio Language Model