mlsanityData to 7 Oct 2026

Covo-Audio Technical Report

arXiv 2602.09823 ↗First posted 10 Feb 2026cs.SD cs.CL eess.AScited by 7

Not on the map. Why?

Abstract (arXiv)

In this work, we present Covo-Audio, a 7B-parameter end-to-end LALM that directly processes continuous audio inputs and generates audio outputs within a single unified architecture. Through large-scale curated pretraining and targeted post-training, Covo-Audio achieves state-of-the-art or competitive performance among models of comparable scale across a broad spectrum of tasks, including speech-text modeling, spoken dialogue, speech understanding, audio understanding, and full-duplex voice interaction. Extensive evaluations demonstrate that the pretrained foundation model exhibits strong speech-text comprehension and semantic reasoning capabilities on multiple benchmarks, outperforming representative open-source models of comparable scale. Furthermore, Covo-Audio-Chat, the dialogue-oriented variant, demonstrates strong spoken conversational abilities, including understanding, contextual reasoning, instruction following, and generating contextually appropriate and empathetic responses, validating its applicability to real-world conversational assistant scenarios. Covo-Audio-Chat-FD, the evolved full-duplex model, achieves substantially superior performance on both spoken dialogue capabilities and full-duplex interaction behaviors, demonstrating its competence in practical robustness. To mitigate the high cost of deploying end-to-end LALMs for natural conversational systems, we propose an intelligence-speaker decoupling strategy that separates dialogue intelligence from voice rendering, enabling flexible voice customization with minimal text-to-speech (TTS) data while preserving dialogue performance. Overall, our results highlight the strong potential of 7B-scale models to integrate sophisticated audio intelligence with high-level semantic reasoning, and suggest a scalable path toward more capable and versatile LALMs.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 72 of its 85 references that are in the map. First posted on arXiv 10 Feb 2026.

Builds on

72 of 85 references.

References · 72

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2024The Llama 3 Herd of Modelscited by 14,192
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  5. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  6. 2025Qwen3 Technical Reportcited by 8,195
  7. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  8. 2025Qwen2.5-VL Technical Reportcited by 5,418
  9. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  10. 2024Qwen2.5 Technical Reportcited by 4,713
  11. 2017Neural Discrete Representation Learningcited by 4,650
  12. 2024GPT-4o System Cardcited by 4,467
38 more
  1. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  2. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  3. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  4. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  5. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  6. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  7. 2025Qwen3-VL Technical Reportcited by 2,534
  8. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  9. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
  10. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  11. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
  12. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
  13. 2017VoxCeleb: a large-scale speaker identification datasetcited by 714
  14. 2025Qwen2.5-Omni Technical Reportcited by 704
  15. 2024Phi-4 Technical Reportcited by 675
  16. 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 636
  17. 2024Qwen2-Audio Technical Reportcited by 543
  18. 2024Moshi: a speech-text foundation model for real-time dialoguecited by 536
  19. 2025Qwen3-Omni Technical Reportcited by 451
  20. 2025SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Modelcited by 307
  21. 2024CosyVoice 2: Scalable Streaming Speech Synthesis with Large Language Modelscited by 282
  22. 2024MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmarkcited by 281
  23. 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 245
  24. 2024GLM-4-Voice: Towards Intelligent and Human-Like End-to-End Spoken Chatbotcited by 218
  25. 2024AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehensioncited by 215
  26. 2025Kimi-Audio Technical Reportcited by 210
  27. 2025Audio Flamingo 3: Advancing Audio Intelligence with Fully Open Large Audio Language Modelscited by 210
  28. 2024Mini-Omni: Language Models Can Hear, Talk While Thinking in Streamingcited by 204
  29. 2024LLaMA-Omni: Seamless Speech Interaction with Large Language Modelscited by 169
  30. 2024Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLMcited by 135
  31. 2025Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilitiescited by 127
  32. 2024Spirit LM: Interleaved Spoken and Written Language Modelcited by 123
  33. 2025Emu3.5: Native Multimodal Models are World Learnerscited by 119
  34. 2025X-Omni: Reinforcement Learning Makes Discrete Autoregressive Image Generative Models Great Againcited by 105
  35. 2025MMSU: A Massive Multi-task Spoken Language Understanding and Reasoning Benchmarkcited by 101
  36. 2025Step-Audio 2 Technical Reportcited by 101
  37. 2020The Zero Resource Speech Benchmark 2021: Metrics and baselines for unsupervised spoken language modelingcited by 100
  38. 2023Textually Pretrained Speech Language Modelscited by 99

50 most cited of 72 All 72 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025AU-Harness: An Open-Source Toolkit for Holistic Evaluation of Audio LLMs
  2. 2026The Evolving Bottleneck in Speech Generation: Interface Co-design and Staged Alignment from CosyVoice to Qwen-Audio-3.0-TTS ↗
  3. 2026Continuous Audio Thinking for Large Audio Language Models
  4. 2023AudioChatLlama: Towards General-Purpose Speech Abilities for LLMs
  5. 2026Alignment Is All You Need: Instruction-Free Training for General Audio-Language Models
  6. 2026Do Audio LLMs Listen Before They Act? Diagnosing Acoustic-Context Gating in Voice Agents
  7. 2026BayLing-Duplex: Native Full-Duplex Speech Dialogue with a Single Autoregressive LLM
  8. 2025Step-Audio-AQAA: a Fully End-to-End Expressive Large Audio Language Model