mlsanityData to 7 Oct 2026

Hello-Chat: Towards Realistic Social Audio Interactions

arXiv 2602.23387 ↗First posted 16 Feb 2026cs.SD cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advancements in Large Audio Language Models (LALMs) have demonstrated exceptional performance in speech recognition and translation. However, existing models often suffer from a disconnect between perception and expression, resulting in a robotic "read-speech" style that lacks the spontaneity and emotional resonance of real human interaction. In this report, we introduce Hello-Chat, an end-to-end audio language model designed for realistic social scenarios. By leveraging a massive dataset of real-life conversations and employing a modality-interleaved training strategy, Hello-Chat achieves a breakthrough in anthropomorphic generation. Experimental results show that our model not only reaches state-of-the-art (SOTA) performance on specific audio understanding tasks but also significantly outperforms existing baselines in prosodic naturalness and emotional alignment, paving the way for the next generation of empathetic AI agents.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 43 references that are in the map. First posted on arXiv 16 Feb 2026.

Builds on

25 of 43 references.

References · 25

  1. 2017Attention Is All You Needcited by 59,932
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2024The Llama 3 Herd of Modelscited by 14,192
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  5. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  6. 2022Scalable Diffusion Models with Transformerscited by 5,931
  7. 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
  8. 2021SoundStream: An End-to-End Neural Audio Codeccited by 756
  9. 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 737
  10. 2022High Fidelity Neural Audio Compressioncited by 673
  11. 2023High-Fidelity Audio Compression with Improved RVQGANcited by 423
  12. 2024F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matchingcited by 353
13 more
  1. 2024CosyVoice: A Scalable Multilingual Zero-shot Text-to-speech Synthesizer based on Supervised Semantic Tokenscited by 323
  2. 2024Seed-TTS: A Family of High-Quality Versatile Speech Generation Modelscited by 293
  3. 2023WavCaps: A ChatGPT-Assisted Weakly-Labelled Audio Captioning Dataset for Audio-Language Multimodal Researchcited by 266
  4. 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognitioncited by 189
  5. 2024Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLMcited by 135
  6. 2020AISHELL-3: A Multi-speaker Mandarin TTS Corpus and the Baselinescited by 111
  7. 2025Step-Audio 2 Technical Reportcited by 101
  8. 2023HiFi-Codec: Group-residual Vector quantization for High Fidelity Audio Codeccited by 95
  9. 2025IndexTTS2: A Breakthrough in Emotionally Expressive and Duration-Controlled Auto-Regressive Zero-Shot Text-to-Speechcited by 85
  10. 2021Large-scale Self-Supervised Speech Representation Learning for Automatic Speaker Verificationcited by 71
  11. 2024EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and Benchmarkcited by 39
  12. 2025MiDashengLM: Efficient Audio Understanding with General Audio Captionscited by 31
  13. 2024Typhoon 2: A Family of Open Text and Multimodal Thai Large Language Modelscited by 12

Built on by

Not cited yet.