mlsanityData to 14 Oct 2026

Zero-Shot Cognitive Impairment Detection from Speech Using AudioLLM

arXiv 2506.17351 ↗First posted 20 Jun 2025cs.SD cs.AI cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

Cognitive impairment (CI) is of growing public health concern, and early detection is vital for effective intervention. Speech has gained attention as a non-invasive and easily collectible biomarker for assessing cognitive decline. Traditional CI detection methods typically rely on supervised models trained on acoustic and linguistic features extracted from speech, which often require manual annotation and may not generalise well across datasets and languages. In this work, we propose the first zero-shot speech-based CI detection method using the Qwen2- Audio AudioLLM, a model capable of processing both audio and text inputs. By designing prompt-based instructions, we guide the model in classifying speech samples as indicative of normal cognition or cognitive impairment. We evaluate our approach on two datasets: one in English and another multilingual, spanning different cognitive assessment tasks. Our results show that the zero-shot AudioLLM approach achieves performance comparable to supervised methods and exhibits promising generalizability and consistency across languages, tasks, and datasets.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 28 of its 50 references that are in the map. First posted on arXiv 20 Jun 2025.

Builds on

28 of 50 references.

References · 28

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  5. 2024Qwen2.5 Technical Reportcited by 4,942
  6. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  7. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  8. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  9. 2023Qwen Technical Reportcited by 3,344
  10. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
  11. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
  12. 2016Enriching Word Vectors with Subword Informationcited by 1,583
16 more
  1. 2023Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Modelscited by 608
  2. 2023SALMONN: Towards Generic Hearing Abilities for Large Language Modelscited by 506
  3. 2022BEATs: Audio Pre-Training with Acoustic Tokenizerscited by 388
  4. 2024VoiceBench: Benchmarking LLM-Based Voice Assistantscited by 200
  5. 2024AudioBench: A Universal Benchmark for Audio Large Language Modelscited by 128
  6. 2024WavLLM: Towards Robust and Adaptive Speech Large Language Modelcited by 109
  7. 2020Alzheimer's Dementia Recognition through Spontaneous Speech: The ADReSS Challengecited by 104
  8. 2023Diagnostic Reasoning Prompts Reveal the Potential for Large Language Model Interpretability in Medicinecited by 83
  9. 2024A Survey on Speech Large Language Models for Understandingcited by 71
  10. 2020To BERT or Not To BERT: Comparing Speech and Language-based Approaches for Alzheimer's Disease Detectioncited by 49
  11. 2020Artificial Intelligence, speech and language processing approaches to monitoring Alzheimer's Disease: a systematic reviewcited by 29
  12. 2021Multi-modal fusion with gating using audio, lexical and disfluency features for Alzheimer's Dementia recognition from spontaneous speechcited by 16
  13. 2024Connected Speech-Based Cognitive Assessment in Chinese and Englishcited by 13
  14. 2019Better Word Embeddings by Disentangling Contextual n-Gram Informationcited by 12
  15. 2024Early Dementia Detection Using Multiple Spontaneous Speech Prompts: The PROCESS Challengecited by 6
  16. 2024Cognitive Insights Across Languages: Enhancing Multimodal Interview Analysiscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.