mlsanityData to 14 Oct 2026

The NTNU System at the S&I Challenge 2025 SLA Open Track

arXiv 2506.05121 ↗First posted 5 Jun 2025cs.CL cs.SD eess.AScited by 3

Not on the map. Why?

Abstract (arXiv)

A recent line of research on spoken language assessment (SLA) employs neural models such as BERT and wav2vec 2.0 (W2V) to evaluate speaking proficiency across linguistic and acoustic modalities. Although both models effectively capture features relevant to oral competence, each exhibits modality-specific limitations. BERT-based methods rely on ASR transcripts, which often fail to capture prosodic and phonetic cues for SLA. In contrast, W2V-based methods excel at modeling acoustic features but lack semantic interpretability. To overcome these limitations, we propose a system that integrates W2V with Phi-4 multimodal large language model (MLLM) through a score fusion strategy. The proposed system achieves a root mean square error (RMSE) of 0.375 on the official test set of the Speak & Improve Challenge 2025, securing second place in the competition. For comparison, the RMSEs of the top-ranked, third-ranked, and official baseline systems are 0.364, 0.384, and 0.444, respectively.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 17 of its 23 references that are in the map. First posted on arXiv 5 Jun 2025.

Builds on

17 of 23 references.

References · 17

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  4. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
  5. 2023GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpointscited by 1,346
  6. 2023SALMONN: Towards Generic Hearing Abilities for Large Language Modelscited by 506
  7. 2024LongRoPE: Extending LLM Context Window Beyond 2 Million Tokenscited by 313
  8. 2024WavLLM: Towards Robust and Adaptive Speech Large Language Modelcited by 109
  9. 2024Can Large Language Models Automatically Score Proficiency of Written Essays?cited by 35
  10. 2020Self-attention encoding and pooling for speaker recognitioncited by 33
  11. 2022Automatic Pronunciation Assessment using Self-Supervised Speech Representation Learningcited by 29
  12. 2022Proficiency assessment of L2 spoken English using wav2vec 2.0cited by 20
5 more
  1. 2024Speak & Improve Corpus 2025: an L2 English Speech Corpus for Language Assessment and Feedbackcited by 14
  2. 2024Speak & Improve Challenge 2025: Tasks and Baseline Systemscited by 13
  3. 2025LCES: Zero-shot Automated Essay Scoring via Pairwise Comparisons Using Large Language Modelscited by 8
  4. 2024An Effective Automated Speaking Assessment Approach to Mitigating Data Scarcity and Imbalanced Distributioncited by 7
  5. 2022L2 proficiency assessment using self-supervised speech representationscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Assessment of L2 Oral Proficiency using Speech Large Language Models
  2. 2025Beyond Modality Limitations: A Unified MLLM Approach to Automated Speaking Assessment with Effective Curriculum Learning
  3. 2024Pronunciation Assessment with Multi-modal Large Language Models
  4. 2021Mixtures of Deep Neural Experts for Automated Speech Scoring
  5. 2026MoST: Mixing Speech and Text with Modality-Aware Mixture of Experts
  6. 2026Efficiently Adapting Spoken Language Models for the Singaporean Context
  7. 2023Teach me with a Whisper: Enhancing Large Language Models for Analyzing Spoken Transcripts using Speech Embeddings
  8. 2025AFD-SLU: Adaptive Feature Distillation for Spoken Language Understanding