mlsanityData to 14 Oct 2026

NAVER LABS Europe Submission to the Instruction-following Track

arXiv 2506.01808 ↗First posted 2 Jun 2025cs.CLcited by 5

Not on the map. Why?

Abstract (arXiv)

In this paper we describe NAVER LABS Europe submission to the instruction-following speech processing short track at IWSLT 2025. We participate in the constrained settings, developing systems that can simultaneously perform ASR, ST, and SQA tasks from English speech input into the following target languages: Chinese, Italian, and German. Our solution leverages two pretrained modules: (1) a speech-to-LLM embedding projector trained using representations from the SeamlessM4T-v2-large speech encoder; and (2) LoRA adapters trained on text data on top of a Llama-3.1-8B-Instruct. These modules are jointly loaded and further instruction-tuned for 1K steps on multilingual and multimodal data to form our final system submitted for evaluation.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 23 of its 29 references that are in the map. First posted on arXiv 2 Jun 2025.

Builds on

23 of 29 references.

References · 23

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2024Qwen2.5 Technical Reportcited by 4,942
  4. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
  5. 2024Mixtral of Expertscited by 1,823
  6. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,799
  7. 2024Moshi: a speech-text foundation model for real-time dialoguecited by 568
  8. 2023SALMONN: Towards Generic Hearing Abilities for Large Language Modelscited by 506
  9. 2023Scaling Speech Technology to 1,000+ Languagescited by 411
  10. 2023AudioPaLM: A Large Language Model That Can Speak and Listencited by 343
  11. 2024What matters when building vision-language models?cited by 326
  12. 2023AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Headcited by 265
11 more
  1. 2024Tower: An Open Multilingual Large Language Model for Translation-Related Taskscited by 206
  2. 2024Spirit LM: Interleaved Spoken and Written Language Modelcited by 126
  3. 2023SeamlessM4T: Massively Multilingual & Multimodal Machine Translationcited by 125
  4. 2019Europarl-ST: A Multilingual Corpus For Speech Translation Of Parliamentary Debatescited by 114
  5. 2024WavLLM: Towards Robust and Adaptive Speech Large Language Modelcited by 109
  6. 2024EuroLLM: Multilingual Language Models for Europecited by 106
  7. 2018Spoken SQuAD: A Study of Mitigating the Impact of Speech Recognition Errors on Listening Comprehensioncited by 74
  8. 2020CoVoST 2 and Massively Multilingual Speech-to-Text Translationcited by 74
  9. 2024BERGEN: A Benchmarking Library for Retrieval-Augmented Generationcited by 31
  10. 2025From TOWER to SPIRE: Adding the Speech Modality to a Translation-Specialist LLMcited by 8
  11. 2025Breaking Language Barriers in Visual Language Models via Multilingual Textual Regularizationcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

  1. 2026SpeechMapper: Speech-to-text Embedding Projector for LLMscited by 4
  2. 2026MEUSLI: a Multilingual Projector for LLM-based ASR and Beyondcited by 1
  3. 2026FBK's Long-form SpeechLLMs for IWSLT 2026 Instruction Followingcited by 0
  4. 2026NAVER LABS Europe Submission to the Instruction-following 2026 Short Trackcited by 0
  5. 2026NAVER LABS System Re-implementation for the IWSLT 2026 Instruction-Following Taskcited by 0