mlsanityData to 13 Oct 2026

Voxtral

arXiv 2507.13264 ↗First posted 17 Jul 2025cs.SD cs.AI eess.AScited by 43

Not on the map. Why?

Abstract (arXiv)

We present Voxtral Mini and Voxtral Small, two multimodal audio chat models. Voxtral is trained to comprehend both spoken audio and text documents, achieving state-of-the-art performance across a diverse range of audio benchmarks, while preserving strong text capabilities. Voxtral Small outperforms a number of closed-source models, while being small enough to run locally. A 32K context window enables the model to handle audio files up to 40 minutes in duration and long multi-turn conversations. We also contribute three benchmarks for evaluating speech understanding models on knowledge and trivia. Both Voxtral models are released under Apache 2.0 license.

Key facts. Cited by 43 papers in the map (data through 13 Oct 2026). Builds on 22 of its 30 references that are in the map. First posted on arXiv 17 Jul 2025.

Builds on

22 of 30 references.

References · 22

  1. 2017Attention Is All You Needcited by 60,106
  2. 2021Training Verifiers to Solve Math Word Problemscited by 9,916
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,986
  4. 2020Measuring Massive Multitask Language Understandingcited by 7,876
  5. 2024GPT-4o System Cardcited by 4,536
  6. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,004
  7. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,714
  8. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,925
  9. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,366
  10. 2020MLS: A Large-Scale Multilingual Dataset for Speech Researchcited by 468
  11. 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 459
  12. 2021VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretationcited by 456
10 more
  1. 2021GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audiocited by 393
  2. 2024Direct Language Model Alignment from Online AI Feedbackcited by 257
  3. 2024VoiceBench: Benchmarking LLM-Based Voice Assistantscited by 192
  4. 2024LLaMA-Omni: Seamless Speech Interaction with Large Language Modelscited by 172
  5. 2024Spirit LM: Interleaved Spoken and Written Language Modelcited by 124
  6. 2023Spoken Question Answering and Speech Continuation Using Spectrogram-Powered LLMcited by 92
  7. 2021SPGISpeech: 5,000 hours of transcribed financial audio for fully formatted end-to-end speech recognitioncited by 77
  8. 2021Earnings-21: A Practical Benchmark for ASR in the Wildcited by 60
  9. 2022Earnings-22: A Practical Benchmark for Accents in the Wildcited by 46
  10. 2024Scaling Speech-Text Pre-training with Synthetic Interleaved Datacited by 46

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2025: 6; 2026: 37.

43 papers.

Sort:

By area:

  1. 2026X-OPD: Cross-Modal On-Policy Distillation for Capability Alignment in Speech LLMscited by 13
  2. 2025Hearing to Translate: The Effectiveness of Speech Modality Integration into LLMscited by 7
  3. 2025Hearing the Order: Investigating Position Bias in Large Audio-Language Modelscited by 5
  4. 2026All That Glitters Is Not Audio: Rethinking Text Priors and Audio Reliance in Audio-Language Evaluationcited by 5
  5. 2025When Silence Matters: The Impact of Irrelevant Audio on Text Reasoning in Large Audio-Language Modelscited by 4
  6. 2025M3-SLU: Evaluating Speaker-Attributed Reasoning in Multimodal Large Language Modelscited by 4
  7. 2026Walking Through Uncertainty: An Empirical Study of Uncertainty Estimation for Audio-Aware Large Language Modelscited by 4
  8. 2025MCAT: Scaling Many-to-Many Speech-to-Text Translation with MLLMs to 70 Languagescited by 3
  9. 2026Whisper-CD: Accurate Long-Form Speech Recognition using Multi-Negative Contrastive Decodingcited by 3
  10. 2026IndicContextEval: A Benchmark for Evaluating Context Utilisation in Audio Large Language Models Across 8 Indic Languagescited by 3
  11. 2026MUGEN: Evaluating and Improving Multi-audio Understanding of Large Audio-Language Modelscited by 2
  12. 2026TriageSim: A Conversational Emergency Triage Simulation Framework from Structured Electronic Health Recordscited by 2
31 more
  1. 2026Nudging Hidden States: Training-Free Model Steering for Chain-of-Thought Reasoning in Large Audio-Language Modelscited by 2
  2. 2026Speech LLMs are Contextual Reasoning Transcriberscited by 2
  3. 2026Hijacking Large Audio-Language Models via Context-Agnostic and Imperceptible Auditory Prompt Injectioncited by 2
  4. 2026Rethinking Entropy Allocation in LLM-based ASR: Understanding the Dynamics between Speech Encoders and LLMscited by 1
  5. 2026FiLM-Based Speaker Conditioning of a SpeechLLM for Pathological Speech Recognitioncited by 1
  6. 2026Auditing Protocol-Level Shortcuts in Large Audio Language Model Judges for Speech Evaluationcited by 1
  7. 2026CLASH: Counterfactual Auditing of Lexical and Prosodic Reliance in Spoken Sarcasm Detectioncited by 1
  8. 2025Isolated Sign Language Recognition with Segmentation and Pose Estimationcited by 0
  9. 2026WavLink: Compact Audio-Text Embeddings with a Global Whisper Tokencited by 0
  10. 2026BASS: Benchmarking Audio LMs for Musical Structure and Semantic Reasoningcited by 0
  11. 2026A Systematic Study of Cross-Modal Typographic Attacks on Audio-Visual Reasoningcited by 0
  12. 2026Parameter- and Bandwidth-Efficient Edge--cloud Many-to-Many Speech-to-Text Translationcited by 0
  13. 2026LLM-Based Synthetic Ground Truth Generation for Audio-Based Emotion Classification via In-Context Learningcited by 0
  14. 2026ROMPAR: Morphological Completion and Demographic Unlearning for Romanian-Accented Speech Recognitioncited by 0
  15. 2026Atomistic Language Models Understand and Generate Materialscited by 0
  16. 2026RedVox: Safety and Fairness Gaps in Speech Models Across Languagescited by 0
  17. 2026S-DiverSe: Spanish Diverse Speechcited by 0
  18. 2026GigaChat Audio: Time-aware Large Audio Language Modelcited by 0
  19. 2026StreamHear: Domain-Adapted Pseudo-Labeling for Semi-Supervised Streaming Speech Recognitioncited by 0
  20. 2026INSPIRE: A Benchmark for Instruction-Aware Speech Retrievalcited by 0
  21. 2026HEAR Who Said What: Unlocking Speaker-Attributed Reasoning via Counterfactual Voice Groundingcited by 0
  22. 2026The Eloquence submission for Task 2 of the Interspeech 2026 MLC-SLM challengecited by 0
  23. 2026Component-Aware Differential Privacy for Federated Multilingual Speech-LLMscited by 0
  24. 2026Causal Localization of the Refusal Direction in Audio Language Modelscited by 0
  25. 2026ParA-LLM: A Unified Approach to Paralinguistic and Acoustic Speech Understandingcited by 0
  26. 2026Federated Multilingual Speech-LLMs: Architecture and Aggregation Strategy Benchmarkingcited by 0
  27. 2026When Entanglement Lower-Bounds Disparity: Auditing and Repairing Demographic Fairness in Audio Understanding Modelscited by 0
  28. 2026Spooftral: Can Voxtral Audio-Language Model Detect Speech Spoofing?cited by 0
  29. 2026Benchmarking Automatic Speech Recognition Tools for Iberian Languagescited by 0
  30. 2026InterView-C: A Synchronized Multimodal Corpus of VR Avatar-Mediated Survey Interviewscited by 0
  31. 2026Selective Listening: Mechanism-Guided Control of Audio Influence in Large Audio-Language Modelscited by 0