mlsanityData to 14 Oct 2026

Qwen3.8-Omni: Towards Native Omni-Modal Agents

arXiv 2609.25611 ↗First posted 22 Sep 2026cs.CL cs.CV cs.MMcited by 2

On the map: LLM agents and tool use → Multimodal and embodied agents

also in 1 more
Abstract (arXiv)

We introduce Qwen3.8-Omni-Flash, a natively multimodal agentic model for real-world multimodal productivity. Compared with previous omni models, which primarily emphasized perception and interaction, Qwen3.8-Omni-Flash substantially improves multimodal understanding and reasoning, as well as performance on long-horizon agentic tasks. These capabilities are supported by a native multimodal co-training strategy that preserves strong text-domain capabilities while facilitating the transfer of agentic capabilities from text to audio and video tasks. The model inherits the sparse mixture-of-experts (MoE) architecture of Qwen3.8-Next and extends the context window to one million tokens, supporting long-context multimodal reasoning and long-horizon planning. These advances enable integration into production workflows as a primary agent or a specialized sub-agent, supporting video editing, long-form audio and video translation, music-conditioned music video or movie generation, and video-based note or omni-skill creation. To address the lack of native audio and video support in existing agent harnesses, we release Qwen-MM-Plugins, a lightweight open-source plugin framework for multimodal productivity. We further frame real-time multimodal interaction as a system-level challenge requiring orchestration of context and memory management, tool use, and sub-agent delegation. Accordingly, we release Qwen-Live-Harness, an open-source framework for building responsive, real-time multimodal agents based on Qwen3.8-Omni-Flash. Extensive evaluations demonstrate that Qwen3.8-Omni-Flash achieves strong performance across multimodal understanding, reasoning, long-horizon agentic execution, and video productivity tasks. These results and the accompanying open-source tools support Qwen3.8-Omni-Flash as a practical foundation for deploying natively multimodal agents in research and production.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 57 of its 67 references that are in the map. First posted on arXiv 22 Sep 2026.

Builds on

57 of 67 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026AgenticVBench: Can AI Agents Complete Real-World Post-Production Tasks?26 May
  2. 2026OmniGAIA: Towards Native Omni-Modal AI Agents26 Feb

Other references · 55

  1. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  2. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
  3. 2025Group Sequence Policy Optimizationcited by 835
  4. 2025Qwen2.5-Omni Technical Reportcited by 736
  5. 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 526
  6. 2025Qwen3-Omni Technical Reportcited by 497
  7. 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 469
  8. 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 468
  9. 2024LVBench: An Extreme Long Video Understanding Benchmarkcited by 410
  10. 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 279
  11. 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMscited by 234
  12. 2024VoiceBench: Benchmarking LLM-Based Voice Assistantscited by 200
38 more
  1. 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognitioncited by 197
  2. 2025Generalizing Verifiable Instruction Followingcited by 194
  3. 2026Qwen3.5-Omni Technical Reportcited by 174
  4. 2025WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMscited by 155
  5. 2024StreamingBench: Assessing the Gap for MLLMs to Achieve Streaming Video Understandingcited by 144
  6. 2025MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mixcited by 117
  7. 2025Daily-Omni: Towards Audio-Visual Reasoning with Temporal Alignment across Modalitiescited by 110
  8. 2025MMSU: A Massive Multi-task Spoken Language Understanding and Reasoning Benchmarkcited by 103
  9. 2026MOPD: Multi-Teacher On-Policy Distillation for Capability Integration in LLM Post-Trainingcited by 72
  10. 2021M2MeT: The ICASSP 2022 Multi-Channel Multi-Party Meeting Transcription Challengecited by 71
  11. 2025NL2Repo-Bench: Towards Long-Horizon Repository Generation Evaluation of Coding Agentscited by 65
  12. 2026Claw-Eval: Towards Trustworthy Evaluation of Autonomous Agentscited by 64
  13. 2021AISHELL-4: An Open Source Dataset for Speech Enhancement, Separation, Recognition and Speaker Diarization in Conference Scenariocited by 60
  14. 2025OmniVideoBench: Towards Audio-Visual Understanding Evaluation for Omni MLLMscited by 59
  15. 2026Seed2.0 Model Card: Towards Intelligence Frontier for Real-World Complexitycited by 58
  16. 2026Video-MME-v2: Towards the Next Stage in Benchmarks for Comprehensive Video Understandingcited by 55
  17. 2022Open Source MagicData-RAMC: A Rich Annotated Mandarin Conversational(RAMC) Speech Datasetcited by 40
  18. 2026WildClawBench: A Benchmark for Real-World, Long-Horizon Agent Evaluationcited by 37
  19. 2025Audio-centric Video Understanding Benchmark without Text Shortcutcited by 36
  20. 2026On the Design of Qwen3.8-Next Architecture: Evaluation, Efficiency, and Training Stabilitycited by 35
  21. 2025Omni-Captioner: Data Pipeline, Models, and Benchmark for Omni Detailed Perceptioncited by 30
  22. 2025ProactiveVideoQA: A Comprehensive Benchmark Evaluating Proactive Interactions in Video Large Language Modelscited by 27
  23. 2026LVOmniBench: Pioneering Long Audio-Video Understanding Evaluation for Omnimodal LLMscited by 24
  24. 2025See, Hear, and Understand: Benchmarking Audiovisual Human Speech Understanding in Multimodal Large Language Modelscited by 20
  25. 2025Audio MultiChallenge: A Multi-Turn Evaluation of Spoken Dialogue Systems on Natural Human Interactioncited by 19
  26. 2025JointAVBench: A Benchmark for Joint Audio-Visual Reasoning Evaluationcited by 17
  27. 2025Are you really listening? Boosting Perceptual Awareness in Music-QA Benchmarkscited by 16
  28. 2026Vision2Web: A Hierarchical Benchmark for Visual Website Development with Agent Verificationcited by 16
  29. 2026MMOU: A Massive Multi-Task Omni Understanding and Reasoning Benchmark for Long and Complex Real-World Videoscited by 14
  30. 2025WildSpeech-Bench: Benchmarking End-to-End SpeechLLMs in the Wildcited by 13
  31. 2025Summary on The Multilingual Conversational Speech Language Model Challenge: Datasets, Tasks, Baselines, and Methodscited by 10
  32. 2025Can Vision-Language Models Answer Face to Face Questions in the Real-World?cited by 7
  33. 2026SpotSound: Enhancing Large Audio-Language Models with Fine-Grained Temporal Groundingcited by 5
  34. 2026MusTBench: Benchmarking and Advancing Temporal Grounding in Music LLMscited by 2
  35. 2026OmniCap-IF: Benchmarking and Improving Instruction Following Abilities for Omni-Video Captioningcited by 2
  36. 2026UniClawBench: A Universal Benchmark for Proactive Agents on Real-World Taskscited by 2
  37. 2026LongAudioSpan: Spanning the Duration and Depth of Audio Comprehensioncited by 2
  38. 2026Vox-Infinity: Benchmarking the Limits of Long-Context Spoken Language Modelscited by 2

50 most cited of 55 All 55 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Agent-Omni: Test-Time Multimodal Reasoning via Model Coordination for Understanding Anything
  2. 2026Sandboxed Coding Agents are Competitive Omni-modal Task Solvers
  3. 2025A Unified Multi-Agent Framework for Universal Multimodal Understanding and Generation
  4. 2025DeepEyesV2: Toward Agentic Multimodal Model
  5. 2026A Survey on Foundations and Frontiers of Multimodal Agentic Frameworks: Techniques and Applications
  6. 2026TOBench: A Task-Oriented Omni-Modal Benchmark for Real-World Tool-Using Agents
  7. 2026GLM-5V-Turbo: Toward a Native Foundation Model for Multimodal Agents
  8. 2025Active Perception Agent for Omnimodal Audio-Video Understanding