Qwen3.8-Omni: Towards Native Omni-Modal Agents
On the map: LLM agents and tool use → Multimodal and embodied agents
also in 1 more
Abstract (arXiv)
We introduce Qwen3.8-Omni-Flash, a natively multimodal agentic model for real-world multimodal productivity. Compared with previous omni models, which primarily emphasized perception and interaction, Qwen3.8-Omni-Flash substantially improves multimodal understanding and reasoning, as well as performance on long-horizon agentic tasks. These capabilities are supported by a native multimodal co-training strategy that preserves strong text-domain capabilities while facilitating the transfer of agentic capabilities from text to audio and video tasks. The model inherits the sparse mixture-of-experts (MoE) architecture of Qwen3.8-Next and extends the context window to one million tokens, supporting long-context multimodal reasoning and long-horizon planning. These advances enable integration into production workflows as a primary agent or a specialized sub-agent, supporting video editing, long-form audio and video translation, music-conditioned music video or movie generation, and video-based note or omni-skill creation. To address the lack of native audio and video support in existing agent harnesses, we release Qwen-MM-Plugins, a lightweight open-source plugin framework for multimodal productivity. We further frame real-time multimodal interaction as a system-level challenge requiring orchestration of context and memory management, tool use, and sub-agent delegation. Accordingly, we release Qwen-Live-Harness, an open-source framework for building responsive, real-time multimodal agents based on Qwen3.8-Omni-Flash. Extensive evaluations demonstrate that Qwen3.8-Omni-Flash achieves strong performance across multimodal understanding, reasoning, long-horizon agentic execution, and video productivity tasks. These results and the accompanying open-source tools support Qwen3.8-Omni-Flash as a practical foundation for deploying natively multimodal agents in research and production.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 57 of its 67 references that are in the map. First posted on arXiv 22 Sep 2026.
Builds on
57 of 67 references.
Closest ancestors · 2
Same direction, newest first
- 2026AgenticVBench: Can AI Agents Complete Real-World Post-Production Tasks?26 May
- 2026OmniGAIA: Towards Native Omni-Modal AI Agents26 Feb
Other references · 55
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
- 2025Group Sequence Policy Optimizationcited by 835
- 2025Qwen2.5-Omni Technical Reportcited by 736
- 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 526
- 2025Qwen3-Omni Technical Reportcited by 497
- 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 469
- 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 468
- 2024LVBench: An Extreme Long Video Understanding Benchmarkcited by 410
- 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 279
- 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMscited by 234
- 2024VoiceBench: Benchmarking LLM-Based Voice Assistantscited by 200
38 more
- 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognitioncited by 197
- 2025Generalizing Verifiable Instruction Followingcited by 194
- 2026Qwen3.5-Omni Technical Reportcited by 174
- 2025WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMscited by 155
- 2024StreamingBench: Assessing the Gap for MLLMs to Achieve Streaming Video Understandingcited by 144
- 2025MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mixcited by 117
- 2025Daily-Omni: Towards Audio-Visual Reasoning with Temporal Alignment across Modalitiescited by 110
- 2025MMSU: A Massive Multi-task Spoken Language Understanding and Reasoning Benchmarkcited by 103
- 2026MOPD: Multi-Teacher On-Policy Distillation for Capability Integration in LLM Post-Trainingcited by 72
- 2021M2MeT: The ICASSP 2022 Multi-Channel Multi-Party Meeting Transcription Challengecited by 71
- 2025NL2Repo-Bench: Towards Long-Horizon Repository Generation Evaluation of Coding Agentscited by 65
- 2026Claw-Eval: Towards Trustworthy Evaluation of Autonomous Agentscited by 64
- 2021AISHELL-4: An Open Source Dataset for Speech Enhancement, Separation, Recognition and Speaker Diarization in Conference Scenariocited by 60
- 2025OmniVideoBench: Towards Audio-Visual Understanding Evaluation for Omni MLLMscited by 59
- 2026Seed2.0 Model Card: Towards Intelligence Frontier for Real-World Complexitycited by 58
- 2026Video-MME-v2: Towards the Next Stage in Benchmarks for Comprehensive Video Understandingcited by 55
- 2022Open Source MagicData-RAMC: A Rich Annotated Mandarin Conversational(RAMC) Speech Datasetcited by 40
- 2026WildClawBench: A Benchmark for Real-World, Long-Horizon Agent Evaluationcited by 37
- 2025Audio-centric Video Understanding Benchmark without Text Shortcutcited by 36
- 2026On the Design of Qwen3.8-Next Architecture: Evaluation, Efficiency, and Training Stabilitycited by 35
- 2025Omni-Captioner: Data Pipeline, Models, and Benchmark for Omni Detailed Perceptioncited by 30
- 2025ProactiveVideoQA: A Comprehensive Benchmark Evaluating Proactive Interactions in Video Large Language Modelscited by 27
- 2026LVOmniBench: Pioneering Long Audio-Video Understanding Evaluation for Omnimodal LLMscited by 24
- 2025See, Hear, and Understand: Benchmarking Audiovisual Human Speech Understanding in Multimodal Large Language Modelscited by 20
- 2025Audio MultiChallenge: A Multi-Turn Evaluation of Spoken Dialogue Systems on Natural Human Interactioncited by 19
- 2025JointAVBench: A Benchmark for Joint Audio-Visual Reasoning Evaluationcited by 17
- 2025Are you really listening? Boosting Perceptual Awareness in Music-QA Benchmarkscited by 16
- 2026Vision2Web: A Hierarchical Benchmark for Visual Website Development with Agent Verificationcited by 16
- 2026MMOU: A Massive Multi-Task Omni Understanding and Reasoning Benchmark for Long and Complex Real-World Videoscited by 14
- 2025WildSpeech-Bench: Benchmarking End-to-End SpeechLLMs in the Wildcited by 13
- 2025Summary on The Multilingual Conversational Speech Language Model Challenge: Datasets, Tasks, Baselines, and Methodscited by 10
- 2025Can Vision-Language Models Answer Face to Face Questions in the Real-World?cited by 7
- 2026SpotSound: Enhancing Large Audio-Language Models with Fine-Grained Temporal Groundingcited by 5
- 2026MusTBench: Benchmarking and Advancing Temporal Grounding in Music LLMscited by 2
- 2026OmniCap-IF: Benchmarking and Improving Instruction Following Abilities for Omni-Video Captioningcited by 2
- 2026UniClawBench: A Universal Benchmark for Proactive Agents on Real-World Taskscited by 2
- 2026LongAudioSpan: Spanning the Duration and Depth of Audio Comprehensioncited by 2
- 2026Vox-Infinity: Benchmarking the Limits of Long-Context Spoken Language Modelscited by 2
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Agent-Omni: Test-Time Multimodal Reasoning via Model Coordination for Understanding Anything
- 2026Sandboxed Coding Agents are Competitive Omni-modal Task Solvers
- 2025A Unified Multi-Agent Framework for Universal Multimodal Understanding and Generation
- 2025DeepEyesV2: Toward Agentic Multimodal Model
- 2026A Survey on Foundations and Frontiers of Multimodal Agentic Frameworks: Techniques and Applications
- 2026TOBench: A Task-Oriented Omni-Modal Benchmark for Real-World Tool-Using Agents
- 2026GLM-5V-Turbo: Toward a Native Foundation Model for Multimodal Agents
- 2025Active Perception Agent for Omnimodal Audio-Video Understanding