Agent-Omni: Test-Time Multimodal Reasoning via Model Coordination for Understanding Anything
On the map: LLM reasoning → Multimodal reasoning
also in 2 more
Abstract (arXiv)
Multimodal large language models (MLLMs) have shown strong capabilities but remain limited to fixed modality pairs and require costly fine-tuning with large aligned datasets. Building fully omni-capable models that can integrate text, images, audio, and video remains impractical and lacks robust reasoning support. In this paper, we propose an Agent-Omni framework that coordinates existing foundation models through a master-agent system, enabling flexible multimodal reasoning without retraining. The master agent interprets user intent, delegates subtasks to modality-specific agents, and integrates their outputs into coherent responses. Extensive experiments across text, image, audio, video, and omni benchmarks show that Agent-Omni consistently achieves state-of-the-art performance, particularly on tasks requiring complex cross-modal reasoning. Its agent-based design enables seamless integration of specialized foundation models, ensuring adaptability to diverse inputs while maintaining transparency and interpretability. In addition, the framework is modular and easily extensible, allowing future improvements as stronger models become available.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 1 of its 43 references that are in the map. First posted on arXiv 4 Nov 2025.
Builds on
1 of 43 references.
References · 1
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026MUSE-Autoskill: Self-Evolving Agents via Skill Creation, Memory, Management, and Evaluationcited by 23
- 2026OmniGAIA: Towards Native Omni-Modal AI Agentscited by 21
- 2026OmniDrop: Layer-wise Token Pruning for Omni-modal LLMs via Query-Guidancecited by 3
- 2026Dynin-Omni: Omnimodal Unified Large Diffusion Language Modelcited by 2
- 2026Sandboxed Coding Agents are Competitive Omni-modal Task Solverscited by 2
- 2026CTM-AI: A Blueprint for General AI Inspired by a Model of Consciousnesscited by 1
- 2026Hierarchical Attacks for Multi-Modal Multi-Agent Reasoningcited by 1
- 2026Self-Evolving Multi-Agent Framework for Efficient Decision Making in Real-Time Strategy Scenarioscited by 0
- 2026Omni-IO Skills: Harnessing Your Agent Omni-Nativecited by 0
- 2026Omni-IO Skills: Harnessing Your Agent Omni-Native25 Sep 2026
- 2026Sandboxed Coding Agents are Competitive Omni-modal Task Solvers30 May 2026
- 2026MUSE-Autoskill: Self-Evolving Agents via Skill Creation, Memory, Management, and Evaluation26 May 2026
- 2026OmniDrop: Layer-wise Token Pruning for Omni-modal LLMs via Query-Guidance14 May 2026
- 2026Hierarchical Attacks for Multi-Modal Multi-Agent Reasoning13 May 2026
- 2026CTM-AI: A Blueprint for General AI Inspired by a Model of Consciousness30 Apr 2026
- 2026Self-Evolving Multi-Agent Framework for Efficient Decision Making in Real-Time Strategy Scenarios25 Mar 2026
- 2026Dynin-Omni: Omnimodal Unified Large Diffusion Language Model9 Mar 2026
- 2026OmniGAIA: Towards Native Omni-Modal AI Agents26 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026Qwen3.8-Omni: Towards Native Omni-Modal Agents
- 2025Rethinking Information Synthesis in Multimodal Question Answering A Multi-Agent Perspective
- 2025A Unified Multi-Agent Framework for Universal Multimodal Understanding and Generation
- 2025Agent-ScanKit: Unraveling Memory and Reasoning of Multimodal Agents via Sensitivity Perturbations
- 2025Be My Eyes: Extending Large Language Models to New Modalities Through Multi-Agent Collaboration
- 2025SeeingEye: Agentic Information Flow Unlocks Multimodal Reasoning In Text-only LLMs
- 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Models
- 2025Seeing and Reasoning with Confidence: Supercharging Multimodal LLMs with an Uncertainty-Aware Agentic Framework