mlsanityData to 7 Oct 2026

Agent-Omni: Test-Time Multimodal Reasoning via Model Coordination for Understanding Anything

arXiv 2511.02834 ↗First posted 4 Nov 2025cs.AI cs.CL cs.LGcited by 9

On the map: LLM reasoning → Multimodal reasoning

also in 2 more
Abstract (arXiv)

Multimodal large language models (MLLMs) have shown strong capabilities but remain limited to fixed modality pairs and require costly fine-tuning with large aligned datasets. Building fully omni-capable models that can integrate text, images, audio, and video remains impractical and lacks robust reasoning support. In this paper, we propose an Agent-Omni framework that coordinates existing foundation models through a master-agent system, enabling flexible multimodal reasoning without retraining. The master agent interprets user intent, delegates subtasks to modality-specific agents, and integrates their outputs into coherent responses. Extensive experiments across text, image, audio, video, and omni benchmarks show that Agent-Omni consistently achieves state-of-the-art performance, particularly on tasks requiring complex cross-modal reasoning. Its agent-based design enables seamless integration of specialized foundation models, ensuring adaptability to diverse inputs while maintaining transparency and interpretability. In addition, the framework is modular and easily extensible, allowing future improvements as stronger models become available.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 1 of its 43 references that are in the map. First posted on arXiv 4 Nov 2025.

Builds on

1 of 43 references.

References · 1

  1. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 9.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Qwen3.8-Omni: Towards Native Omni-Modal Agents
  2. 2025Rethinking Information Synthesis in Multimodal Question Answering A Multi-Agent Perspective
  3. 2025A Unified Multi-Agent Framework for Universal Multimodal Understanding and Generation
  4. 2025Agent-ScanKit: Unraveling Memory and Reasoning of Multimodal Agents via Sensitivity Perturbations
  5. 2025Be My Eyes: Extending Large Language Models to New Modalities Through Multi-Agent Collaboration
  6. 2025SeeingEye: Agentic Information Flow Unlocks Multimodal Reasoning In Text-only LLMs
  7. 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Models
  8. 2025Seeing and Reasoning with Confidence: Supercharging Multimodal LLMs with an Uncertainty-Aware Agentic Framework