mlsanityData to 14 Oct 2026

DAIN: Dynamic Agent-Based Interaction Network for Efficient and Collaborative Multimodal Reasoning

arXiv 2606.30189 ↗First posted 29 Jun 2026cs.CLcited by 0

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

Current multimodal fusion approaches, particularly those based on static Mixture-of-Experts (MoE) architectures, often struggle to provide the adaptive and efficient collaborative reasoning required by complex real-world applications. We introduce the Dynamic Agent-based Interaction Network (DAIN), which reconceptualizes multimodal fusion as a dynamic, multi-agent collaborative process. DAIN employs a context-aware Meta-Controller that dynamically schedules sparse activation of specialized interaction agents and orchestrates compressed inter-agent communication for consensus-building. The framework is guided by a multi-objective loss function that jointly optimizes task accuracy, agent specialization, and operational efficiency through sparse activation and communication regularization. Comprehensive evaluations across five diverse benchmarks -- ADNI, MIMIC-IV, MM-IMDB, CMU-MOSI, and ENRICO -- establish DAIN as a new state-of-the-art, delivering significant performance improvements including a 2.6% accuracy gain on ADNI. Ablation studies verify the critical roles of both dynamic scheduling and agent communication. Furthermore, DAIN offers enhanced interpretability by exposing context-dependent agent roles and collaboration patterns while maintaining computational efficiency through sample-wise sparse agent activation. Our work demonstrates the promise of dynamic, agent-based paradigms for multimodal reasoning.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 25 of its 87 references that are in the map. First posted on arXiv 29 Jun 2026.

Builds on

25 of 87 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025SafeWork-R1: Coevolving Safety and Intelligence under the AI-45circ Law24 Jul

Other references · 24

  1. 2025Seed1.5-VL Technical Reportcited by 373
  2. 2019Learning Individual Styles of Conversational Gesturecited by 191
  3. 2024OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoningcited by 173
  4. 2024MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answeringcited by 93
  5. 2025Dolphin: Document Image Parsing via Heterogeneous Anchor Promptingcited by 79
  6. 2023UniDoc: A Universal Large Multimodal Model for Simultaneous Text Detection, Recognition, Spotting and Understandingcited by 74
  7. 2024TextSquare: Scaling up Text-Centric Visual Instruction Tuningcited by 62
  8. 2024A Bounding Box is Worth One Token: Interleaving Layout and Text in a Large Language Model for Document Understandingcited by 57
  9. 2024Harmonizing Visual Text Comprehension and Generationcited by 54
  10. 2025Vision as LoRAcited by 37
  11. 2025Prolonged Reasoning Is Not All You Need: Certainty-Based Adaptive Routing for Efficient LLM/MLLM Reasoningcited by 35
  12. 2025The Devil behind the mask: An emergent safety vulnerability of Diffusion LLMscited by 34
12 more
  1. 2024A Comprehensive Survey and Guide to Multimodal Large Language Models in Vision-Language Taskscited by 27
  2. 2024MCTBench: Multimodal Cognition towards Text-Rich Visual Scenes Benchmarkcited by 26
  3. 2025WildDoc: How Far Are We from Achieving Comprehensive and Robust Document Understanding in the Wild?cited by 26
  4. 2025Advancing Sequential Numerical Prediction in Autoregressive Modelscited by 26
  5. 2025Exploring Hallucination of Large Multimodal Models in Video Understanding: Benchmark, Analysis and Mitigationcited by 20
  6. 2025Plan Then Action:High-Level Planning Guidance Reinforcement Learning for LLM Reasoningcited by 19
  7. 2026GUI Agents for Continual Game Generationcited by 18
  8. 2026MemMark: State-Evolution Attribution Watermarking for Agent Long-Term Memory Systemscited by 16
  9. 2025Mixture of Experts in Large Language Modelscited by 15
  10. 2026STRIDE: Strategic Trajectory Reasoning via Discriminative Estimation for Verifiable Reinforcement Learningcited by 10
  11. 2026CoRe-Code: Collaborative Reinforcement Learning for Code Generationcited by 4
  12. 2025Multimodal Representation Learning and Fusioncited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Agent-Omni: Test-Time Multimodal Reasoning via Model Coordination for Understanding Anything
  2. 2026DIG to Heal: Scaling General-purpose Agent Collaboration via Explainable Dynamic Decision Paths
  3. 2025AgentsNet: Coordination and Collaborative Reasoning in Multi-Agent LLMs
  4. 2025Agent-ScanKit: Unraveling Memory and Reasoning of Multimodal Agents via Sensitivity Perturbations
  5. 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agents
  6. 2026Qwen3.8-Omni: Towards Native Omni-Modal Agents
  7. 2025OPTAGENT: Optimizing Multi-Agent LLM Interactions Through Verbal Reinforcement Learning for Enhanced Reasoning
  8. 2024COMMA: A Communicative Multimodal Multi-Agent Benchmark