Orion: A Unified Visual Agent for Multimodal Perception, Advanced Visual Reasoning and Execution
On the map: LLM reasoning → Multimodal reasoning
also in 1 more
Abstract (arXiv)
We introduce Orion, a visual agent that integrates vision-based reasoning with tool-augmented execution to achieve powerful, precise, multi-step visual intelligence across images, video, and documents. Unlike traditional vision-language models that generate descriptive outputs, Orion orchestrates a suite of specialized computer vision tools, including object detection, keypoint localization, panoptic segmentation, Optical Character Recognition (OCR), and geometric analysis, to execute complex multi-step visual workflows. The system achieves competitive performance across MMMU, MMBench, DocVQA, and MMLongBench while extending monolithic VLM capabilities to production-grade visual intelligence. Through its agentic, tool-augmented approach, Orion enables autonomous visual reasoning that bridges neural perception with symbolic execution, marking the transition from passive visual understanding to active, tool-driven visual intelligence. Try Orion for free at: https://chat.vlm.run Learn more at: https://www.vlm.run/orion
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 12 of its 18 references that are in the map. First posted on arXiv 18 Nov 2025.
Builds on
12 of 18 references.
Closest ancestors · 1
Same direction, newest first
Other references · 11
- 2023GPT-4 Technical Reportcited by 18,396
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2025Qwen3 Technical Reportcited by 8,820
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Visual Instruction Tuningcited by 7,869
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
- 2024Prometheus-Vision: Vision-Language Model as a Judge for Fine-Grained Evaluationcited by 125
- 2024Computational Dynamical Systemscited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026VLM-in-Sandbox: Visual Workspaces for Agentic Visual Reasoning
- 2024VipAct: Visual-Perception Enhancement via Specialized VLM Agent Collaboration and Tool-use
- 2025PixelCraft: A Multi-Agent System for High-Fidelity Visual Reasoning on Structured Images
- 2025SenseNova-MARS: Empowering Multimodal Agentic Reasoning and Search via Reinforcement Learning
- 2025Agent-X: Evaluating Deep Multimodal Reasoning in Vision-Centric Agentic Tasks
- 2025Diagnosing Visual Reasoning: Challenges, Insights, and a Path Forward
- 2025Argus: Vision-Centric Reasoning with Grounded Chain-of-Thought
- 2026Visual Para-Thinker++: A Single-Policy Multi-Agent Framework for Visual Reasoning