STELAR-VISION: Self-Topology-Aware Efficient Learning for Aligned Reasoning in Vision
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Vision-language models (VLMs) have made significant strides in reasoning, yet they often struggle with complex multimodal tasks and tend to generate overly verbose outputs. A key limitation is their reliance on chain-of-thought (CoT) reasoning, despite many tasks benefiting from alternative topologies like trees or graphs. To address this, we introduce STELAR-Vision, a training framework for topology-aware reasoning. At its core is TopoAug, a synthetic data pipeline that enriches training with diverse topological structures. Using supervised fine-tuning and reinforcement learning, we post-train Qwen2VL models with both accuracy and efficiency in mind. Additionally, we propose Frugal Learning, which reduces output length with minimal accuracy loss. On MATH-V and VLM-S2H, STELAR-Vision improves accuracy by 9.7% over its base model and surpasses the larger Qwen2VL-72B-Instruct by 7.3%. On five out-of-distribution benchmarks, it outperforms Phi-4-Multimodal-Instruct by up to 28.4% and LLaMA-3.2-11B-Vision-Instruct by up to 13.2%, demonstrating strong generalization. Compared to Chain-Only training, our approach achieves 4.3% higher overall accuracy on in-distribution datasets and consistently outperforms across all OOD benchmarks.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 40 of its 50 references that are in the map. First posted on arXiv 12 Aug 2025.
Builds on
40 of 50 references.
Closest ancestors · 7
Same direction, newest first
- 2025LlamaV-o1: Rethinking Step-by-step Visual Reasoning in LLMs10 Jan
- 2025Generalizing from SIMPLE to HARD Visual Reasoning: Can We Mitigate Modality Imbalance in VLMs?5 Jan
- 2024Polymath: A Challenging Multi-modal Mathematical Reasoning Benchmark6 Oct
- 2024LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contexts6 Jul
- 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?1 Jul
- 2024Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning16 May
- 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset22 Feb
Other references · 33
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2023Visual Instruction Tuningcited by 7,869
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2024GPT-4o System Cardcited by 4,588
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
21 more
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2020Learning to summarize from human feedbackcited by 2,588
- 2024Qwen2 Technical Reportcited by 2,120
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,121
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
- 2024SimPO: Simple Preference Optimization with a Reference-Free Rewardcited by 963
- 2022A-OKVQA: A Benchmark for Visual Question Answering using World Knowledgecited by 710
- 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 672
- 2024ORPO: Monolithic Preference Optimization without Reference Modelcited by 562
- 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 521
- 2025L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learningcited by 384
- 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 383
- 2025Training Language Models to Reason Efficientlycited by 247
- 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learningcited by 173
- 2024Training Large Language Models for Reasoning through Reverse Curriculum Reinforcement Learningcited by 65
- 2024VLM-RL: A Unified Vision Language Models and Reinforcement Learning Framework for Safe Autonomous Drivingcited by 51
- 2024Relative Preference Optimization: Enhancing LLM Alignment through Contrasting Responses across Identical and Diverse Promptscited by 36
- 2024Automatic Curriculum Expert Iteration for Reliable LLM Reasoningcited by 16
- 2025Problem-Solving Logic Guided Curriculum In-Context Learning for LLMs Complex Reasoningcited by 12
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026TagaVLM: Topology-Aware Global Action Reasoning for Vision-Language Navigation
- 2025VReST: Enhancing Reasoning in Large Vision-Language Models through Tree Search and Self-Reward Mechanism
- 2025SPHINX: A Synthetic Environment for Visual Perception and Reasoning
- 2024Vision-Language Models Can Self-Improve Reasoning via Reflection
- 2026Self-Consistent Latent Reasoning: Long Latent Sequence Reasoning for Vision-Language Model
- 2025Unveiling Chain of Step Reasoning for Vision-Language Models with Fine-grained Rewards
- 2026Render-of-Thought: Rendering Textual Chain-of-Thought as Images for Visual Latent Reasoning
- 2025Zebra-CoT: A Dataset for Interleaved Vision Language Reasoning