mlsanityData to 14 Oct 2026

STELAR-VISION: Self-Topology-Aware Efficient Learning for Aligned Reasoning in Vision

arXiv 2508.08688 ↗First posted 12 Aug 2025cs.AI cs.CVcited by 0

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Vision-language models (VLMs) have made significant strides in reasoning, yet they often struggle with complex multimodal tasks and tend to generate overly verbose outputs. A key limitation is their reliance on chain-of-thought (CoT) reasoning, despite many tasks benefiting from alternative topologies like trees or graphs. To address this, we introduce STELAR-Vision, a training framework for topology-aware reasoning. At its core is TopoAug, a synthetic data pipeline that enriches training with diverse topological structures. Using supervised fine-tuning and reinforcement learning, we post-train Qwen2VL models with both accuracy and efficiency in mind. Additionally, we propose Frugal Learning, which reduces output length with minimal accuracy loss. On MATH-V and VLM-S2H, STELAR-Vision improves accuracy by 9.7% over its base model and surpasses the larger Qwen2VL-72B-Instruct by 7.3%. On five out-of-distribution benchmarks, it outperforms Phi-4-Multimodal-Instruct by up to 28.4% and LLaMA-3.2-11B-Vision-Instruct by up to 13.2%, demonstrating strong generalization. Compared to Chain-Only training, our approach achieves 4.3% higher overall accuracy on in-distribution datasets and consistently outperforms across all OOD benchmarks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 40 of its 50 references that are in the map. First posted on arXiv 12 Aug 2025.

Builds on

40 of 50 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025LlamaV-o1: Rethinking Step-by-step Visual Reasoning in LLMs10 Jan
  2. 2025Generalizing from SIMPLE to HARD Visual Reasoning: Can We Mitigate Modality Imbalance in VLMs?5 Jan
  3. 2024Polymath: A Challenging Multi-modal Mathematical Reasoning Benchmark6 Oct
  4. 2024LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contexts6 Jul
  5. 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?1 Jul
  6. 2024Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning16 May
  7. 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset22 Feb

Other references · 33

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2024The Llama 3 Herd of Modelscited by 14,715
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  6. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  7. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  8. 2023Visual Instruction Tuningcited by 7,869
  9. 2025Qwen2.5-VL Technical Reportcited by 5,587
  10. 2024Qwen2.5 Technical Reportcited by 4,942
  11. 2024GPT-4o System Cardcited by 4,588
  12. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
21 more
  1. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  2. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  3. 2020Learning to summarize from human feedbackcited by 2,588
  4. 2024Qwen2 Technical Reportcited by 2,120
  5. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  6. 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,121
  7. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
  8. 2024SimPO: Simple Preference Optimization with a Reference-Free Rewardcited by 963
  9. 2022A-OKVQA: A Benchmark for Visual Question Answering using World Knowledgecited by 710
  10. 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 672
  11. 2024ORPO: Monolithic Preference Optimization without Reference Modelcited by 562
  12. 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 521
  13. 2025L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learningcited by 384
  14. 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 383
  15. 2025Training Language Models to Reason Efficientlycited by 247
  16. 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learningcited by 173
  17. 2024Training Large Language Models for Reasoning through Reverse Curriculum Reinforcement Learningcited by 65
  18. 2024VLM-RL: A Unified Vision Language Models and Reinforcement Learning Framework for Safe Autonomous Drivingcited by 51
  19. 2024Relative Preference Optimization: Enhancing LLM Alignment through Contrasting Responses across Identical and Diverse Promptscited by 36
  20. 2024Automatic Curriculum Expert Iteration for Reliable LLM Reasoningcited by 16
  21. 2025Problem-Solving Logic Guided Curriculum In-Context Learning for LLMs Complex Reasoningcited by 12

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026TagaVLM: Topology-Aware Global Action Reasoning for Vision-Language Navigation
  2. 2025VReST: Enhancing Reasoning in Large Vision-Language Models through Tree Search and Self-Reward Mechanism
  3. 2025SPHINX: A Synthetic Environment for Visual Perception and Reasoning
  4. 2024Vision-Language Models Can Self-Improve Reasoning via Reflection
  5. 2026Self-Consistent Latent Reasoning: Long Latent Sequence Reasoning for Vision-Language Model
  6. 2025Unveiling Chain of Step Reasoning for Vision-Language Models with Fine-grained Rewards
  7. 2026Render-of-Thought: Rendering Textual Chain-of-Thought as Images for Visual Latent Reasoning
  8. 2025Zebra-CoT: A Dataset for Interleaved Vision Language Reasoning