Self-Evolving Visual Questioner
On the map: Multimodal LLMs / vision-language models → VLM benchmarks and visual reasoning
also in 1 more
Abstract (arXiv)
Vision-language models (VLMs) are typically trained as passive answerers, while their ability to actively ask diverse, non-trivial, visual-centric and grounded questions remains underexplored. Existing visual questioners' performance is bottlenecked by the availability of high-quality training data or the cost of curating them. We show that a VLM can continuously improve itself as a visual questioner without any external supervision. We propose a self-evolving framework that uses a VLM itself as both a proposer and a filter to produce harder, more informative, and visual-centric questions, while maintaining their exploration diversity to avoid training collapse. These questions are then used to train the VLM in both questioner and answerer modes. To evaluate the questioner, we introduce an agentic protocol that assesses questions along perception, reasoning, and diversity dimensions. Experiments across various backbone VLMs show that our method substantially enhances the quality and substantially expands the difficulty boundary of autonomous question generation. Under the same budget, our self-supervision is more effective than training on the static source data. Moreover, the self-evolving questioner remains a competitive or even better answerer.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in VLM benchmarks and visual reasoning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 16 of its 28 references that are in the map. First posted on arXiv 11 Jun 2026.
Builds on
16 of 28 references.
Closest ancestors · 2
Same direction, newest first
- 2024Vision-Language Models Can Self-Improve Reasoning via Reflection30 Oct
- 2024Enhancing Large Vision Language Models with Self-Training on Image Comprehension30 May
Other references · 14
- 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 838
- 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 482
- 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 372
- 2025From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3Dcited by 138
- 2024LOVA3: Learning to Visual Question Answering, Asking and Assessmentcited by 21
- 2021Guiding Visual Question Generationcited by 14
- 2026Through the Lens of Contrast: Self-Improving Visual Reasoning in VLMscited by 10
- 2022K-VQG: Knowledge-aware Visual Question Generation for Common-sense Acquisitioncited by 9
- 2025Learning to Instruct for Visual Instruction Tuningcited by 8
- 2025Savaal: Scalable Concept-Driven Question Generation to Enhance Human Learningcited by 7
- 2025CYCLE-INSTRUCT: Fully Seed-Free Instruction Tuning via Dual Self-Training and Cycle Consistencycited by 6
- 2023Location-Aware Visual Question Generation with Lightweight Modelscited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026On-Policy Self-Distillation without Any Supervisioncited by 17
- 2026On-Policy Self-Distillation without Any Supervision6 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026Trinity: Self-Evolving Vision-Language Models with a Self-Verifier
- 2026RISE: Reliable Improvement in Self-Evolving Vision-Language Models
- 2025Automated Generation of Challenging Multiple-Choice Questions for Vision Language Model Evaluation
- 2026Program-Verified Self-Evolution for Vision-Language Models
- 2026Self-Questioning Vision-Language Models: Reinforcement Learning for Compositional Visual Reasoning
- 2025VQ-VA World: Towards High-Quality Visual Question-Visual Answering
- 2025VisPlay: Self-Evolving Vision-Language Models from Images
- 2025Analyzing the Sensitivity of Vision Language Models in Visual Question Answering