mlsanityData to 7 Oct 2026

Test-Time Scaling for Small VLMs on Multilingual Visual MCQ

arXiv 2607.09438 ↗First posted 10 Jul 2026cs.CL cs.AI cs.LGcited by 1

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Test-time scaling (TTS) reliably improves reasoning in large language models, but whether it transfers to small open vision-language models remains unclear. We examine this on EXAMS-V, a multilingual visual multiple-choice benchmark, comparing self-consistency, describe-then-reason with PRM-guided beam search, and two post-hoc selectors across Qwen2.5-VL-7B-Instruct and Qwen3.5-4B. What matters is the conditions under which TTS runs, not the search or verification machinery. The largest factor is parseability: an early prompt format left many chains reasoning correctly yet never committing to an answer letter, which a standard answer cue and a guided repair step largely remove. A larger decoding budget removes the rest: raising the per-chain token limit from 1k to 2k recovers 3.7 pp, whereas sampling more chains (8 to 16) adds only 0.15 pp. Once chains have room to finish, elaborate methods contribute little: PRM-guided beam search trails plain self-consistency by 0.39 pp at over eight times the cost, and neither a training-free generative critic nor a trained multimodal PRM beats majority vote across both policies. The largest gain comes instead from the policy model itself (+11.4 pp). Our best configuration reaches 84.1% on the held-out ImageCLEF 2026 test split, ranking first on the Visual MCQ leaderboard.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 27 of its 30 references that are in the map. First posted on arXiv 10 Jul 2026.

Builds on

27 of 30 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025Limits and Gains of Test-Time Scaling in Vision-Language Reasoning11 Dec
  2. 2025TIM-PRM: Verifying multimodal reasoning with Tool-Integrated PRM28 Nov
  3. 2025Training Vision-Language Process Reward Models for Test-Time Scaling in Multimodal Reasoning: Key Insights and Lessons Learned27 Sep
  4. 2025GM-PRM: A Generative Multimodal Process Reward Model for Multimodal Mathematical Reasoning6 Aug
  5. 2025MSA at ImageCLEF 2025 Multimodal Reasoning: Multilingual Multimodal Reasoning With Ensemble Vision Language Models15 Jul
  6. 2025Think or Not? Selective Reasoning via Reinforcement Learning for Vision-Language Models22 May
  7. 2025VisualPRM: An Effective Process Reward Model for Multimodal Reasoning13 Mar

Other references · 20

  1. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  2. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  3. 2023Let's Verify Step by Stepcited by 3,598
  4. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
  5. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
  6. 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 965
  7. 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 651
  8. 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 494
  9. 2024Inference Scaling Laws: An Empirical Analysis of Compute-Optimal Inference for Problem-Solving with Language Modelscited by 282
  10. 2025Can 1B LLM Surpass 405B LLM? Rethinking Compute-Optimal Test-Time Scalingcited by 135
  11. 2025GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoningcited by 94
  12. 2025Scaling Test-Time Compute Without Verification or RL is Suboptimalcited by 82
8 more
  1. 2025Does Thinking More always Help? Mirage of Test-Time Scaling in Reasoning Modelscited by 52
  2. 2025Inverse Scaling in Test-Time Computecited by 49
  3. 2024EXAMS-V: A Multi-Discipline Multilingual Multimodal Exam Benchmark for Evaluating Vision Language Modelscited by 41
  4. 2025VersaPRM: Multi-Domain Process Reward Model via Synthetic Reasoning Datacited by 39
  5. 2025Athena: Enhancing Multimodal Reasoning with Data-efficient Process Reward Modelscited by 16
  6. 2025PRM-BAS: Enhancing Multimodal Reasoning through PRM-guided Beam Annealing Searchcited by 12
  7. 2025Rethinking Reward Models for Multi-Domain Test-Time Scalingcited by 10
  8. 2025From Mathematical Reasoning to Code: Generalization of Process Reward Models in Test-Time Scalingcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026On Test-Time Scaling for Vision-Language Models
  2. 2025The Art of Scaling Test-Time Compute for Large Language Models
  3. 2025First Finish Search: Efficient Test-Time Scaling in Large Language Models
  4. 2026Test-Time Hinting for Black-Box Vision-Language Models
  5. 2025A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?
  6. 2026AVIS: Adaptive Test-Time Scaling for Vision-Language Models
  7. 2025Efficient Test-Time Scaling for Small Vision-Language Models
  8. 2025Multilingual Test-Time Scaling via Initial Thought Transfer