mlsanityData to 14 Oct 2026

ReSight-SMC: Two-Stage Power Sampling via Island SMC with Visual Scouts

arXiv 2609.34905 ↗First posted 28 Sep 2026cs.CVcited by 0

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Power sampling has emerged as a training-free approach to LLM reasoning, eliciting capabilities comparable to reinforcement learning by sharpening the model distribution over complete responses. Despite this success, power sampling remains underexplored in large vision-language models (LVLMs). We transfer Power-SMC to LVLM decoding by defining a sequence-power target conditioned on both the image and the prompt. This direct transfer provides a strong training-free baseline, but leaves two aspects of finite-particle multimodal inference unaddressed. At the particle level, global resampling can collapse genealogies, while particle-based power sampling does not diversify trajectories through distinct visual cues in multimodal decoding, limiting exploration under a finite particle budget. At the answer level, sequence-level sharpening makes distinct reasoning trajectories compete even when they support the same answer. We introduce ReSight-SMC, a verifier-free two-stage power sampler for LVLM inference. Its first stage uses ancestry-isolated SMC islands to preserve independent trajectory families and routes a bounded set of prefix-conditioned visual scouts to prefix-relevant image regions while discouraging redundant overlap. Each scout temporarily increases attention to the image tokens and emphasizes its routed region. Exact importance correction preserves the base LVLM sequence-power target. The second stage aggregates terminal importance mass by canonical answer, powers the answer marginal, and samples an answer together with a supporting trajectory. Across four LVLM backbones and five benchmarks, ReSight-SMC achieves stronger aggregate performance than Power-SMC over both the reasoning and perception benchmark groups. Without post-training, it remains competitive in aggregate with backbone-matched models trained using reinforcement learning.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 27 of its 31 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

27 of 31 references.

Closest ancestors · 11

Same direction, newest first

  1. 2026Aligning Large Vision-Language Models at Test Time: A Trajectory-Guided Structured Sampling Approach4 Aug
  2. 2026Trace: A Taxonomy-Guided Environment for Multidomain Visual Reasoning22 Jul
  3. 2026On Test-Time Scaling for Vision-Language Models27 Jun
  4. 2026AVIS: Adaptive Test-Time Scaling for Vision-Language Models10 Jun
  5. 2025Efficient Test-Time Scaling for Small Vision-Language Models3 Oct
  6. 2025Game-RL: Synthesizing Multimodal Verifiable Game Data to Boost VLMs' General Reasoning20 May
  7. 2025VisuoThink: Empowering LVLM Reasoning with Multimodal Tree Search12 Apr
  8. 2024Interleaved-Modal Chain-of-Thought29 Nov
  9. 2024LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contexts6 Jul
  10. 2023Compositional Chain-of-Thought Prompting for Large Multimodal Models27 Nov
  11. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct

Other references · 16

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  3. 2025Qwen2.5-VL Technical Reportcited by 5,587
  4. 2025Qwen3-VL Technical Reportcited by 2,793
  5. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
  6. 2023Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decodingcited by 688
  7. 2024Multi-Modal Hallucination Control by Visual Information Groundingcited by 208
  8. 2025Reasoning with Sampling: Your Base Model is Smarter Than You Thinkcited by 89
  9. 2026Scalable Power Sampling: Unlocking Efficient, Training-Free Reasoning for LLMs via Distribution Sharpeningcited by 31
  10. 2026Power-SMC: Low-Latency Sequence-Level Power Sampling for Training-Free LLM Reasoningcited by 21
  11. 2026Power Distribution Bridges Sampling, Self-Reward RL, and Self-Distillationcited by 5
  12. 2026Self-Consistency via Marginal Sharpeningcited by 4
4 more
  1. 2026Drift is a Sampling Error: SNR-Aware Power Distributions for Long-Horizon Robotic Planningcited by 3
  2. 2026Reasoning with Sampling: Cutting at Decision Pointscited by 3
  3. 2026SMCEvolve: Principled Scientific Discovery via Sequential Monte Carlo Evolutioncited by 2
  4. 2026More Correct Mass, Worse Answers: Why Power Sampling Can Fail and How to Fix Itcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Chopthin-Consensus Power Sampling: A Diversity-Preserving Approach to LLM Decoding
  2. 2026Towards Efficient Large Vision-Language Models: A Comprehensive Survey on Inference Strategies
  3. 2024Inference Optimal VLMs Need Fewer Visual Tokens and More Parameters
  4. 2026Efficient Inference for Large Vision-Language Models: Bottlenecks, Techniques, and Prospects
  5. 2025LaViDa: A Large Diffusion Language Model for Multimodal Understanding
  6. 2023IdealGPT: Iteratively Decomposing Vision and Language Reasoning via Large Language Models
  7. 2025MASSV: Multimodal Adaptation and Self-Data Distillation for Speculative Decoding of Vision-Language Models
  8. 2026CASHEW: Stabilizing Multimodal Reasoning via Iterative Trajectory Aggregation