Intrinsic Selection and Particle Resampling for Inference-Time Scaling Beyond Domain Verifiability
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Inference-Time Scaling (ITS) has largely succeeded in verifiable domains like math and coding, where cheap verification enables scalable output selection. However, extending ITS to tasks prone to systematic failure - driven by faulty initial assumptions or unmet multidimensional constraints - typically relies on costly external solvers or brittle, model-based verifiers. Our key insight is that the intrinsic statistics of parallel sample sets, specifically length-adjusted tail entropy, provide a robust discriminative signal for solution quality without access to ground truth. Crucially, these statistics serve as a difficulty gate for adaptive compute allocation, dynamically routing problems across scaling regimes. First, Intrinsic Selection (iS) ranks candidates post-hoc, matching consensus-based algorithms across three domains and improving engineering design selection by 20% over pass@1 baselines. Second, Intrinsic Particle Filtering (iPF) generalizes this to step-level resampling, guiding generation toward high-confidence reasoning trajectories to improve pass@1 by 6.1 points on average on hard math problems. Finally, Particle Distillation (dPF) injects privileged guidance via early logit blending and KL-guided resampling, steering generation past systematic reasoning errors to satisfy expert rubrics, yielding up to 26.5% gains on complex clinical responses. Our pipeline applies seamlessly across broad-purpose, domain-specialized, and multimodal architectures, successfully extending ITS to open-ended domains without requiring trained reward models or exact ground-truth verification.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 41 of its 61 references that are in the map. First posted on arXiv 7 Jun 2026.
Builds on
41 of 61 references.
Closest ancestors · 10
Same direction, newest first
- 2025Think in Parallel, Answer as One: Logit Averaging for Open-Ended Reasoning2 Dec
- 2025Deep Think with Confidence21 Aug
- 2025TokUR: Token-Level Uncertainty Estimation for Large Language Model Reasoning16 May
- 2025Wider or Deeper? Scaling LLM Inference-Time Compute with Adaptive Branching Tree Search6 Mar
- 2025Scalable Best-of-N Selection for Large Language Models via Self-Certainty25 Feb
- 2025Rollout Roulette: A Probabilistic Inference Approach to Inference-Time Scaling of LLMs using Particle-Based Monte Carlo Methods3 Feb
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters6 Aug
- 2023Universal Self-Consistency for Large Language Model Generation29 Nov
- 2023Contrastive Decoding Improves Reasoning in Large Language Models17 Sep
- 2022Language Models (Mostly) Know What They Know11 Jul
Other references · 31
- 2025Qwen3 Technical Reportcited by 8,820
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
- 2025Gemma 3 Technical Reportcited by 1,824
- 2024OpenAI o1 System Cardcited by 1,244
- 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 1,053
- 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 991
- 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 819
19 more
- 2022Contrastive Decoding: Open-ended Text Generation as Optimizationcited by 609
- 2025Kimi K2: Open Agentic Intelligencecited by 567
- 2026Self-Distilled Reasoner: On-Policy Self-Distillation for Large Language Modelscited by 455
- 2025HealthBench: Evaluating Large Language Models Towards Improved Human Healthcited by 429
- 2025The Lessons of Developing Process Reward Models in Mathematical Reasoningcited by 415
- 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 398
- 2026Reinforcement Learning via Self-Distillationcited by 332
- 2025MathArena: Evaluating LLMs on Uncontaminated Math Competitionscited by 297
- 2025Reinforcement Learning with Verifiable Rewards Implicitly Incentivizes Correct Reasoning in Base LLMscited by 289
- 2023Stay on topic with Classifier-Free Guidancecited by 91
- 2024Probabilistic Inference in Language Models via Twisted Sequential Monte Carlocited by 90
- 2023Sequential Monte Carlo Steering of Large Language Models using Probabilistic Programscited by 80
- 2026MedGemma 1.5 Technical Reportcited by 45
- 2025MCTS-Judge: Test-Time Scaling in LLM-as-a-Judge for Code Correctness Evaluationcited by 32
- 2025Beyond Verifiable Rewards: Scaling Reinforcement Learning for Language Models to Unverifiable Datacited by 29
- 2025Know What You Don't Know: Uncertainty Calibration of Process Reward Modelscited by 21
- 2026Self-Hinting Language Models Enhance Reinforcement Learningcited by 20
- 2024On Goodhart's law, with an application to value alignmentcited by 9
- 2026A Variational Pseudo-Observation Guided Nudged Particle Filtercited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Mitigating Premature Exploitation in Particle-based Monte Carlo for Inference-Time Scaling
- 2025Sample, Scrutinize and Scale: Effective Inference-Time Search by Scaling Verification
- 2026Certain Head, Uncertain Tail: Expert-Sample for Test-Time Scaling in Fine-Grained MoE
- 2026Hill Sampling for Test-Time Scaling: A Simple and Better Alternative to Repeated Sampling, Evolution, and Training
- 2026What If We Allocate Test-Time Compute Adaptively?
- 2026Consilience for Verifier-Free Test-Time Scaling
- 2025Rethinking Optimal Verification Granularity for Compute-Efficient Test-Time Scaling
- 2026Entropy Centroids as Intrinsic Rewards for Test-Time Scaling