mlsanityData to 14 Oct 2026

Intrinsic Selection and Particle Resampling for Inference-Time Scaling Beyond Domain Verifiability

arXiv 2606.08850 ↗First posted 7 Jun 2026cs.LG cs.AI cs.CLcited by 1

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Inference-Time Scaling (ITS) has largely succeeded in verifiable domains like math and coding, where cheap verification enables scalable output selection. However, extending ITS to tasks prone to systematic failure - driven by faulty initial assumptions or unmet multidimensional constraints - typically relies on costly external solvers or brittle, model-based verifiers. Our key insight is that the intrinsic statistics of parallel sample sets, specifically length-adjusted tail entropy, provide a robust discriminative signal for solution quality without access to ground truth. Crucially, these statistics serve as a difficulty gate for adaptive compute allocation, dynamically routing problems across scaling regimes. First, Intrinsic Selection (iS) ranks candidates post-hoc, matching consensus-based algorithms across three domains and improving engineering design selection by 20% over pass@1 baselines. Second, Intrinsic Particle Filtering (iPF) generalizes this to step-level resampling, guiding generation toward high-confidence reasoning trajectories to improve pass@1 by 6.1 points on average on hard math problems. Finally, Particle Distillation (dPF) injects privileged guidance via early logit blending and KL-guided resampling, steering generation past systematic reasoning errors to satisfy expert rubrics, yielding up to 26.5% gains on complex clinical responses. Our pipeline applies seamlessly across broad-purpose, domain-specialized, and multimodal architectures, successfully extending ITS to open-ended domains without requiring trained reward models or exact ground-truth verification.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 41 of its 61 references that are in the map. First posted on arXiv 7 Jun 2026.

Builds on

41 of 61 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025Think in Parallel, Answer as One: Logit Averaging for Open-Ended Reasoning2 Dec
  2. 2025Deep Think with Confidence21 Aug
  3. 2025TokUR: Token-Level Uncertainty Estimation for Large Language Model Reasoning16 May
  4. 2025Wider or Deeper? Scaling LLM Inference-Time Compute with Adaptive Branching Tree Search6 Mar
  5. 2025Scalable Best-of-N Selection for Large Language Models via Self-Certainty25 Feb
  6. 2025Rollout Roulette: A Probabilistic Inference Approach to Inference-Time Scaling of LLMs using Particle-Based Monte Carlo Methods3 Feb
  7. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters6 Aug
  8. 2023Universal Self-Consistency for Large Language Model Generation29 Nov
  9. 2023Contrastive Decoding Improves Reasoning in Large Language Models17 Sep
  10. 2022Language Models (Mostly) Know What They Know11 Jul

Other references · 31

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  3. 2022Classifier-Free Diffusion Guidancecited by 5,847
  4. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  5. 2025Qwen2.5-VL Technical Reportcited by 5,587
  6. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  7. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
  8. 2025Gemma 3 Technical Reportcited by 1,824
  9. 2024OpenAI o1 System Cardcited by 1,244
  10. 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 1,053
  11. 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 991
  12. 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 819
19 more
  1. 2022Contrastive Decoding: Open-ended Text Generation as Optimizationcited by 609
  2. 2025Kimi K2: Open Agentic Intelligencecited by 567
  3. 2026Self-Distilled Reasoner: On-Policy Self-Distillation for Large Language Modelscited by 455
  4. 2025HealthBench: Evaluating Large Language Models Towards Improved Human Healthcited by 429
  5. 2025The Lessons of Developing Process Reward Models in Mathematical Reasoningcited by 415
  6. 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 398
  7. 2026Reinforcement Learning via Self-Distillationcited by 332
  8. 2025MathArena: Evaluating LLMs on Uncontaminated Math Competitionscited by 297
  9. 2025Reinforcement Learning with Verifiable Rewards Implicitly Incentivizes Correct Reasoning in Base LLMscited by 289
  10. 2023Stay on topic with Classifier-Free Guidancecited by 91
  11. 2024Probabilistic Inference in Language Models via Twisted Sequential Monte Carlocited by 90
  12. 2023Sequential Monte Carlo Steering of Large Language Models using Probabilistic Programscited by 80
  13. 2026MedGemma 1.5 Technical Reportcited by 45
  14. 2025MCTS-Judge: Test-Time Scaling in LLM-as-a-Judge for Code Correctness Evaluationcited by 32
  15. 2025Beyond Verifiable Rewards: Scaling Reinforcement Learning for Language Models to Unverifiable Datacited by 29
  16. 2025Know What You Don't Know: Uncertainty Calibration of Process Reward Modelscited by 21
  17. 2026Self-Hinting Language Models Enhance Reinforcement Learningcited by 20
  18. 2024On Goodhart's law, with an application to value alignmentcited by 9
  19. 2026A Variational Pseudo-Observation Guided Nudged Particle Filtercited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Mitigating Premature Exploitation in Particle-based Monte Carlo for Inference-Time Scaling
  2. 2025Sample, Scrutinize and Scale: Effective Inference-Time Search by Scaling Verification
  3. 2026Certain Head, Uncertain Tail: Expert-Sample for Test-Time Scaling in Fine-Grained MoE
  4. 2026Hill Sampling for Test-Time Scaling: A Simple and Better Alternative to Repeated Sampling, Evolution, and Training
  5. 2026What If We Allocate Test-Time Compute Adaptively?
  6. 2026Consilience for Verifier-Free Test-Time Scaling
  7. 2025Rethinking Optimal Verification Granularity for Compute-Efficient Test-Time Scaling
  8. 2026Entropy Centroids as Intrinsic Rewards for Test-Time Scaling