mlsanityData to 14 Oct 2026

Interpretable Adaptive Sampling for LLM Test-Time Scaling

arXiv 2608.03961 ↗First posted 4 Aug 2026cs.AIcited by 1

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Test-time scaling improves LLM reasoning by generating and aggregating multiple candidate answers, yet many pipelines use fixed per-query budgets that spend the same compute on easy and difficult prompts. These fixed budgets are also difficult to inspect because they do not explain why a given prompt receives a particular number of samples. We propose adaptive test-time scaling with a lightweight fuzzy controller that maps interpretable signals, including estimated prompt complexity and model confidence, to a per-query sampling budget. The controller assigns fewer samples to easier or more confident prompts and more samples to harder or less certain prompts, making inference-time compute inspectable rather than fixed or opaque. We evaluate under a fair-alignment protocol with matched decoding settings and controlled answer selection, and compare against best-of-N, compute-aware scaling, and self-certainty-based baselines on question-answering and mathematical reasoning tasks. Across models and datasets, adaptive fuzzy control improves over several standard baselines and remains close to a selector-matched full-budget control while reducing the average number of samples. These findings suggest that interpretable adaptive sampling is a practical direction for more efficient test-time reasoning in large language models.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 25 of its 26 references that are in the map. First posted on arXiv 4 Aug 2026.

Builds on

25 of 26 references.

Closest ancestors · 11

Same direction, newest first

  1. 2025Kinetics: Rethinking Test-Time Scaling Laws5 Jun
  2. 2025Rethinking the Role of Prompting Strategies in LLM Test-Time Scaling: A Perspective of Probability Theory16 May
  3. 2025Can Test-Time Scaling Improve World Foundation Model?31 Mar
  4. 2025A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?31 Mar
  5. 2025Efficient Test-Time Scaling via Self-Calibration25 Feb
  6. 2025Scalable Best-of-N Selection for Large Language Models via Self-Certainty25 Feb
  7. 2025Towards Thinking-Optimal Scaling of Test-Time Compute for LLM Reasoning25 Feb
  8. 2025Revisiting the Test-Time Scaling of o1-like Models: Do they Truly Possess Test-Time Scaling Capabilities?17 Feb
  9. 2025Atom of Thoughts for Markov LLM Test-Time Scaling17 Feb
  10. 2025Can 1B LLM Surpass 405B LLM? Rethinking Compute-Optimal Test-Time Scaling10 Feb
  11. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters6 Aug

Other references · 14

  1. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  2. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  3. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  4. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  5. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
  6. 2017Crowdsourcing Multiple Choice Science Questionscited by 765
  7. 2024Rethinking Interpretability in the Era of Large Language Modelscited by 111
  8. 2025GTA1: GUI Test-time Scaling Agentcited by 106
  9. 2025Trae Agent: An LLM-based Agent for Software Engineering with Test-time Scalingcited by 94
  10. 2023InstructZero: Efficient Instruction Optimization for Black-Box Large Language Modelscited by 68
  11. 2025Z1: Efficient Test-time Scaling with Codecited by 35
  12. 2025MCTS-Judge: Test-Time Scaling in LLM-as-a-Judge for Code Correctness Evaluationcited by 32
2 more
  1. 2026Benchmark Test-Time Scaling of General LLM Agentscited by 26
  2. 2025FastTTS: Accelerating Test-Time Scaling for Edge LLM Reasoningcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Refining Over Resampling: Test-Time Self-Correction for LLM Reasoning
  2. 2026ThinkBooster: A Unified Framework for Seamless Test-Time Scaling of LLM Reasoning
  3. 2026Adaptive Power Sampling for LLM Reasoning
  4. 2025Reasoning on a Budget: A Survey of Adaptive and Controllable Test-Time Compute in LLMs
  5. 2026Uncertainty-Aware Budget Allocation for Adaptive Test-Time Reasoning
  6. 2025A Theoretical Study on Bridging Internal Probability and Self-Consistency for LLM Reasoning
  7. 2025Is That Your Final Answer? Test-Time Scaling Improves Selective Question Answering
  8. 2026AERA: Adaptive Evidence Residual Allocation for Efficient Test-Time Reasoning