Interpretable Adaptive Sampling for LLM Test-Time Scaling
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Test-time scaling improves LLM reasoning by generating and aggregating multiple candidate answers, yet many pipelines use fixed per-query budgets that spend the same compute on easy and difficult prompts. These fixed budgets are also difficult to inspect because they do not explain why a given prompt receives a particular number of samples. We propose adaptive test-time scaling with a lightweight fuzzy controller that maps interpretable signals, including estimated prompt complexity and model confidence, to a per-query sampling budget. The controller assigns fewer samples to easier or more confident prompts and more samples to harder or less certain prompts, making inference-time compute inspectable rather than fixed or opaque. We evaluate under a fair-alignment protocol with matched decoding settings and controlled answer selection, and compare against best-of-N, compute-aware scaling, and self-certainty-based baselines on question-answering and mathematical reasoning tasks. Across models and datasets, adaptive fuzzy control improves over several standard baselines and remains close to a selector-matched full-budget control while reducing the average number of samples. These findings suggest that interpretable adaptive sampling is a practical direction for more efficient test-time reasoning in large language models.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 25 of its 26 references that are in the map. First posted on arXiv 4 Aug 2026.
Builds on
25 of 26 references.
Closest ancestors · 11
Same direction, newest first
- 2025Kinetics: Rethinking Test-Time Scaling Laws5 Jun
- 2025Rethinking the Role of Prompting Strategies in LLM Test-Time Scaling: A Perspective of Probability Theory16 May
- 2025Can Test-Time Scaling Improve World Foundation Model?31 Mar
- 2025A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?31 Mar
- 2025Efficient Test-Time Scaling via Self-Calibration25 Feb
- 2025Scalable Best-of-N Selection for Large Language Models via Self-Certainty25 Feb
- 2025Towards Thinking-Optimal Scaling of Test-Time Compute for LLM Reasoning25 Feb
- 2025Revisiting the Test-Time Scaling of o1-like Models: Do they Truly Possess Test-Time Scaling Capabilities?17 Feb
- 2025Atom of Thoughts for Markov LLM Test-Time Scaling17 Feb
- 2025Can 1B LLM Surpass 405B LLM? Rethinking Compute-Optimal Test-Time Scaling10 Feb
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters6 Aug
Other references · 14
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
- 2017Crowdsourcing Multiple Choice Science Questionscited by 765
- 2024Rethinking Interpretability in the Era of Large Language Modelscited by 111
- 2025GTA1: GUI Test-time Scaling Agentcited by 106
- 2025Trae Agent: An LLM-based Agent for Software Engineering with Test-time Scalingcited by 94
- 2023InstructZero: Efficient Instruction Optimization for Black-Box Large Language Modelscited by 68
- 2025Z1: Efficient Test-time Scaling with Codecited by 35
- 2025MCTS-Judge: Test-Time Scaling in LLM-as-a-Judge for Code Correctness Evaluationcited by 32
2 more
- 2026Benchmark Test-Time Scaling of General LLM Agentscited by 26
- 2025FastTTS: Accelerating Test-Time Scaling for Edge LLM Reasoningcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Refining Over Resampling: Test-Time Self-Correction for LLM Reasoning
- 2026ThinkBooster: A Unified Framework for Seamless Test-Time Scaling of LLM Reasoning
- 2026Adaptive Power Sampling for LLM Reasoning
- 2025Reasoning on a Budget: A Survey of Adaptive and Controllable Test-Time Compute in LLMs
- 2026Uncertainty-Aware Budget Allocation for Adaptive Test-Time Reasoning
- 2025A Theoretical Study on Bridging Internal Probability and Self-Consistency for LLM Reasoning
- 2025Is That Your Final Answer? Test-Time Scaling Improves Selective Question Answering
- 2026AERA: Adaptive Evidence Residual Allocation for Efficient Test-Time Reasoning