A Survey on Self-Improving Test-Time Intelligence: Feedback-Driven Adapting, Learning, and Scaling at Inference
Not on the map. Why?
Abstract (arXiv)
The ability of AI systems to improve their behavior during deployment is becoming increasingly important. As inference moves beyond the static execution of a fixed trained model, a growing body of work studies how models can refine their behavior on the fly by exploiting test-time information and additional computation. These developments have largely evolved along two directions: methods that modify the model's state using test-time signals, and methods that improve predictions through extra inference-time resources such as more sampling and tool use. However, these directions are often studied in separate communities with different terminology, making their connections harder to see. In this survey, we present feedback-driven Test-Time Intelligence (TTI) as a unified perspective for understanding such deployment-time improvement. We use this view to relate test-time adaptation, test-time learning, and test-time scaling, highlighting both their distinctions and their growing overlap in hybrid systems. This unified framework helps connect previously fragmented ideas and provides a clearer conceptual foundation for studying inference-time self-improvement. We review major methodological paradigms, representative applications, and open challenges across vision, language, multimodal learning, generative models, robotics, and healthcare. Our goal is to provide a coherent foundation and research roadmap for the study of self-improving AI systems at test time.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 94 of its 512 references that are in the map. First posted on arXiv 1 Sep 2026.
Builds on
94 of 512 references.
References · 94
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
- 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 991
- 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 867
- 2016Adaptive Computation Time for Recurrent Neural Networkscited by 506
- 2024Improve Mathematical Reasoning in Language Models by Automated Process Supervisioncited by 441
- 2016Revisiting Batch Normalization For Practical Domain Adaptationcited by 288
- 2025Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Stepscited by 234
- 2025A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?cited by 223
- 2025VisualPRM: An Effective Process Reward Model for Multimodal Reasoningcited by 139
- 2025Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memorycited by 136
- 2026Learning to Discover at Test Timecited by 115
38 more
- 2025Agent-R: Training Language Model Agents to Reflect via Iterative Self-Trainingcited by 82
- 2025A Self-Improving Coding Agentcited by 79
- 2021Test-Time Adaptation to Distribution Shift by Confidence Maximization and Input Transformationcited by 68
- 2025ATLAS: Learning to Optimally Memorize the Context at Test Timecited by 66
- 2025It's All Connected: A Journey Through Test-Time Memorization, Attentional Bias, Retention, and Online Optimizationcited by 64
- 2024A Comparative Study on Reasoning Patterns of OpenAI's o1 Modelcited by 63
- 2025End-to-End Test-Time Training for Long Contextcited by 62
- 2021SITA: Single Image Test-time Adaptationcited by 59
- 2024Beyond Model Adaptation at Test Time: A Surveycited by 59
- 2026Hyperagentscited by 56
- 2025Sleep-time Compute: Beyond Inference Scaling at Test-timecited by 43
- 2025Centaur: Robust End-to-End Autonomous Driving with Test-Time Trainingcited by 42
- 2025Scaling Image and Video Generation via Test-Time Evolutionary Searchcited by 40
- 2024Towards Self-Improvement of LLMs via MCTS: Leveraging Stepwise Knowledge with Curriculum Preference Learningcited by 30
- 2026Benchmark Test-Time Scaling of General LLM Agentscited by 26
- 2026AutoSOTA: An End-to-End Automated Research System for State-of-the-Art AI Model Discoverycited by 23
- 2025PairJudge RM: Perform Best-of-N Sampling with Knockout Tournamentcited by 22
- 2026MetaSkill-Evolve: Recursive Self-Improvement of LLM Agents via Two-Timescale Meta-Skill Evolutioncited by 22
- 2025Steering Vision-Language-Action Models as Anti-Exploration: A Test-Time Scaling Approachcited by 21
- 2026Learning to Self-Verify Makes Language Models Better Reasonerscited by 21
- 2026Scaling Verification Can Be More Effective than Scaling Policy Learning for Vision-Language-Action Alignmentcited by 21
- 2025Learning When to Plan: Efficiently Allocating Test-Time Compute for LLM Agentscited by 20
- 2025Test-Time Adaptation for LLM Agents via Environment Interactioncited by 20
- 2026AdaJEPA: An Adaptive Latent World Modelcited by 20
- 2025RoVer: Robot Reward Model as Test-Time Verifier for Vision-Language-Action Modelcited by 19
- 2026TTCS: Test-Time Curriculum Synthesis for Self-Evolvingcited by 19
- 2026RoboTTT: Context Scaling for Robot Policiescited by 19
- 2025SLOT: Sample-specific Language Model Optimization at Test-timecited by 18
- 2025ETS: Efficient Tree Search for Inference-Time Scalingcited by 16
- 2025TUMIX: Multi-Agent Test-Time Scaling with Tool-Use Mixturecited by 15
- 2026Beyond Static Tools: Test-Time Tool Evolution for Scientific Reasoningcited by 15
- 2026Pathwise Test-Time Correction for Autoregressive Long Video Generationcited by 15
- 2026When and How Much to Imagine: Adaptive Test-Time Scaling with World Models for Visual Spatial Reasoningcited by 14
- 2026Latent Context Compilation: Distilling Long Context into Compact Portable Memorycited by 13
- 2026Learning from Trials and Errors: Reflective Test-Time Planning for Embodied LLMscited by 11
- 2026Spatial-TTT: Streaming Visual-based Spatial Intelligence with Test-Time Trainingcited by 11
- 2025TTRV: Test-Time Reinforcement Learning for Vision Language Modelscited by 10
- 2026TAME: A Trustworthy Test-Time Evolution of Agent Memory with Systematic Benchmarkingcited by 10
50 most cited of 94 All 94 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2024A Survey on LLM Inference-Time Self-Improvement
- 2025On the Role of Feedback in Test-Time Scaling of Agentic AI Workflows
- 2025Extending Test-Time Scaling: A 3D Perspective with Context, Batch, and Turn
- 2025A Survey of Test-Time Compute: From Intuitive Inference to Deliberate Reasoning
- 2026TIDE: Trajectory-based Diagnostic Evaluation of Test-Time Improvement in LLM Agents
- 2026Agentic-TTT: Training test-time policy for test-time training
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters
- 2025Limits and Gains of Test-Time Scaling in Vision-Language Reasoning