A Survey of In-Context Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
Reinforcement learning (RL) agents typically optimize their policies by performing expensive backward passes to update their network parameters. However, some agents can solve new tasks without updating any parameters by simply conditioning on additional context such as their action-observation histories. This paper surveys work on such behavior, known as in-context reinforcement learning.
Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Feb 2025.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2025: 19; 2026: 16.
35 papers.
Sort:
By area:
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligencecited by 155
- 2025A Survey on Vision-Language-Action Models: An Action Tokenization Perspectivecited by 96
- 2025Reward Is Enough: LLMs Are In-Context Reinforcement Learnerscited by 29
- 2025LLM Economist: Large Population Models and Mechanism Design in Multi-Agent Generative Simulacracited by 20
- 2025A Survey of Continual Reinforcement Learningcited by 16
- 2025Yes, Q-learning Helps Offline In-Context RLcited by 8
- 2025Scalable In-Context Q-Learningcited by 5
- 2026Complementary RL: Towards Efficient Experience-Driven Agent Learningcited by 5
- 2025Experience Replay Addresses Loss of Plasticity in Continual Learningcited by 4
- 2026Improving Efficiency of GPU Kernel Optimization Agents using a Domain-Specific Language and Speed-of-Light Guidancecited by 4
- 2025Scalable Strategies for Continual Learning with Replaycited by 3
- 2025In-Context Reinforcement Learning via Communicative World Modelscited by 3
23 more
- 2025When Greedy Wins: Emergent Exploitation Bias in Meta-Bandit LLM Trainingcited by 3
- 2026Aligned, Orthogonal or In-conflict: When can we safely optimize Chain-of-Thought?cited by 3
- 2025Offline RLAIF: Piloting VLM Feedback for RL via SFOcited by 2
- 2025Towards Agentic OS: An LLM Agent Framework for Linux Schedulerscited by 2
- 2025Discovering New Theorems via LLMs with In-Context Proof Learning in Leancited by 2
- 2025Towards Provable Emergence of In-Context Reinforcement Learningcited by 2
- 2025Safe In-Context Reinforcement Learningcited by 2
- 2026Reasoning aligns language models to human cognitioncited by 2
- 2026Hierarchical Experimentalist Agentscited by 2
- 2025ViTSP: A Vision Language Models Guided Framework for Solving Large-Scale Traveling Salesman Problemscited by 1
- 2025Prompt-Driven Domain Adaptation for End-to-End Autonomous Driving via In-Context RLcited by 1
- 2025Long-Horizon Model-Based Offline Reinforcement Learning Without Explicit Conservatismcited by 1
- 2026Hallucination-Resistant Security Planning with a Large Language Modelcited by 1
- 2026IntentScore: Intent-Conditioned Action Evaluation for Computer-Use Agentscited by 1
- 2026Transformers Provably Implement In-Context Reinforcement Learning with Policy Improvementcited by 1
- 2026In-Context Reinforcement Learning through Bayesian Fusion of Context and Value Priorcited by 0
- 2026TR-ICRL: Test-Time Rethinking for In-Context Reinforcement Learningcited by 0
- 2026Bridging Natural Language and Microgrid Dynamics: A Context-Aware Simulator and Datasetcited by 0
- 2026When Do We Need LLMs? A Diagnostic for Language-Driven Banditscited by 0
- 2026Latent Q-Barrier Shielding for Safe In-Context Reinforcement Learningcited by 0
- 2026From Weak Data to Strong Policy: Q-Targets Enable Provable In-Context Reinforcement Learningcited by 0
- 2026From Static Policies to Adaptive Priors in Offline Reinforcement Learningcited by 0
- 2026From Solo to Social Learning: Characterizing Recursive Social Improvement in LLMscited by 0
- 2026From Solo to Social Learning: Characterizing Recursive Social Improvement in LLMs29 Sep 2026
- 2026From Static Policies to Adaptive Priors in Offline Reinforcement Learning26 Sep 2026
- 2026From Weak Data to Strong Policy: Q-Targets Enable Provable In-Context Reinforcement Learning24 Sep 2026
- 2026Hierarchical Experimentalist Agents28 Jun 2026
- 2026Latent Q-Barrier Shielding for Safe In-Context Reinforcement Learning24 May 2026
- 2026Transformers Provably Implement In-Context Reinforcement Learning with Policy Improvement7 May 2026
- 2026When Do We Need LLMs? A Diagnostic for Language-Driven Bandits7 Apr 2026
- 2026Bridging Natural Language and Microgrid Dynamics: A Context-Aware Simulator and Dataset7 Apr 2026
- 2026IntentScore: Intent-Conditioned Action Evaluation for Computer-Use Agents6 Apr 2026
- 2026TR-ICRL: Test-Time Rethinking for In-Context Reinforcement Learning1 Apr 2026
- 2026Aligned, Orthogonal or In-conflict: When can we safely optimize Chain-of-Thought?31 Mar 2026
- 2026Improving Efficiency of GPU Kernel Optimization Agents using a Domain-Specific Language and Speed-of-Light Guidance30 Mar 2026
23 more
- 2026Complementary RL: Towards Efficient Experience-Driven Agent Learning18 Mar 2026
- 2026Reasoning aligns language models to human cognition9 Feb 2026
- 2026Hallucination-Resistant Security Planning with a Large Language Model5 Feb 2026
- 2026In-Context Reinforcement Learning through Bayesian Fusion of Context and Value Prior6 Jan 2026
- 2025Long-Horizon Model-Based Offline Reinforcement Learning Without Explicit Conservatism4 Dec 2025
- 2025Prompt-Driven Domain Adaptation for End-to-End Autonomous Driving via In-Context RL16 Nov 2025
- 2025Safe In-Context Reinforcement Learning29 Sep 2025
- 2025When Greedy Wins: Emergent Exploitation Bias in Meta-Bandit LLM Training29 Sep 2025
- 2025ViTSP: A Vision Language Models Guided Framework for Solving Large-Scale Traveling Salesman Problems27 Sep 2025
- 2025Towards Provable Emergence of In-Context Reinforcement Learning22 Sep 2025
- 2025Discovering New Theorems via LLMs with In-Context Proof Learning in Lean16 Sep 2025
- 2025Towards Agentic OS: An LLM Agent Framework for Linux Schedulers1 Sep 2025
- 2025In-Context Reinforcement Learning via Communicative World Models8 Aug 2025
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligence28 Jul 2025
- 2025LLM Economist: Large Population Models and Mechanism Design in Multi-Agent Generative Simulacra21 Jul 2025
- 2025A Survey on Vision-Language-Action Models: An Action Tokenization Perspective2 Jul 2025
- 2025A Survey of Continual Reinforcement Learning27 Jun 2025
- 2025Scalable In-Context Q-Learning2 Jun 2025
- 2025Reward Is Enough: LLMs Are In-Context Reinforcement Learners21 May 2025
- 2025Scalable Strategies for Continual Learning with Replay18 May 2025
- 2025Experience Replay Addresses Loss of Plasticity in Continual Learning25 Mar 2025
- 2025Offline RLAIF: Piloting VLM Feedback for RL via SFO2 Mar 2025
- 2025Yes, Q-learning Helps Offline In-Context RL24 Feb 2025
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligencecited by 155
- 2025LLM Economist: Large Population Models and Mechanism Design in Multi-Agent Generative Simulacracited by 20
- 2026Complementary RL: Towards Efficient Experience-Driven Agent Learningcited by 5
- 2026Improving Efficiency of GPU Kernel Optimization Agents using a Domain-Specific Language and Speed-of-Light Guidancecited by 4
- 2025Towards Agentic OS: An LLM Agent Framework for Linux Schedulerscited by 2
- 2026Hierarchical Experimentalist Agentscited by 2
- 2026IntentScore: Intent-Conditioned Action Evaluation for Computer-Use Agentscited by 1
- 2026From Solo to Social Learning: Characterizing Recursive Social Improvement in LLMscited by 0
- 2026From Solo to Social Learning: Characterizing Recursive Social Improvement in LLMs29 Sep 2026
- 2026Hierarchical Experimentalist Agents28 Jun 2026
- 2026IntentScore: Intent-Conditioned Action Evaluation for Computer-Use Agents6 Apr 2026
- 2026Improving Efficiency of GPU Kernel Optimization Agents using a Domain-Specific Language and Speed-of-Light Guidance30 Mar 2026
- 2026Complementary RL: Towards Efficient Experience-Driven Agent Learning18 Mar 2026
- 2025Towards Agentic OS: An LLM Agent Framework for Linux Schedulers1 Sep 2025
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligence28 Jul 2025
- 2025LLM Economist: Large Population Models and Mechanism Design in Multi-Agent Generative Simulacra21 Jul 2025
- 2025Scalable In-Context Q-Learningcited by 5
- 2025In-Context Reinforcement Learning via Communicative World Modelscited by 3
- 2025In-Context Reinforcement Learning via Communicative World Models8 Aug 2025
- 2025Scalable In-Context Q-Learning2 Jun 2025
- 2025Reward Is Enough: LLMs Are In-Context Reinforcement Learnerscited by 29
- 2025A Survey of Continual Reinforcement Learningcited by 16
- 2025Experience Replay Addresses Loss of Plasticity in Continual Learningcited by 4
- 2025Scalable Strategies for Continual Learning with Replaycited by 3
- 2025When Greedy Wins: Emergent Exploitation Bias in Meta-Bandit LLM Trainingcited by 3
- 2025Discovering New Theorems via LLMs with In-Context Proof Learning in Leancited by 2
- 2025Towards Provable Emergence of In-Context Reinforcement Learningcited by 2
- 2025Safe In-Context Reinforcement Learningcited by 2
- 2026Hallucination-Resistant Security Planning with a Large Language Modelcited by 1
- 2026Transformers Provably Implement In-Context Reinforcement Learning with Policy Improvementcited by 1
- 2026In-Context Reinforcement Learning through Bayesian Fusion of Context and Value Priorcited by 0
- 2026Bridging Natural Language and Microgrid Dynamics: A Context-Aware Simulator and Datasetcited by 0
12 most cited of 15 All 15 (JSON)
- 2026From Weak Data to Strong Policy: Q-Targets Enable Provable In-Context Reinforcement Learning24 Sep 2026
- 2026Latent Q-Barrier Shielding for Safe In-Context Reinforcement Learning24 May 2026
- 2026Transformers Provably Implement In-Context Reinforcement Learning with Policy Improvement7 May 2026
- 2026When Do We Need LLMs? A Diagnostic for Language-Driven Bandits7 Apr 2026
- 2026Bridging Natural Language and Microgrid Dynamics: A Context-Aware Simulator and Dataset7 Apr 2026
- 2026Hallucination-Resistant Security Planning with a Large Language Model5 Feb 2026
- 2026In-Context Reinforcement Learning through Bayesian Fusion of Context and Value Prior6 Jan 2026
- 2025Safe In-Context Reinforcement Learning29 Sep 2025
- 2025When Greedy Wins: Emergent Exploitation Bias in Meta-Bandit LLM Training29 Sep 2025
- 2025Towards Provable Emergence of In-Context Reinforcement Learning22 Sep 2025
- 2025Discovering New Theorems via LLMs with In-Context Proof Learning in Lean16 Sep 2025
- 2025A Survey of Continual Reinforcement Learning27 Jun 2025
12 newest of 15 All 15 (JSON)