mlsanityData to 7 Oct 2026

PRIME: Training Free Proactive Reasoning via Iterative Memory Evolution for User-Centric Agent

arXiv 2604.07645 ↗First posted 8 Apr 2026cs.AIcited by 2

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

The development of autonomous tool-use agents for complex, long-horizon tasks in collaboration with human users has become the frontier of agentic research. During multi-turn Human-AI interactions, the dynamic and uncertain nature of user demands poses a significant challenge; agents must not only invoke tools but also iteratively refine their understanding of user intent through effective communication. While recent advances in reinforcement learning offer a path to more capable tool-use agents, existing approaches require expensive training costs and struggle with turn-level credit assignment across extended interaction horizons. To this end, we introduce PRIME (Proactive Reasoning via Iterative Memory Evolution), a gradient-free learning framework that enables continuous agent evolvement through explicit experience accumulation rather than expensive parameter optimization. PRIME distills multi-turn interaction trajectories into structured, human-readable experiences organized across three semantic zones: successful strategies, failure patterns, and user preferences. These experiences evolve through meta-level operations and guide future agent behavior via retrieval-augmented generation. Our experiments across several diverse user-centric environments demonstrate that PRIME achieves competitive performance with gradient-based methods while offering cost-efficiency and interpretability. Together, PRIME presents a practical paradigm for building proactive, collaborative agents that learn from Human-AI interaction without the computational burden of gradient-based training.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 25 of its 33 references that are in the map. First posted on arXiv 8 Apr 2026.

Builds on

25 of 33 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Training Proactive and Personalized LLM Agents4 Nov
  2. 2025UserBench: An Interactive Gym Environment for User-Centric Agents29 Jul
  3. 2024Proactive Agent: Shifting LLM Agents from Reactive Responses to Active Assistance16 Oct
  4. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains17 Jun

Other references · 21

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2017Proximal Policy Optimization Algorithmscited by 14,441
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  4. 2025Qwen3 Technical Reportcited by 8,195
  5. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  6. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  7. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
  8. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
  9. 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,276
  10. 2024Qwen2.5-Coder Technical Reportcited by 1,151
  11. 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
  12. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
9 more
  1. 2025Group-in-Group Policy Optimization for LLM Agent Trainingcited by 442
  2. 2025ToolRL: Reward is All Tool Learning Needscited by 342
  3. 2025MemAgent: Reshaping Long-Context LLM with Multi-Conv RL-based Memory Agentcited by 235
  4. 2025CollabLLM: From Passive Responders to Active Collaboratorscited by 117
  5. 2025SWEET-RL: Training Multi-Turn LLM Agents on Collaborative Reasoning Taskscited by 108
  6. 2025Reinforcement Learning for Long-Horizon Interactive LLM Agentscited by 103
  7. 2025RLVMR: Reinforcement Learning with Verifiable Meta-Reasoning Rewards for Robust Long-Horizon Agentscited by 56
  8. 2025Turn-PPO: Turn-Level Advantage Estimation with PPO for Improved Multi-Turn RL in Agentic LLMscited by 28
  9. 2025UserRL: Training Interactive User-Centric Agent via Reinforcement Learningcited by 27

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025PRIME: Planning and Retrieval-Integrated Memory for Enhanced Reasoning
  2. 2026PRIME: Policy-Reinforced Iterative Multi-agent Execution for Algorithmic Reasoning in Large Language Models
  3. 2026SAM: State-Adaptive Memory for Long-Horizon Reasoning Agent
  4. 2026SEARL: Joint Optimization of Policy and Tool Graph Memory for Self-Evolving Agents
  5. 2026Pushing Forward Pareto Frontiers of Proactive Agents with Behavioral Agentic Optimization
  6. 2026ProactiveVLA: Augmenting Embodied Memory through Proactive Environment Exploration ↗
  7. 2026MetaEvo: A Meta-Optimization Framework for Experience-Driven Agent Evolution
  8. 2025AlphaApollo: A System for Deep Agentic Reasoning