mlsanityData to 7 Oct 2026

How Can Recommendation Feedback Evolve Agent Memory?

arXiv 2609.37544 ↗First posted 29 Sep 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Content-generation agents continuously receive impressions, clicks, conversions, and negative feedback from recommendation systems, providing real-world outcome signals for memory evolution. However, these signals are delayed and noisy, confounded by audience composition, placement, and recommendation policies, and may result from the combined influence of multiple memories, making accurate attribution difficult. Existing methods rely primarily on immediate feedback or semantic retrieval and therefore struggle to reliably translate recommendation outcomes into memory fitness. To address this challenge, we propose TIDE (Trajectory-Informed Directed Memory Evolution), an external memory evolution framework driven by delayed recommendation feedback. We further introduce Memory Evolution Gain (MEG), which measures the utility improvement of evolved memory over a no memory baseline on strictly future tasks. TIDE treats memory as a capacity-constrained population of experiences: temporal and semantic credit assignment estimates contextual fitness, while responsibility credit distributes outcome signals according to the memories referenced during generation. These signals are then used to reinforce, crossover, mutate, or evict memories. On an e-commerce membership marketing content-generation agent, TIDE achieves a +7.75-percentage-point MEG in offline temporal replay and significantly improves both unique click-through rate (UCTR) and activation rate in an online A/B test. On a delayed-label benchmark, TIDE achieves the lowest mean absolute error (MAE) and root mean squared error (RMSE) and the highest MEG among the compared methods, demonstrating its effectiveness.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 34 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

30 of 34 references.

References · 30

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  5. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  6. 2023Let's Verify Step by Stepcited by 3,598
  7. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
  8. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
  9. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 722
  10. 2024From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judgecited by 480
  11. 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Datacited by 323
  12. 2025Dynamic Cheatsheet: Test-Time Learning with Adaptive Memorycited by 146
18 more
  1. 2025Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memorycited by 129
  2. 2025Memp: Exploring Agent Procedural Memorycited by 88
  3. 2025Self-Adapting Language Modelscited by 71
  4. 2025AgentRefine: Enhancing Agent Generalization through Refinement Tuningcited by 51
  5. 2025PosterCraft: Rethinking High-Quality Aesthetic Poster Generation in a Unified Frameworkcited by 37
  6. 2022CREATER: CTR-driven Advertising Text Generation with Controlled Pre-Training and Contrastive Fine-Tuningcited by 16
  7. 2024Self-Evolved Reward Learning for LLMscited by 16
  8. 2025Dynamic and Generalizable Process Reward Modelingcited by 16
  9. 2026Learning Personalized Agents from Human Feedbackcited by 16
  10. 2026MemoryCD: Benchmarking Long-Context User Memory of LLM Agents for Lifelong Cross-Domain Personalizationcited by 15
  11. 2025CTR-Driven Advertising Image Generation with Multimodal Large Language Modelscited by 14
  12. 2026EvoMemBench: Benchmarking Agent Memory from a Self-Evolving Perspectivecited by 14
  13. 2025CTR-Guided Generative Query Suggestion in Conversational Searchcited by 9
  14. 2025CTR-Driven Ad Text Generation via Online Feedback Preference Optimizationcited by 8
  15. 2026PosterOmni: Generalized Artistic Poster Creation via Task Distillation and Unified Reward Feedbackcited by 8
  16. 2024Generative Explore-Exploit: Training-free Optimization of Generative Recommender Systems using LLM Optimizerscited by 7
  17. 2026PosterReward: Unlocking Accurate Evaluation for High-Quality Graphic Design Generationcited by 4
  18. 2026A Better Spur Should Start From Each Objectivecited by 1

Built on by

Not cited yet.