mlsanityData to 14 Oct 2026

MemOrb: A Plug-and-Play Verbal-Reinforcement Memory Layer for E-Commerce Customer Service

arXiv 2509.18713 ↗First posted 23 Sep 2025cs.CL cs.AIcited by 7

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Large Language Model-based agents(LLM-based agents) are increasingly deployed in customer service, yet they often forget across sessions, repeat errors, and lack mechanisms for continual self-improvement. This makes them unreliable in dynamic settings where stability and consistency are critical. To better evaluate these properties, we emphasize two indicators: task success rate as a measure of overall effectiveness, and consistency metrics such as Passk to capture reliability across multiple trials. To address the limitations of existing approaches, we propose MemOrb, a lightweight and plug-and-play verbal reinforcement memory layer that distills multi-turn interactions into compact strategy reflections. These reflections are stored in a shared memory bank and retrieved to guide decision-making, without requiring any fine-tuning. Experiments show that MemOrb significantly improves both success rate and stability, achieving up to a 63 percentage-point gain in multi-turn success rate and delivering more consistent performance across repeated trials. Our results demonstrate that structured reflection is a powerful mechanism for enhancing long-term reliability of frozen LLM agents in customer service scenarios.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 13 of its 18 references that are in the map. First posted on arXiv 23 Sep 2025.

Builds on

13 of 18 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains17 Jun

Other references · 12

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  3. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  4. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 779
  5. 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 634
  6. 2025Memory-R1: Enhancing Large Language Model Agents to Manage and Utilize Memories via Reinforcement Learningcited by 237
  7. 2024A Human-Inspired Reading Agent with Gist Memory of Very Long Contextscited by 146
  8. 2025From Human Memory to AI Memory: A Survey on Memory Mechanisms in the Era of LLMscited by 124
  9. 2024Optimus-1: Hybrid Multimodal Memory Empowered Agents Excel in Long-Horizon Taskscited by 84
  10. 2024The Benefits of a Concise Chain of Thought on Problem-Solving in Large Language Modelscited by 63
  11. 2025ECom-Bench: Can LLM Agent Resolve Real-World E-commerce Customer Support Issues?cited by 27
  12. 2023Empowering Working Memory for Large Language Model Agentscited by 18

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 5.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025MindFlow+: A Self-Evolving Agent for E-Commerce Customer Service
  2. 2026MerchantBench: Benchmarking LLM Agents for Long-Term Coherence in E-Commerce Operations
  3. 2026Iterating Toward Better Search: A Two-Agent Simulation Framework for Evaluating Agentic Search Architectures in E-Commerce
  4. 2025MindFlow: Revolutionizing E-commerce Customer Support with Multimodal LLM Agents
  5. 2026ServeLearnBench: How Well Can Agents Self-Improve from Serving Experience?
  6. 2025Language Model Agents Under Attack: A Cross Model-Benchmark of Profit-Seeking Behaviors in Customer Service
  7. 2025Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactions
  8. 2025Towards Reliable Multi-Agent Systems for Marketing Applications via Reflection, Memory, and Planning