MemOrb: A Plug-and-Play Verbal-Reinforcement Memory Layer for E-Commerce Customer Service
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Large Language Model-based agents(LLM-based agents) are increasingly deployed in customer service, yet they often forget across sessions, repeat errors, and lack mechanisms for continual self-improvement. This makes them unreliable in dynamic settings where stability and consistency are critical. To better evaluate these properties, we emphasize two indicators: task success rate as a measure of overall effectiveness, and consistency metrics such as Passk to capture reliability across multiple trials. To address the limitations of existing approaches, we propose MemOrb, a lightweight and plug-and-play verbal reinforcement memory layer that distills multi-turn interactions into compact strategy reflections. These reflections are stored in a shared memory bank and retrieved to guide decision-making, without requiring any fine-tuning. Experiments show that MemOrb significantly improves both success rate and stability, achieving up to a 63 percentage-point gain in multi-turn success rate and delivering more consistent performance across repeated trials. Our results demonstrate that structured reflection is a powerful mechanism for enhancing long-term reliability of frozen LLM agents in customer service scenarios.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 13 of its 18 references that are in the map. First posted on arXiv 23 Sep 2025.
Builds on
13 of 18 references.
Closest ancestors · 1
Same direction, newest first
Other references · 12
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 779
- 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 634
- 2025Memory-R1: Enhancing Large Language Model Agents to Manage and Utilize Memories via Reinforcement Learningcited by 237
- 2024A Human-Inspired Reading Agent with Gist Memory of Very Long Contextscited by 146
- 2025From Human Memory to AI Memory: A Survey on Memory Mechanisms in the Era of LLMscited by 124
- 2024Optimus-1: Hybrid Multimodal Memory Empowered Agents Excel in Long-Horizon Taskscited by 84
- 2024The Benefits of a Concise Chain of Thought on Problem-Solving in Large Language Modelscited by 63
- 2025ECom-Bench: Can LLM Agent Resolve Real-World E-commerce Customer Support Issues?cited by 27
- 2023Empowering Working Memory for Large Language Model Agentscited by 18
Built on by
Citing papers per year: 2025: 2; 2026: 5.
7 papers.
- 2026Anatomy of Agentic Memory: Taxonomy and Empirical Analysis of Evaluation and System Limitationscited by 21
- 2026From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanismscited by 21
- 2025AI Meets Brain: Memory Systems from Cognitive Neuroscience to Autonomous Agentscited by 12
- 2026EComStage: Stage-wise and Orientation-specific Benchmarking for Large Language Models in E-commercecited by 4
- 2025ArchMap: Arch-Flattening and Knowledge-Guided Vision Language Model for Tooth Counting and Structured Dental Understandingcited by 2
- 2026SOCIA-EVO: Automated Simulator Construction via Dual-Anchored Bi-Level Optimizationcited by 0
- 2026OVIBench: Benchmarking Online Video Question Answering under Interruptioncited by 0
- 2026OVIBench: Benchmarking Online Video Question Answering under Interruption23 Aug 2026
- 2026From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms7 May 2026
- 2026SOCIA-EVO: Automated Simulator Construction via Dual-Anchored Bi-Level Optimization19 Apr 2026
- 2026Anatomy of Agentic Memory: Taxonomy and Empirical Analysis of Evaluation and System Limitations22 Feb 2026
- 2026EComStage: Stage-wise and Orientation-specific Benchmarking for Large Language Models in E-commerce6 Jan 2026
- 2025AI Meets Brain: Memory Systems from Cognitive Neuroscience to Autonomous Agents29 Dec 2025
- 2025ArchMap: Arch-Flattening and Knowledge-Guided Vision Language Model for Tooth Counting and Structured Dental Understanding18 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2025MindFlow+: A Self-Evolving Agent for E-Commerce Customer Service
- 2026MerchantBench: Benchmarking LLM Agents for Long-Term Coherence in E-Commerce Operations
- 2026Iterating Toward Better Search: A Two-Agent Simulation Framework for Evaluating Agentic Search Architectures in E-Commerce
- 2025MindFlow: Revolutionizing E-commerce Customer Support with Multimodal LLM Agents
- 2026ServeLearnBench: How Well Can Agents Self-Improve from Serving Experience?
- 2025Language Model Agents Under Attack: A Cross Model-Benchmark of Profit-Seeking Behaviors in Customer Service
- 2025Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactions
- 2025Towards Reliable Multi-Agent Systems for Marketing Applications via Reflection, Memory, and Planning