mlsanityData to 7 Oct 2026

PEARL: Self-Evolving Assistant for Time Management with Reinforcement Learning

arXiv 2601.11957 ↗First posted 17 Jan 2026cs.CLcited by 3

On the map: Synthetic data and self-improvement for LLMs → Self-evolving LLM agents

Abstract (arXiv)

Overlapping calendar invitations force busy professionals to repeatedly decide which meetings to attend, reschedule, or decline. We refer to this preference-driven decision process as calendar conflict resolution. Automating this decision process is crucial yet challenging. Scheduling logistics can drain hours, and human delegation often fails at scale, which motivates us to ask: Can we trust large language models (LLMs) or language agents to manage time? To enable a systematic study of this question, we introduce CalConflictBench, a benchmark for long-horizon calendar conflict resolution. In CalConflictBench, conflicts are presented to agents round-by-round over a calendar year, requiring them to infer and adapt to user preferences progressively. Our experiments show that current LLM agents perform poorly with high error rates, e.g., Qwen-3-30B-Think has an average error rate of 35%. To address this gap, we propose PEARL, a reinforcement-learning framework that (i) augments the language agent with an external preference memory that stores and updates inferred strategies (e.g., attendee priorities, topic importance, time/location preferences), and (ii) optimizes the agent with round-wise rewards that directly supervise decision correctness, ranking quality, and memory usage across rounds. Experiments on CalConflictBench show that PEARL achieves an error reduction rate of 0.76 and a 55% improvement in average error rate compared to the strongest baseline.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Self-evolving LLM agents, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 17 of its 44 references that are in the map. First posted on arXiv 17 Jan 2026.

Builds on

17 of 44 references.

References · 17

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  4. 2020Learning to summarize from human feedbackcited by 2,562
  5. 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
  6. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
  7. 2024Executable Code Actions Elicit Better LLM Agentscited by 537
  8. 2020Curriculum Learning for Reinforcement Learning Domains: A Framework and Surveycited by 350
  9. 2024Self-Play Preference Optimization for Language Model Alignmentcited by 228
  10. 2025Where LLM Agents Fail and How They can Learn From Failurescited by 118
  11. 2024Learning Planning-based Reasoning by Trajectories Collection and Process Reward Synthesizingcited by 49
  12. 2025METAL: A Multi-Agent Framework for Chart Generation with Test-Time Scalingcited by 33
5 more
  1. 2024Thought of Search: Planning with Language Models Through The Lens of Efficiencycited by 32
  2. 2017Calendar.help: Designing a Workflow-Based Scheduling Agent with Humans in the Loopcited by 26
  3. 2024Interactive and Expressive Code-Augmented Planning with Large Language Modelscited by 6
  4. 2024Control Large Language Models via Divide and Conquercited by 5
  5. 2025EchoFoley: Event-Centric Hierarchical Control for Video Grounded Creative Sound Generationcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Temporal Preferences in Language Models for Long-Horizon Assistance
  2. 2025EvoMem: Improving Multi-Agent Planning with Dual-Evolving Memory
  3. 2025Memory-T1: Reinforcement Learning for Temporal Reasoning in Multi-session Agents
  4. 2025Conversational Planning for Personal Plans
  5. 2026Ask Now, Use Later: Benchmarking the Proactivity Gap in Long-Lived LLM Agents
  6. 2026MAESTRO: Adapting GUIs and Guiding Navigation with User Preferences in Conversational Agents with GUIs ↗
  7. 2025ScheduleMe: Multi-Agent Calendar Assistant
  8. 2025Preference-Aware Memory Update for Long-Term LLM Agents