mlsanityData to 14 Oct 2026

UserGPT Technical Report

arXiv 2605.08766 ↗First posted 9 May 2026cs.IR cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Personalized user understanding from large-scale digital traces remains a fundamental challenge. Traditional user profiling methods rely on discriminative models and manual feature engineering to predict discrete attributes, often producing fragmented and logically inconsistent profiles that generalize poorly to long-tail behaviors. In this work, we study a generative paradigm in which large language models (LLMs) summarize long and noisy behavioral histories into coherent narratives that capture nuanced user evolution. Our experiments show that even strong LLMs remain limited in complex and implicit personalization reasoning. We propose UserGPT, a framework for improving LLM-based persona understanding through both attribute generation and summary generation. To address the scarcity of real-world behavioral data, we develop a User Behavior Simulation Engine that produces realistic and complex user trajectories. We further introduce a Data-Centric Semantization module that transforms heterogeneous behavioral logs into structured and semantically coherent inputs, reducing noise and sparsity. On top of this pipeline, we design a curriculum-driven post-training strategy that combines multi-stage Supervised Fine-Tuning (SFT) with Dual-Filter Group Relative Policy Optimization (DF-GRPO) to strengthen reasoning over long behavioral histories. We also construct HPR-Bench, a benchmark for holistic persona reasoning derived from simulated data. On HPR-Bench, UserGPT achieves an Avg@10 score of 0.7325 on tag prediction and an AccEx score of 0.7528 on summary generation, while compressing behavioral records by up to 97.9% with critical information preserved. These results demonstrate the effectiveness of UserGPT for holistic persona reasoning and personalized user-agent interaction.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 43 references that are in the map. First posted on arXiv 9 May 2026.

Builds on

33 of 43 references.

References · 33

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  5. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  6. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  7. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  8. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 815
  9. 2023C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Modelscited by 708
  10. 2026Kimi K2.5: Visual Agentic Intelligencecited by 501
  11. 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 417
  12. 2024Large Language Models Can Learn Temporal Reasoningcited by 111
21 more
  1. 2025Reinforcement Learning Optimization for Large-Scale Learning: An Efficient and User-Friendly Scaling Librarycited by 101
  2. 2024Test of Time: A Benchmark for Evaluating LLMs on Temporal Reasoningcited by 88
  3. 2019Investigating Prior Knowledge for Challenging Chinese Machine Reading Comprehensioncited by 81
  4. 2025SocioVerse: A World Model for Social Simulation Powered by LLM Agents and A Pool of 10 Million Real-World Userscited by 55
  5. 2025VitaBench: Benchmarking LLM Agents with Versatile Interactive Tasks in Real-world Applicationscited by 53
  6. 2024Let's Learn Step by Step: Enhancing In-Context Learning Ability with Curriculum Learningcited by 47
  7. 2025RL Tango: Reinforcing Generator and Verifier Together for Language Reasoningcited by 40
  8. 2025From 1,000,000 Users to Every User: Scaling Up Personalized Preference for User-level Alignmentcited by 30
  9. 2023Knowledge Enhancement for Contrastive Multi-Behavior Recommendationcited by 16
  10. 2024Lost in the Middle, and In-Between: Enhancing Language Models' Ability to Reason Over Long Contexts in Multi-Hop QAcited by 13
  11. 2026LifeSim: Long-Horizon User Life Simulator for Personalized Assistant Evaluationcited by 11
  12. 2025ChineseEcomQA: A Scalable E-commerce Concept Evaluation Benchmark for Large Language Modelscited by 9
  13. 2025You Are What You Bought: Generating Customer Personas for E-commerce Applicationscited by 7
  14. 2021Empowering General-purpose User Representation with Full-life Cycle Behavior Modelingcited by 6
  15. 2025Towards Explainable Temporal User Profiling with LLMscited by 6
  16. 2025Evaluating Podcast Recommendations with Profile-Aware LLM-as-a-Judgecited by 6
  17. 2024Prompt Tuning as User Inherent Profile Inference Machinecited by 5
  18. 2025User Profile with Large Language Models: Construction, Updating, and Benchmarkingcited by 5
  19. 2026ProductResearch: Training E-Commerce Deep Research Agents via Multi-Agent Synthetic Trajectory Distillationcited by 3
  20. 2025Conf-Profile: A Confidence-Driven Reasoning Paradigm for Label-Free User Profilingcited by 2
  21. 2025AMAP Agentic Planning Technical Reportcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Behaviorally Grounded User Profiles from the Wild for Personalized Alignment and Multi-Perspective Reasoning
  2. 2026PersonaTrace: Synthesizing Realistic Digital Footprints with LLM Agents
  3. 2025PersonaFeedback: A Large-scale Human-annotated Benchmark For Personalization
  4. 2025RPM: Reasoning-Level Personalization for Black-Box Large Language Models
  5. 2025DEEPER Insight into Your User: Directed Persona Refinement for Dynamic Persona Modeling
  6. 2024User-LLM: Efficient LLM Contextualization with User Embeddings
  7. 2025TWICE: Modeling the Temporal Evolution of Personalized User Behavior via Event-Driven Agents
  8. 2026Synthetic Interaction Data for Scalable Personalization in Large Language Models