Vela: User Behavior as Supervision Sparks LLM Intelligence
Not on the map. Why?
Abstract (arXiv)
Large language models are increasingly deployed in applications that act on users' long-term behavior histories, from personal assistants to recommendation and advertising systems. These applications demand the user dimension of LLM intelligence: inferring a person's preferences, intent, and likely future actions from weeks to years of behavior data. Yet current models are trained on static text or synthetic data, neither of which captures how user behavior evolves over time. Real-world behavior records, already available at scale on content platforms and in personal-assistant agents, offer a natural supervisory signal. We propose user behavior as supervision and introduce Vela, a framework that converts real user behavior data into trainable tasks and trajectories. From the anonymized behavior records of 100,000 users, Vela generates 100,000 tasks across 91 real-world task templates; difficulty-based filtering and trajectory acceptance criteria retain approximately 75,000 tasks with selected training trajectories. Fine-tuning Qwen3.6-35B-A3B on these trajectories improves performance over the base model by up to 11.5 points on user-related tasks and by an average of 4 points on general benchmarks. Training on more user behavior data further improves user-related performance, and reinforcement learning after fine-tuning outperforms reinforcement learning from the base model by up to 7.7 points. These gains suggest that real-world user behavior is a scalable source of supervision for both user-centered capabilities and the broader intelligence of LLMs.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 37 references that are in the map. First posted on arXiv 10 Oct 2026.
Builds on
22 of 37 references.
References · 22
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2025Group Sequence Policy Optimizationcited by 835
- 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
- 2022Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)cited by 402
- 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 355
- 2022Will we run out of data? Limits of LLM scaling based on human-generated datacited by 195
- 2025Know Me, Respond to Me: Benchmarking LLMs for Dynamic User Profiling and Personalized Responses at Scalecited by 178
- 2024Nemotron-CC: Transforming Common Crawl into a Refined Long-Horizon Pretraining Datasetcited by 160
- 2025Do LLMs Recognize Your Preferences? Evaluating Personalized Preference Following in LLMscited by 148
- 2024User-LLM: Efficient LLM Contextualization with User Embeddingscited by 76
- 2026From Recall to Forgetting: Benchmarking Long-Term Memory for Personalized Agentscited by 36
- 2025OPeRA: A Dataset of Observation, Persona, Rationale, and Action for Evaluating LLMs on Human Online Shopping Behavior Simulationcited by 28
10 more
- 2025Customer-R1: Personalized Simulation of Human Behaviors via RL-based LLM Agent in Online Shoppingcited by 19
- 2026According to Me: Long-Term Personalized Referential Memory QAcited by 14
- 2024RLPF: Reinforcement Learning from Prediction Feedback for User Summarization with LLMscited by 13
- 2025LLM-Auction: Generative Auction towards LLM-Native Advertisingcited by 12
- 2025DEEPER Insight into Your User: Directed Persona Refinement for Dynamic Persona Modelingcited by 10
- 2026CL-bench Life: Can Language Models Learn from Real-Life Context?cited by 9
- 2026LUNAR: Benchmarking Personalized Large Language Models on UNiversal User BehAvioR Logscited by 2
- 2026CORAL: An LLM-Native Harness for Production Recommender Systemscited by 2
- 2026LiveAgentBench: Comprehensive Benchmarking of Agentic Systems Across 104 Real-World Challengescited by 1
- 2026StreamProfileBench: A Benchmark for Fine-Grained User Profile Inference in Real-World Streaming Scenarioscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Subjective Behaviors and Preferences in LLM: Language of Browsing
- 2026LLMs Reading the Rhythms of Daily Life: Aligned Understanding for Behavior Prediction and Generation
- 2026DynamicMem: A Long-Horizon Memory Benchmark in Real-World Settings
- 2025Show or Tell? Modeling the evolution of request-making in Human-LLM conversations
- 2026On the Behavioral Traits of LLM Agents
- 2026Benchmarking LLM Tool-Use in the Wild
- 2026From Profiling to Synthesis: Benchmarking Implicit Behavioral Alignment in Personalized LLM Agents
- 2025To See or To Read: User Behavior Reasoning in Multimodal LLMs