Listwise Preference Diffusion Optimization for User Behavior Trajectories Prediction
Not on the map. Why?
Abstract (arXiv)
Forecasting multi-step user behavior trajectories requires reasoning over structured preferences across future actions, a challenge overlooked by traditional sequential recommendation. This problem is critical for applications such as personalized commerce and adaptive content delivery, where anticipating a user's complete action sequence enhances both satisfaction and business outcomes. We identify an essential limitation of existing paradigms: their inability to capture global, listwise dependencies among sequence items. To address this, we formulate User Behavior Trajectory Prediction (UBTP) as a new task setting that explicitly models long-term user preferences. We introduce Listwise Preference Diffusion Optimization (LPDO), a diffusion-based training framework that directly optimizes structured preferences over entire item sequences. LPDO incorporates a Plackett-Luce supervision signal and derives a tight variational lower bound aligned with listwise ranking likelihoods, enabling coherent preference generation across denoising steps and overcoming the independent-token assumption of prior diffusion methods. To rigorously evaluate multi-step prediction quality, we propose the task-specific metric Sequential Match (SeqMatch), which measures exact trajectory agreement, and adopt Perplexity (PPL), which assesses probabilistic fidelity. Extensive experiments on real-world user behavior benchmarks demonstrate that LPDO consistently outperforms state-of-the-art baselines, establishing a new benchmark for structured preference learning with diffusion models.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Nov 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026WS-GRPO: Weakly-Supervised Group-Relative Policy Optimization for Rollout-Efficient Reasoningcited by 12
- 2026Generate, Filter, Control, Replay: A Comprehensive Survey of Rollout Strategies for LLM Reinforcement Learningcited by 8
- 2026PruneRAG: Confidence-Guided Query Decomposition Trees for Efficient Retrieval-Augmented Generationcited by 5
- 2026Doctor-RAG: A Failure-Aware Repair Framework for Agentic Retrieval-Augmented Generationcited by 5
- 2026AMPS: Adaptive Modality Preference Steering via Functional Entropycited by 4
- 2026Factorized Latent Reasoning for LLM-based Recommendationcited by 3
- 2026MASS-DPO: Multi-negative Active Sample Selection for Direct Policy Optimizationcited by 1
- 2026Learning to Retrieve Navigable Candidates for Efficient Vision-and-Language Navigationcited by 0
- 2026RRPO: Reference-Relative Policy Optimization with Stratified Conditional Rolloutscited by 0
- 2026AUSO: Action-Level Unified Skill Optimization from Internalization to Utilizationcited by 0
- 2026AUSO: Action-Level Unified Skill Optimization from Internalization to Utilization21 Aug 2026
- 2026RRPO: Reference-Relative Policy Optimization with Stratified Conditional Rollouts20 Jul 2026
- 2026MASS-DPO: Multi-negative Active Sample Selection for Direct Policy Optimization11 May 2026
- 2026Factorized Latent Reasoning for LLM-based Recommendation29 Apr 2026
- 2026Generate, Filter, Control, Replay: A Comprehensive Survey of Rollout Strategies for LLM Reinforcement Learning8 Apr 2026
- 2026Doctor-RAG: A Failure-Aware Repair Framework for Agentic Retrieval-Augmented Generation1 Apr 2026
- 2026WS-GRPO: Weakly-Supervised Group-Relative Policy Optimization for Rollout-Efficient Reasoning19 Feb 2026
- 2026Learning to Retrieve Navigable Candidates for Efficient Vision-and-Language Navigation17 Feb 2026
- 2026AMPS: Adaptive Modality Preference Steering via Functional Entropy13 Feb 2026
- 2026PruneRAG: Confidence-Guided Query Decomposition Trees for Efficient Retrieval-Augmented Generation16 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026From Agnostic to Specific: Latent Preference Diffusion for Multi-Behavior Sequential Recommendation
- 2026PAPA: Online Personalized Active Preference Alignment
- 2024Preference Diffusion for Recommendation
- 2025Towards Better Optimization For Listwise Preference in Diffusion Models
- 2024Regularized Conditional Diffusion Model for Multi-Task Preference Alignment
- 2025Fading to Grow: Growing Preference Ratios via Preference Fading Discrete Diffusion for Recommendation
- 2026LATTE: Forecasting Peer Anchored Preference Trajectories for Personalized LLM Generation
- 2025Continuous-time Discrete-space Diffusion Model for Recommendation