mlsanityData to 14 Oct 2026

Navigating User Behavior toward Personalized Multimodal Generation

arXiv 2606.24196 ↗First posted 23 Jun 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Modern AIGC pipelines deliver high-fidelity images and videos but presuppose a well-formed creation instruction, while end users rarely articulate visual details, leaving generators misaligned with user demand. We study personalized content generation, which turns a user's interaction history into an executable instruction for downstream synthesis, and identify two obstacles: behavior must be encoded in a form legible to language reasoning, and the model must acquire instruction-writing skill absent from both pretraining and behavior data. We propose NaviGen, which represents each item with a dual identifier coupling a collaborative code and a textual code as a behavioral substrate and a semantic bridge in one token stream. On this representation, a two-stage SFT+RL pipeline first distills preference reasoning and instruction writing from evolutionarily searched supervision, then aligns generation with user intent through hierarchical and self-consistent rewards. Experiments across product, game, and short-video domains show that NaviGen improves personalized image and video generation, strengthens next-item prediction, and yields more specific, relevant, and visually generatable instructions. Our code is released at: https://github.com/iLearn-Lab/NaviGen.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 41 references that are in the map. First posted on arXiv 23 Jun 2026.

Builds on

20 of 41 references.

References · 20

  1. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  2. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  3. 2018Self-Attentive Sequential Recommendationcited by 1,184
  4. 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,139
  5. 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 249
  6. 2023Adapting Large Language Models by Integrating Collaborative Semantics for Recommendationcited by 179
  7. 2025OneRec: Unifying Retrieve and Rank with Generative Recommender and Iterative Preference Alignmentcited by 173
  8. 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
  9. 2023Representation Learning with Large Language Models for Recommendationcited by 155
  10. 2025Multi-Agent Collaboration via Evolving Orchestrationcited by 108
  11. 2024Aligning LLM Agents by Learning Latent Preference from User Editscited by 69
  12. 2025UniCTokens: Boosting Personalized Understanding and Generation via Unified Concept Tokenscited by 56
8 more
  1. 2024Harnessing Multimodal Large Language Models for Multimodal Sequential Recommendationcited by 33
  2. 2025Content-Rich AIGC Video Quality Assessment via Intricate Text Alignment and Motion-Aware Consistencycited by 12
  3. 2025Aligning LLMs by Predicting Preferences from User Writing Samplescited by 11
  4. 2025RAGAR: Retrieval Augmented Personalized Image Generation Guided by Recommendationcited by 8
  5. 2024Symmetric Graph Contrastive Learning against Noisy Views for Recommendationcited by 7
  6. 2024Efficient and Effective Adaptation of Multimodal Foundation Models in Sequential Recommendationcited by 7
  7. 2024Exploring the Individuality and Collectivity of Intents behind Interactions for Graph Collaborative Filteringcited by 4
  8. 2024MoRE: A Mixture of Reflectors Framework for Large Language Model-Based Sequential Recommendationcited by 4

Built on by

Not cited yet.