mlsanityData to 14 Oct 2026

FLUID: From Ephemeral IDs to Multimodal Semantic Codes for Industrial-Scale Livestreaming Recommendation

arXiv 2605.21832 ↗First posted 20 May 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Modern recommender systems rely heavily on ID-based collaborative filtering: each item is represented by a unique ID embedding that accumulates collaborative signals from user interactions. Livestreaming recommendation, however, faces a unique challenge in this paradigm: a live room typically broadcasts for only tens of minutes, so its item ID remains poorly learned in a persistent cold-start state and ID-centric ranking models fail to generalize. We present FLUID, the first framework to fully retire the candidate-side item ID from a production-scale livestreaming ranker. FLUID introduces a cross-domain multimodal encoder, jointly trained on short videos and livestreams, to produce discrete hierarchical semantic codes, called LUCID, for content-based item characterization. To adapt the ranker to LUCID, FLUID further employs a staged warmup scheme: it first incorporates cold, slice-level LUCID as an independent token alongside the ID embedding, and then replaces the ID embedding with warm, room-level LUCID before online incremental training. Deployed on our industrial livestreaming recommenders with a cross-platform combined user base of over one billion globally, FLUID delivers significant online gains of +0.55% Quality Watch Duration, +2.05% Cold-Start Room Views, and +0.05% Active Hours.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 47 references that are in the map. First posted on arXiv 20 May 2026.

Builds on

30 of 47 references.

References · 30

  1. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  2. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
  3. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
  4. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
  5. 2018Self-Attentive Sequential Recommendationcited by 1,184
  6. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
  7. 2016Wide & Deep Learning for Recommender Systemscited by 747
  8. 2017DeepFM: A Factorization-Machine based Neural Network for CTR Predictioncited by 676
  9. 2017Deep & Cross Network for Ad Click Predictionscited by 393
  10. 2018Deep Interest Evolution Network for Click-Through Rate Predictioncited by 338
  11. 2024Long-CLIP: Unlocking the Long-Text Capability of CLIPcited by 300
  12. 2024VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Taskscited by 228
18 more
  1. 2024Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendationscited by 188
  2. 2025OneRec: Unifying Retrieve and Rank with Generative Recommender and Iterative Preference Alignmentcited by 173
  3. 2024GME: Improving Universal Multimodal Retrieval by Multimodal LLMscited by 170
  4. 2023Where to Go Next for Recommender Systems? ID- vs. Modality-based Recommender Models Revisitedcited by 124
  5. 2025VLM2Vec-V2: Advancing Multimodal Embedding for Videos, Images, and Visual Documentscited by 116
  6. 2024Wukong: Towards a Scaling Law for Large-Scale Recommendationcited by 74
  7. 2023Better Generalization with Semantic IDs: A Case Study in Ranking for Recommendationscited by 52
  8. 2024NoteLLM-2: Multimodal Large Representation Models for Recommendationcited by 44
  9. 2025MetaEmbed: Scaling Multimodal Retrieval at Test-Time with Flexible Late Interactioncited by 39
  10. 2024Enhancing Taobao Display Advertising with Multimodal Representations: Challenges, Approaches and Insightscited by 23
  11. 2024AlignRec: Aligning and Training in Multimodal Recommendationscited by 21
  12. 2025MoCa: Modality-aware Continual Pre-training Makes Better Bidirectional Multimodal Embeddingscited by 20
  13. 2025Enhancing Embedding Representation Stability in Recommendation Systems with Semantic IDcited by 19
  14. 2023Hiformer: Heterogeneous Feature Interactions Learning with Transformers for Recommender Systemscited by 14
  15. 2024FLAME: Frozen Large Language Models Enable Data-Efficient Language-Image Pre-trainingcited by 12
  16. 2025DAS: Dual-Aligned Semantic IDs Empowered Industrial Recommender Systemcited by 8
  17. 2026Zenith: Scaling up Ranking Models for Billion-scale Livestreaming Recommendationcited by 3
  18. 2026SARM: LLM-Augmented Semantic Anchor for End-to-End Live-Streaming Rankingcited by 3

Built on by

Not cited yet.