M3TR: Temporal Retrieval Enhanced Multi-Modal Micro-video Popularity Prediction
Not on the map. Why?
Abstract (arXiv)
Accurately predicting the popularity of micro-videos is a critical but challenging task, characterized by volatile, `rollercoaster-like' engagement dynamics. Existing methods often fail to capture these complex temporal patterns, leading to inaccurate long-term forecasts. This failure stems from two fundamental limitations: ding172 a superficial understanding of user feedback dynamics, which overlooks the mutually exciting and decaying nature of interactions such as likes, comments, and shares; and~ding173 retrieval mechanisms that rely solely on static content similarity, ignoring the crucial patterns of how a video's popularity evolves over time. To address these limitations, we propose M3TR, a Temporal Retrieval enhanced Multi-Modal framework that uniquely synergizes fine-grained temporal modeling with a novel temporal-aware retrieval process for Micro-video popularity prediction. At its core, M3TR introduces a Mamba-Hawkes Process (MHP) module to explicitly model user feedback as a sequence of self-exciting events, capturing the intricate, long-range dependencies within user interactions (for limitation ding172). This rich temporal representation then powers a temporal-aware retrieval engine that identifies historically relevant videos based on a combined similarity of both their multi-modal content (visual, audio, text) and their popularity trajectories (for limitation ding173). By augmenting the target video's features with this retrieved knowledge, M3TR achieves a comprehensive understanding of prediction. Extensive experiments on two real-world datasets demonstrate the superiority of our framework. M3TR achieves state-of-the-art performance, outperforming previous methods by up to 19.3% in nMSE and showing significant gains in addressing long-term prediction challenges.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 12 of its 44 references that are in the map. First posted on arXiv 23 Nov 2024.
Builds on
12 of 44 references.
References · 12
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2017Billion-scale similarity search with GPUscited by 2,497
- 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,336
- 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 719
- 2021AST: Audio Spectrogram Transformercited by 643
- 2019Multi-Task Attention-Based Semi-Supervised Learning for Medical Image Segmentationcited by 55
- 2023A Content-Driven Micro-Video Recommendation Dataset at Scalecited by 45
- 2019Accelerating Large-Scale Inference with Anisotropic Vector Quantizationcited by 9
- 2020Predicting the Popularity of Micro-videos with Multimodal Variational Encoder-Decoder Frameworkcited by 8
- 2021Multimodal Deep Learning Framework for Image Popularity Prediction on Social Mediacited by 6
- 2014Forecasting Popularity of Videos using Social Mediacited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026MealRec: Multi-granularity Sequential Modeling via Hierarchical Diffusion Models for Micro-Video Recommendation
- 2026Benchmarking Multi-Modal Graph-based Social Media Popularity Prediction
- 2026Preference Flow Matching with Spectral Factorization for Micro-video Recommendation
- 2026LongLive-RAG: A General Retrieval-Augmented Framework for Long Video Generation
- 2025TV-RAG: A Temporal-aware and Semantic Entropy-Weighted Framework for Long Video Retrieval and Understanding
- 2026Predict, Then Retrieve: Cross-Instance Future-State Retrieval from Video Prefixes
- 2025MADTempo: An Interactive System for Multi-Event Temporal Video Retrieval with Query Augmentation
- 2026FlowTime: Towards Continuous Generative Watch Time Prediction via Flow-based Personalized Priors