HotComment: A Benchmark for Evaluating Popularity of Online Comments
Not on the map. Why?
Abstract (arXiv)
Online comments play a crucial role in shaping public sentiment and opinion dynamics on social media. However, evaluating their popularity remains challenging, not only because it depends on linguistic quality, originality, and emotional resonance, but also because stylistic preferences vary widely across platforms and user groups, causing the same comment to resonate differently in different communities. In this work, we present HotComment, a multimodal benchmark integrating video and text modalities that comprehensively quantifies popularity from three enhanced aspects: (1) Content Quality, which evaluates semantic similarity with ground-truth human comments and extends quality assessment through four interpretable dimensions; (2) Popularity Prediction, based on trends from models trained on real-world interaction data; and (3) User Behavior Simulation, which models the distribution of platform users and approximates engagement scores through an agent-based framework. Furthermore, we propose StyleCmt, inspired by social ripple effects, where multiple stylistic dimensions align to amplify socially resonant expressions and suppress incongruent ones.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 43 of its 80 references that are in the map. First posted on arXiv 28 Apr 2026.
Builds on
43 of 80 references.
References · 43
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2022Do Androids Laugh at Electric Sheep? Humor "Understanding" Benchmarks from The New Yorker Caption Contestcited by 98
- 2022Transformer Tracking with Cyclic Shifting Window Attentioncited by 75
- 2023Simulating Social Media Using Large Language Models to Evaluate Alternative News Feed Algorithmscited by 64
- 2023Let's Think Outside the Box: Exploring Leap-of-Thought in Large Language Models with Creative Humor Generationcited by 56
- 2023Compact Transformer Tracker with Correlative Masked Modelingcited by 50
- 2025OFFSET: Segmentation-based Focus Shift Revision for Composed Image Retrievalcited by 40
- 2026ReTrack: Evidence-Driven Dual-Stream Directional Anchor Calibration Network for Composed Video Retrievalcited by 39
- 2025M2IV: Towards Efficient and Fine-grained Multimodal In-Context Learning via Representation Engineeringcited by 34
31 more
- 2025Semantic-Aware Logical Reasoning via a Semiotic Frameworkcited by 32
- 2014Can Cascades be Predicted?cited by 31
- 2025Personalized Text Generation with Contrastive Activation Steeringcited by 30
- 2019Popularity Prediction on Social Platforms with Coupled Graph Neural Networkscited by 26
- 2026INTENT: Invariance and Discrimination-aware Noise Mitigation for Robust Composed Image Retrievalcited by 26
- 2025SF2T: Self-supervised Fragment Finetuning of Video-LLMs for Fine-Grained Understandingcited by 25
- 2026Logical Phase Transitions: Understanding Collapse in LLM Logical Reasoningcited by 24
- 2022ExPUNations: Augmenting Puns with Keywords and Explanationscited by 21
- 2026HINT: Composed Image Retrieval with Dual-path Compositional Contextualized Networkcited by 18
- 2024Autogenic Language Embedding for Coherent Point Trackingcited by 17
- 2025LoRA-Mixer: Coordinate Modular LoRA Experts Through Serial Attention Routingcited by 16
- 2018LiveBot: Generating Live Video Comments Based on Visual and Textual Contextscited by 14
- 2025MVP: Winning Solution to SMP Challenge 2025 Video Trackcited by 14
- 2026Coupling Macro Dynamics and Micro States for Long-Horizon Social Simulationcited by 14
- 2024Can Pre-trained Language Models Understand Chinese Humor?cited by 13
- 2026TEMA: Anchor the Image, Follow the Text for Multi-Modification Composed Image Retrievalcited by 13
- 2015Measuring Emotional Contagion in Social Mediacited by 10
- 2025Efficient LLaMA-3.2-Vision by Trimming Cross-attended Visual Featurescited by 10
- 2026IntervenSim: Intervention-Aware Social Network Simulation for Opinion Dynamicscited by 10
- 2019Automatic Generation of Personalized Comment Based on User Profilecited by 9
- 2025LoRA-MGPO: Mitigating Double Descent in Low-Rank Adaptation via Momentum-Guided Perturbation Optimizationcited by 9
- 2023ViCo: Engaging Video Comment Generation with Human Preference Rewardscited by 8
- 2024PopALM: Popularity-Aligned Language Models for Social Media Trendy Response Predictioncited by 8
- 2025Can LLMs Simulate Social Media Engagement? A Study on Action-Guided Response Generationcited by 8
- 2018Automatic Article Commenting: the Task and Datasetcited by 7
- 2024HOTVCOM: Generating Buzzworthy Comments for Videoscited by 7
- 2023Knowledge Enhanced Model for Live Video Comment Generationcited by 6
- 2020Top Comment or Flop Comment? Predicting and Explaining User Engagement in Online News Discussionscited by 5
- 2024Augmenting emotion features in irony detection with Large language modelingcited by 5
- 2025GODBench: A Benchmark for Multimodal Large Language Models in Video Comment Artcited by 5
- 2025SMTPD: A New Benchmark for Temporal Prediction of Social Media Popularitycited by 4
Built on by
Citing papers per year: 2026: 3.
3 papers.