A Multimodal Analysis of Influencer Content on Twitter
Not on the map. Why?
Abstract (arXiv)
Influencer marketing involves a wide range of strategies in which brands collaborate with popular content creators (i.e., influencers) to leverage their reach, trust, and impact on their audience to promote and endorse products or services. Because followers of influencers are more likely to buy a product after receiving an authentic product endorsement rather than an explicit direct product promotion, the line between personal opinions and commercial content promotion is frequently blurred. This makes automatic detection of regulatory compliance breaches related to influencer advertising (e.g., misleading advertising or hidden sponsorships) particularly difficult. In this work, we (1) introduce a new Twitter (now X) dataset consisting of 15,998 influencer posts mapped into commercial and non-commercial categories for assisting in the automatic detection of commercial influencer content; (2) experiment with an extensive set of predictive models that combine text and visual information showing that our proposed cross-attention approach outperforms state-of-the-art multimodal models; and (3) conduct a thorough analysis of strengths and limitations of our models. We show that multimodal modeling is useful for identifying commercial posts, reducing the amount of false positives, and capturing relevant context that aids in the discovery of undisclosed commercial posts.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 27 of its 76 references that are in the map. First posted on arXiv 6 Sep 2023.
Builds on
27 of 76 references.
References · 27
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
- 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,222
- 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,218
- 2019LXMERT: Learning Cross-Modality Encoder Representations from Transformerscited by 1,553
15 more
- 2017Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answeringcited by 1,312
- 2021ViLT: Vision-and-Language Transformer Without Convolution or Region Supervisioncited by 1,230
- 2019Unified Vision-Language Pre-Training for Image Captioning and VQAcited by 494
- 2020BERTweet: A pre-trained language model for English Tweetscited by 346
- 2019Supervised Multimodal Bitransformers for Classifying Images and Textcited by 130
- 2020Does my multimodal model learn cross-modal interactions? It's harder to tell than you might think!cited by 62
- 2022Automatic Identification and Classification of Bragging in Social Mediacited by 12
- 2020Cross-Media Keyphrase Prediction: A Unified Framework with Multi-Modality Multi-Head Attention and Image Wordingscited by 11
- 2021Analyzing Online Political Advertisementscited by 11
- 2018An Empirical Study of Affiliate Marketing Disclosures on YouTube and Pinterestcited by 10
- 2021Point-of-Interest Type Prediction using Text and Imagescited by 10
- 2020Characterising and Detecting Sponsored Influencer Posts on Instagramcited by 7
- 2022Combining Humor and Sarcasm for Improving Political Parody Detectioncited by 6
- 2017Algorithms for Online Influencer Marketingcited by 5
- 2020Point-of-Interest Type Inference from Social Media Textcited by 5
Built on by
Citing papers per year: 2023: 1; 2024: 1.
2 papers.