mlsanityData to 14 Oct 2026

Vision-Language Pre-Training for Multimodal Aspect-Based Sentiment Analysis

arXiv 2204.07955 ↗First posted 17 Apr 2022cs.CV cs.CL cs.MMcited by 21

On the map: Multimodal LLMs / vision-language models → VLM benchmarks and visual reasoning

Abstract (arXiv)

As an important task in sentiment analysis, Multimodal Aspect-Based Sentiment Analysis (MABSA) has attracted increasing attention in recent years. However, previous approaches either (i) use separately pre-trained visual and textual models, which ignore the crossmodal alignment or (ii) use vision-language models pre-trained with general pre-training tasks, which are inadequate to identify finegrained aspects, opinions, and their alignments across modalities. To tackle these limitations, we propose a task-specific Vision-Language Pre-training framework for MABSA (VLPMABSA), which is a unified multimodal encoder-decoder architecture for all the pretraining and downstream tasks. We further design three types of task-specific pre-training tasks from the language, vision, and multimodal modalities, respectively. Experimental results show that our approach generally outperforms the state-of-the-art approaches on three MABSA subtasks. Further analysis demonstrates the effectiveness of each pretraining task. The source code is publicly released at https://github.com/NUSTM/VLP-MABSA.

Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Placed in VLM benchmarks and visual reasoning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 13 of its 40 references that are in the map. First posted on arXiv 17 Apr 2022.

Builds on

13 of 40 references.

References · 13

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  3. 2017Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answeringcited by 1,312
  4. 2020Towards Learning a Generic Agent for Vision-and-Language Navigation via Pre-trainingcited by 231
  5. 2020ERNIE-ViL: Knowledge Enhanced Vision-Language Representations Through Scene Graphcited by 211
  6. 2021A Unified Generative Framework for Aspect-Based Sentiment Analysiscited by 97
  7. 2018A Unified Model for Opinion Target Extraction and Target Sentiment Predictioncited by 56
  8. 2019An Interactive Multi-Task Learning Network for End-to-End Aspect-Based Sentiment Analysiscited by 52
  9. 2019Open-Domain Targeted Sentiment Analysis via Span-Based Extraction and Classificationcited by 50
  10. 2021Exploiting BERT For Multimodal Target Sentiment Classification Through Input Space Translationcited by 41
  11. 2021RpBERT: A Text-image Relation Propagation-based BERT Model for Multimodal NERcited by 37
  12. 2014DeepSentiBank: Visual Sentiment Concept Classification with Deep Convolutional Neural Networkscited by 24
1 more
  1. 2021KM-BART: Knowledge Enhanced Multimodal BART for Visual Commonsense Generationcited by 19

Built on by

Cited by year

Citing papers per year: 2022: 3; 2023: 4; 2024: 6; 2025: 8.

21 papers.

Sort:

By area:

  1. 2023Large-scale Multi-Modal Pre-trained Models: A Comprehensive Surveycited by 153
  2. 2023All in One: Multi-task Prompting for Graph Neural Networkscited by 148
  3. 2023MM-BigBench: Evaluating Multimodal Models on Multimodal Content Comprehension Taskscited by 18
  4. 2024WisdoM: Improving Multimodal Sentiment Analysis by Fusing Contextual World Knowledgecited by 16
  5. 2024Large Language Models Meet Text-Centric Multimodal Sentiment Analysis: A Surveycited by 16
  6. 2024PanoSent: A Panoptic Sextuple Extraction Benchmark for Multimodal Conversational Aspect-based Sentiment Analysiscited by 13
  7. 2024Recent Advances in Multimodal Affective Computing: An NLP Perspectivecited by 13
  8. 2022Few-shot Multimodal Sentiment Analysis based on Multimodal Probabilistic Fusion Promptscited by 9
  9. 2025Provoking Multi-modal Few-Shot LVLM via Exploration-Exploitation In-Context Learningcited by 7
  10. 2025Exploring Cognitive and Aesthetic Causality for Multimodal Aspect-Based Sentiment Analysiscited by 6
  11. 2025An Empirical Study on Configuring In-Context Learning Demonstrations for Unleashing MLLMs' Sentimental Perception Capabilitycited by 4
  12. 2024RNG: Reducing Multi-level Noise and Multi-grained Semantic Gap for Joint Multimodal Aspect-Sentiment Analysiscited by 3
9 more
  1. 2022Target-oriented Sentiment Classification with Sequential Cross-modal Semantic Graphcited by 2
  2. 2022TCAB: A Large-Scale Text Classification Attack Benchmarkcited by 2
  3. 2023RethinkingTMSC: An Empirical Study for Target-Oriented Multimodal Sentiment Classificationcited by 2
  4. 2025Enhanced Multimodal Aspect-Based Sentiment Analysis by LLM-Generated Rationalescited by 2
  5. 2025AdaptiSent: Context-Aware Adaptive Attention for Multimodal Aspect-Based Sentiment Analysiscited by 1
  6. 2024DualKanbaFormer: An Efficient Selective Sparse Framework for Multimodal Aspect-based Sentiment Analysiscited by 0
  7. 2025Resource-Limited Joint Multimodal Sentiment Reasoning and Classification via Chain-of-Thought Enhancement and Distillationcited by 0
  8. 2025GateMABSA: Aspect-Image Gated Fusion for Multimodal Aspect-based Sentiment Analysiscited by 0
  9. 2025Semantic-Preserving Cross-Style Visual Reasoning for Robust Multi-Modal Understanding in Large Vision-Language Modelscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Explainable Multimodal Aspect-Based Sentiment Analysis with Dependency-guided Large Language Model
  2. 2026Explicit Representation Alignment for Multimodal Sentiment Analysis
  3. 2025Multimodal LLMs See Sentiment
  4. 2024Evaluating Zero-Shot Multilingual Aspect-Based Sentiment Analysis with Large Language Models
  5. 2024Utilizing Large Language Models for Event Deconstruction to Enhance Multimodal Aspect-Based Sentiment Analysis
  6. 2024MOSABench: Multi-Object Sentiment Analysis Benchmark for Evaluating Multimodal Large Language Models Understanding of Complex Image
  7. 2023A Survey of Vision-Language Pre-training from the Lens of Multimodal Machine Translation
  8. 2026Large-Scale Aspect-Based Sentiment Analysis with Reasoning-Infused LLMs