mlsanityData to 7 Oct 2026

MAF: Multimodal Adaptive Few-shot Prompting for Sentiment Analysis with MLLMs

arXiv 2606.15694 ↗First posted 14 Jun 2026cs.MM cs.AI cs.CVcited by 0

On the map: Multimodal LLMs / vision-language models → Multimodal emotion understanding

Abstract (arXiv)

Multimodal large language models (MLLMs) have demonstrated remarkable capabilities in understanding complex multimodal content. However, their performance in sentiment analysis exhibits acute sensitivity to prompt design, rendering static, uniformly applied prompts inherently suboptimal for capturing the nuanced multimodal cues that vary across inputs. To address this limitation, we propose a Multimodal Adaptive Few-Shot Prompting (MAF) framework, which dynamically retrieves and integrates query-relevant demonstrations to elicit the sentiment reasoning capabilities of MLLMs in a context-sensitive manner. MAF constructs a demonstration retrieval module that holistically encodes facial expressions, scene context, and textual semantics, with a lip movement amplitude detection mechanism introduced for accurate speaker identification in multi-person scenarios. Departing from conventional fixed-weight fusion, a lightweight coefficient generation network is trained to output query-conditioned fusion weights in real time, enabling weighted aggregation of multimodal similarity scores to retrieve the top-K most informative demonstrations. Prediction stability is further enhanced through majority voting over multiple candidate outputs generated by the MLLM. Extensive experiments on public benchmark datasets demonstrate that MAF achieves substantial and consistent performance improvements over the corresponding backbone variants and remains competitive with strong multimodal sentiment-analysis baselines.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal emotion understanding, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 24 of its 33 references that are in the map. First posted on arXiv 14 Jun 2026.

Builds on

24 of 33 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Multimodal Large Language Models Meet Multimodal Emotion Recognition and Reasoning: A Survey29 Sep

Other references · 23

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  5. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  6. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  7. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  8. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
  9. 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,096
  10. 2019Latent Retrieval for Weakly Supervised Open Domain Question Answeringcited by 691
  11. 2019Multimodal Transformer for Unaligned Multimodal Language Sequencescited by 637
  12. 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 636
11 more
  1. 2017Tensor Fusion Network for Multimodal Sentiment Analysiscited by 429
  2. 2018Efficient Low-rank Multimodal Fusion with Modality-Specific Factorscited by 268
  3. 2021Learning Modality-Specific Representations with Self-Supervised Multi-Task Learning for Multimodal Sentiment Analysiscited by 179
  4. 2021MMGCN: Multimodal Fusion via Deep Graph Convolution Network for Emotion Recognition in Conversationcited by 99
  5. 2022UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognitioncited by 61
  6. 2022Make Acoustic and Visual Cues Matter: CH-SIMS v2.0 Dataset and AV-Mixup Consistent Modulecited by 43
  7. 2022GA2MIF: Graph and Attention Based Two-Stage Multi-Source Information Fusion for Conversational Emotion Detectioncited by 20
  8. 2023UniSA: Unified Generative Framework for Sentiment Analysiscited by 17
  9. 2025MSE-Adapter: A Lightweight Plugin Endowing LLMs with the Capability to Perform Multimodal Sentiment Analysis and Emotion Recognitioncited by 9
  10. 2023TextMI: Textualize Multimodal Information for Integrating Non-verbal Cues in Pre-trained Language Modelscited by 6
  11. 2025Structured Prompting and LLM Ensembling for Multimodal Conversational Aspect-based Sentiment Analysiscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Multimodal Prompt Optimization: Why Not Leverage Multiple Modalities for MLLMs
  2. 2025An Empirical Study on Configuring In-Context Learning Demonstrations for Unleashing MLLMs' Sentimental Perception Capability
  3. 2024Mixture-of-Prompt-Experts for Multi-modal Semantic Understanding
  4. 2025Multimodal Large Language Models for End-to-End Affective Computing: Benchmarking and Boosting with Generative Knowledge Prompting
  5. 2026MVFA: A Multi-View Text-Guided Multimodal Fusion LLM Adapter for Sentiment Analysis and Emotion Recognition
  6. 2026FewMMBench: A Benchmark for Multimodal Few-Shot Learning
  7. 2026Do We Really Need Multimodal Emotion Language Models Larger Than 1B Parameters?
  8. 2025The Future of MLLM Prompting is Adaptive: A Comprehensive Experimental Evaluation of Prompt Engineering Methods for Robust Multimodal Performance