Towards Faithful Sentimental Image Captioning via Evidence-Aware Multi-Agent Reasoning
Not on the map. Why?
Abstract (arXiv)
Sentimental Image Captioning (SIC) requires balancing emotional expression with visual fidelity. Existing methods often struggle with this trade-off, leading to hallucinations due to insufficient local grounding and the lack of sentimental verification mechanisms. To address these limitations, we propose SEA-Cap, a Sentiment-Evidence-Aware Multi-Agent System for faithful and evidence-grounded sentimental image captioning. SEA-Cap incorporates a Sentiment Evidence Miner that extracts structured, local affective cues to shift sentiment control from global attributes to verifiable object-level evidence. Leveraging this evidence, our framework orchestrates a collaborative workflow where a Generator, Hallucination Checker, and Arbitrator iteratively refine captions via a shared blackboard. By explicitly auditing generated content against mined visual evidence, SEA-Cap ensures both sentiment accuracy and factual consistency. Extensive experiments on two benchmark datasets demonstrate that SEA-Cap effectively mitigates hallucinations and achieves state-of-the-art performance.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 25 references that are in the map. First posted on arXiv 28 Jul 2026.
Builds on
16 of 25 references.
References · 16
- 2023Segment Anythingcited by 8,234
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
- 2018Object Hallucination in Image Captioningcited by 669
- 2020Say As You Wish: Fine-grained Control of Image Caption Generation with Abstract Scene Graphscited by 87
- 2015SentiCap: Generating Image Descriptions with Sentimentscited by 48
- 2020Length-Controllable Image Captioningcited by 36
- 2023ConZIC: Controllable Zero-shot Image Captioning by Sampling-Based Polishingcited by 33
- 2018SemStyle: Learning to Generate Stylised Image Captions using Unaligned Textcited by 27
- 2024Toward Robust Hyper-Detailed Image Captioning: A Multiagent Approach and Dual Evaluation Metrics for Factuality and Coveragecited by 20
- 2022Controllable Image Captioning via Promptingcited by 15
4 more
- 2024Zero-Shot Strategies for Length-Controllable Summarizationcited by 10
- 2024PositionID: LLMs can Control Lengths, Copy and Paste with Explicit Positional Awarenesscited by 9
- 2024The Power of Many: Multi-Agent Multimodal Models for Cultural Image Captioningcited by 9
- 2024Length Controlled Generation for Black-box LLMscited by 8
Built on by
Not cited yet.