RA-CoA: Training-free Fashion Image Captioning via Retrieval-Augmented Chain-of-Attributes
On the map: Retrieval-augmented generation → Multimodal RAG
Abstract (arXiv)
Fashion Image Captioning (FIC) plays a vital role in enhancing user experience and product search in e-commerce platforms. Unlike natural scene image captioning, FIC requires fine-grained visual reasoning and knowledge of domain-specific terminology to capture subtle attributes such as neckline and closure types, graphic patterns, and dress silhouettes. Moreover, as fashion inventories evolve rapidly with new trends, styles, and frequently emerging vocabulary, developing training-free captioning solution becomes essential for scalability and real-world adaptability. Instruction-tuned vision-language models (VLMs) offer a promising solution to fashion image captioning dueto their strong zero-shot capabilities and natural language fluency. However, these general-purpose models often lack attribute-level coverage and precision, and tend to hallucinate or misidentify fine-grained fashion details, making them less suitable for high-fidelity applications like product cataloging or personalized recommendations. To address this, we propose RA-CoA (Retrieval-Augmented Chain-of-Attributes), a novel, training-free framework that disentangles fashion image captioning into two interpretable stages: (i) retrieval of relevant attribute sets from a product knowledge base, and (ii) attribute-level reasoning to generate the final caption. RA-CoA is a model-agnostic approach that works with frozen VLMs to improve fine-grained attribute precision in product captions without the need for fine-tuning. Extensive evaluations across diverse VLM model families under different prompting paradigms demonstrate that RA-CoA significantly improves caption quality, achieving an average gain of 26.3% METEOR score over zero-shot captioning. We make our code publicly available.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal RAG, one of 15 directions in Retrieval-augmented generation. Builds on 35 of its 48 references that are in the map. First posted on arXiv 12 Sep 2026.
Builds on
35 of 48 references.
Closest ancestors · 3
Same direction, newest first
- 2024Understanding Retrieval Robustness for Retrieval-Augmented Image Captioning4 Jun
- 2023EVCap: Retrieval-Augmented Image Captioning with External Visual-Name Memory for Open-World Comprehension27 Nov
- 2023Retrieval-augmented Image Captioning16 Feb
Other references · 32
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,656
20 more
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2023mPLUG-Owl: Modularization Empowers Large Language Models with Multimodalitycited by 1,040
- 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 410
- 2024The Faiss librarycited by 376
- 2024TinyLLaVA: A Framework of Small-scale Large Multimodal Modelscited by 164
- 2017Automatic Spatially-aware Fashion Concept Discoverycited by 134
- 2022SmallCap: Lightweight Image Captioning Prompted with Retrieval Augmentationcited by 82
- 2021Kaleido-BERT: Vision-Language Pre-training on Fashion Domaincited by 67
- 2018Fashion-Gen: The Generative Fashion Dataset and Challengecited by 65
- 2025Grounded Chain-of-Thought for Multimodal Large Language Modelscited by 59
- 2020FashionBERT: Text and Image Matching with Adaptive Loss for Cross-modal Retrievalcited by 55
- 2020Fashion Captioning: Towards Generating Accurate Descriptions with Semantic Rewardscited by 38
- 2023FAME-ViL: Multi-Tasking Vision-Language Model for Heterogeneous Fashion Taskscited by 38
- 2023Improving Automatic VQA Evaluation Using Large Language Modelscited by 37
- 2024MeaCap: Memory-Augmented Zero-shot Image Captioningcited by 35
- 2022FashionViL: Fashion-Focused Vision-and-Language Representation Learningcited by 32
- 2024UniFashion: A Unified Vision-Language Model for Multimodal Fashion Retrieval and Generationcited by 17
- 2025Visual RAG: Expanding MLLM visual knowledge without fine-tuningcited by 11
- 2024Memorization in In-Context Learningcited by 6
- 2024Towards the Effect of Examples on In-Context Learning: A Theoretical Case Studycited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025FACap: A Large-scale Fashion Dataset for Fine-grained Composed Image Retrieval
- 2026FashionMV: Product-Level Composed Image Retrieval with Multi-View Fashion Data
- 2025From Pixels to Posts: Retrieval-Augmented Fashion Captioning and Hashtag Generation
- 2026Exploring Multi-Modal Large Language Models and Two-Stage Fine-Tuning for Fashion Image Retrieval
- 2024Decoding Style: Efficient Fine-Tuning of LLMs for Image-Guided Outfit Recommendation with Preference
- 2026Fashion Florence: Fine-Tuning Florence-2 for Structured Fashion Attribute Extraction
- 2026Zero-Shot Product Attribute Labeling with Vision-Language Models: A Three-Tier Evaluation Framework
- 2024FashionFAE: Fine-grained Attributes Enhanced Fashion Vision-Language Pre-training