Neural Fashion Image Captioning : Accounting for Data Diversity
Not on the map. Why?
Abstract (arXiv)
Image captioning has increasingly large domains of application, and fashion is not an exception. Having automatic item descriptions is of great interest for fashion web platforms, sometimes hosting hundreds of thousands of images. This paper is one of the first to tackle image captioning for fashion images. To address dataset diversity issues, we introduced the InFashAIv1 dataset containing almost 16.000 African fashion item images with their titles, prices, and general descriptions. We also used the well-known DeepFashion dataset in addition to InFashAIv1. Captions are generated using the Show and Tell model made of CNN encoder and RNN Decoder. We showed that jointly training the model on both datasets improves captions quality for African style fashion images, suggesting a transfer learning from Western style data. The InFashAIv1 dataset is released on Github to encourage works with more diversity inclusion.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 12 of its 26 references that are in the map. First posted on arXiv 23 Jun 2021.
Builds on
12 of 26 references.
References · 12
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
- 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,421
- 2014Show and Tell: A Neural Image Caption Generatorcited by 877
- 2019Image Captioning: Transforming Objects into Wordscited by 171
- 2019DeepFashion2: A Versatile Benchmark for Detection, Pose Estimation, Segmentation and Re-Identification of Clothing Imagescited by 132
- 2017Be Your Own Prada: Fashion Synthesis with Structural Coherencecited by 49
- 2020Fashion Captioning: Towards Generating Accurate Descriptions with Semantic Rewardscited by 37
- 2016Fashion Landmark Detection in the Wildcited by 21
- 2017Unconstrained Fashion Landmark Detection via Hierarchical Recurrent Transformer Networkscited by 6
Built on by
Citing papers per year: 2022: 1; 2023: 1; 2024: 1; 2025: 2.
5 papers.
- 2023Street TryOn: Learning In-the-Wild Virtual Try-On from Unpaired Person Imagescited by 34
- 2022HandsOff: Labeled Dataset Generation With No Additional Human Annotationscited by 9
- 2025Visual Persona: Foundation Model for Full-Body Human Customizationcited by 7
- 2024A Survey of Reasoning for Substitution Relationships: Definitions, Methods, and Directionscited by 0
- 2025African Gender Classification Using Clothing Identification Via Deep Learningcited by 0
- 2025Visual Persona: Foundation Model for Full-Body Human Customization19 Mar 2025
- 2025African Gender Classification Using Clothing Identification Via Deep Learning26 Feb 2025
- 2024A Survey of Reasoning for Substitution Relationships: Definitions, Methods, and Directions9 Apr 2024
- 2023Street TryOn: Learning In-the-Wild Virtual Try-On from Unpaired Person Images27 Nov 2023
- 2022HandsOff: Labeled Dataset Generation With No Additional Human Annotations24 Dec 2022