# ModaNet: A Large-Scale Street Fashion Dataset with Polygon Annotations

arXiv: https://arxiv.org/abs/1807.01394 · HTML: https://mlsanity.com/paper/1807.01394/

## Key facts

- Cited by 33 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 3 Jul 2018.

## Built on by (most cited first, 30 of 33)

- [PACO: Parts and Attributes of Common Objects](https://mlsanity.com/paper/2301.01795/) (2023)
- [UniHCP: A Unified Model for Human-Centric Perceptions](https://mlsanity.com/paper/2303.02936/) (2023)
- [Going Denser with Open-Vocabulary Part Segmentation](https://mlsanity.com/paper/2305.11173/) (2023)
- [Contrastive language and vision learning of general fashion concepts](https://mlsanity.com/paper/2204.03972/) (2022)
- [HumanBench: Towards General Human-centric Perception with Projector Assisted Pretraining](https://mlsanity.com/paper/2303.05675/) (2023)
- [MMR: A Large-scale Benchmark Dataset for Multi-target and Multi-granularity Reasoning Segmentation](https://mlsanity.com/paper/2503.13881/) (2025)
- [What a MESS: Multi-Domain Evaluation of Zero-Shot Semantic Segmentation](https://mlsanity.com/paper/2306.15521/) (2023)
- [Hulk: A Universal Knowledge Translator for Human-Centric Tasks](https://mlsanity.com/paper/2312.01697/) (2023)
- [Deep Learning Technique for Human Parsing: A Survey and Outlook](https://mlsanity.com/paper/2301.00394/) (2023)
- [Fashionformer: A simple, Effective and Unified Baseline for Human Fashion Segmentation and Recognition](https://mlsanity.com/paper/2204.04654/) (2022)
- [From Culture to Clothing: Discovering the World Events Behind A Century of Fashion Images](https://mlsanity.com/paper/2102.01690/) (2021)
- [FashionVQA: A Domain-Specific Visual Question Answering System](https://mlsanity.com/paper/2208.11253/) (2022)
- [SPIN: Hierarchical Segmentation with Subpart Granularity in Natural Images](https://mlsanity.com/paper/2407.09686/) (2024)
- [Smart Fashion: A Review of AI Applications in the Fashion & Apparel Industry](https://mlsanity.com/paper/2111.00905/) (2021)
- [Describe me if you can! Characterized Instance-level Human Parsing](https://mlsanity.com/paper/2201.09594/) (2022)
- [GLAMI-1M: A Multilingual Image-Text Fashion Dataset](https://mlsanity.com/paper/2211.14451/) (2022)
- [TextileNet: A Material Taxonomy-based Fashion Textile Dataset](https://mlsanity.com/paper/2301.06160/) (2023)
- [Automatic Generation of Fashion Images using Prompting in Generative Machine Learning Models](https://mlsanity.com/paper/2407.14944/) (2024)
- [Object Recognition Datasets and Challenges: A Review](https://mlsanity.com/paper/2507.22361/) (2025)
- [Image-based Virtual Fitting Room](https://mlsanity.com/paper/2104.04104/) (2021)
- [DETR-based Layered Clothing Segmentation and Fine-Grained Attribute Recognition](https://mlsanity.com/paper/2304.08107/) (2023)
- [FashionFail: Addressing Failure Cases in Fashion Object Detection and Segmentation](https://mlsanity.com/paper/2404.08582/) (2024)
- [se-Shweshwe Inspired Fashion Generation](https://mlsanity.com/paper/2203.00435/) (2022)
- [Technologies for AI-Driven Fashion Social Networking Service with E-Commerce](https://mlsanity.com/paper/2203.10996/) (2022)
- [NL-FCOS: Improving FCOS through Non-Local Modules for Object Detection](https://mlsanity.com/paper/2203.15638/) (2022)
- [Learning Fashion Compatibility from In-the-wild Images](https://mlsanity.com/paper/2206.05982/) (2022)
- [Fashionpedia-Taste: A Dataset towards Explaining Human Fashion Taste](https://mlsanity.com/paper/2305.02307/) (2023)
- [Fashionpedia-Ads: Do Your Favorite Advertisements Reveal Your Fashion Taste?](https://mlsanity.com/paper/2305.02360/) (2023)
- [Fashion Object Detection for Tops & Bottoms](https://mlsanity.com/paper/2305.18482/) (2023)
- [Prompt2Fashion: An automatically generated fashion dataset](https://mlsanity.com/paper/2409.06442/) (2024)

## Abstract (arXiv)

Understanding clothes from a single image has strong commercial and cultural impacts on modern societies. However, this task remains a challenging computer vision problem due to wide variations in the appearance, style, brand and layering of clothing items. We present a new database called ModaNet, a large-scale collection of images based on Paperdoll dataset. Our dataset provides 55,176 street images, fully annotated with polygons on top of the 1 million weakly annotated street images in Paperdoll. ModaNet aims to provide a technical benchmark to fairly evaluate the progress of applying the latest computer vision techniques that rely on large data for fashion understanding. The rich annotation of the dataset allows to measure the performance of state-of-the-art algorithms for object detection, semantic segmentation and polygon prediction on street fashion images in detail. The polygon-based annotation dataset has been released https://github.com/eBay/modanet, we also host the leaderboard at EvalAI: https://evalai.cloudcv.org/featured-challenges/136/overview.