# Garment Attribute Manipulation with Multi-level Attention

arXiv: https://arxiv.org/abs/2409.10206 · HTML: https://mlsanity.com/paper/2409.10206/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 18 of its 38 references that are in the map.
- First posted on arXiv 16 Sep 2024.

## Builds on (most cited first, 18 of 18)

- [Layer Normalization](https://mlsanity.com/paper/1607.06450/) (2016)
- [CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification](https://mlsanity.com/paper/2103.14899/) (2021)
- [Generative Visual Manipulation on the Natural Image Manifold](https://mlsanity.com/paper/1609.03552/) (2016)
- [VITON: An Image-based Virtual Try-on Network](https://mlsanity.com/paper/1711.08447/) (2017)
- [Scaling Local Self-Attention for Parameter Efficient Visual Backbones](https://mlsanity.com/paper/2103.12731/) (2021)
- [Dress Code: High-Resolution Multi-Category Virtual Try-On](https://mlsanity.com/paper/2204.08532/) (2022)
- [DeepFashion2: A Versatile Benchmark for Detection, Pose Estimation, Segmentation and Re-Identification of Clothing Images](https://mlsanity.com/paper/1901.07973/) (2019)
- [A Decade Survey of Content Based Image Retrieval using Deep Learning](https://mlsanity.com/paper/2012.00641/) (2020)
- [Learning Fashion Compatibility with Bidirectional LSTMs](https://mlsanity.com/paper/1707.05691/) (2017)
- [Multimodal Garment Designer: Human-Centric Latent Diffusion Models for Fashion Image Editing](https://mlsanity.com/paper/2304.02051/) (2023)
- [Multi-task CNN Model for Attribute Prediction](https://mlsanity.com/paper/1601.00400/) (2016)
- [Fine-Grained Fashion Similarity Learning by Attribute-Specific Embedding Network](https://mlsanity.com/paper/2002.02814/) (2020)
- [MMFashion: An Open-Source Toolbox for Visual Fashion Analysis](https://mlsanity.com/paper/2005.08847/) (2020)
- [Garment Recommendation with Memory Augmented Neural Networks](https://mlsanity.com/paper/2012.06200/) (2020)
- [Multimodal-Conditioned Latent Diffusion Models for Fashion Image Editing](https://mlsanity.com/paper/2403.14828/) (2024)
- [Fashion Recommendation Based on Style and Social Events](https://mlsanity.com/paper/2208.00725/) (2022)
- [Attribute-Guided Multi-Level Attention Network for Fine-Grained Fashion Retrieval](https://mlsanity.com/paper/2301.13014/) (2022)
- [Transformer-based Graph Neural Networks for Outfit Generation](https://mlsanity.com/paper/2304.08098/) (2023)

## Abstract (arXiv)

In the rapidly evolving field of online fashion shopping, the need for more personalized and interactive image retrieval systems has become paramount. Existing methods often struggle with precisely manipulating specific garment attributes without inadvertently affecting others. To address this challenge, we propose GAMMA (Garment Attribute Manipulation with Multi-level Attention), a novel framework that integrates attribute-disentangled representations with a multi-stage attention-based architecture. GAMMA enables targeted manipulation of fashion image attributes, allowing users to refine their searches with high accuracy. By leveraging a dual-encoder Transformer and memory block, our model achieves state-of-the-art performance on popular datasets like Shopping100k and DeepFashion.
