# An Empirical Analysis of GPT-4V's Performance on Fashion Aesthetic Evaluation

arXiv: https://arxiv.org/abs/2410.23730 · HTML: https://mlsanity.com/paper/2410.23730/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 8 of its 15 references that are in the map.
- First posted on arXiv 31 Oct 2024.

## Builds on (most cited first, 8 of 8)

- [Learning Transferable Visual Models From Natural Language Supervision](https://mlsanity.com/paper/2103.00020/) (2021)
- [Language Models are Few-Shot Learners](https://mlsanity.com/paper/2005.14165/) (2020)
- [An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale](https://mlsanity.com/paper/2010.11929/) (2020)
- [Large Language Models are not Fair Evaluators](https://mlsanity.com/paper/2305.17926/) (2023)
- [The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)](https://mlsanity.com/paper/2309.17421/) (2023)
- [Large Language Models Are Not Robust Multiple Choice Selectors](https://mlsanity.com/paper/2309.03882/) (2023)
- [GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generation](https://mlsanity.com/paper/2401.04092/) (2024)
- [OpenSkill: A faster asymmetric multi-team, multiplayer rating system](https://mlsanity.com/paper/2401.05451/) (2024)

## Built on by (most cited first, 3 of 3)

- [PinLanding: Content-First Keyword Landing Page Generation via Multi-Modal AI for Web-Scale Discovery](https://mlsanity.com/paper/2503.00619/) (2025)
- [Visual Interestingness Decoded: How GPT-4o Mirrors Human Interests](https://mlsanity.com/paper/2510.13316/) (2025)
- [Fashionability-Enhancing Outfit Image Editing with Conditional Diffusion Models](https://mlsanity.com/paper/2412.18421/) (2024)

## Abstract (arXiv)

Fashion aesthetic evaluation is the task of estimating how well the outfits worn by individuals in images suit them. In this work, we examine the zero-shot performance of GPT-4V on this task for the first time. We show that its predictions align fairly well with human judgments on our datasets, and also find that it struggles with ranking outfits in similar colors. The code is available at https://github.com/st-tech/gpt4v-fashion-aesthetic-evaluation.