VLM-PAR: A Vision Language Model for Pedestrian Attribute Recognition
On the map: Multimodal LLMs / vision-language models → Driving VLMs and open-vocabulary detection
Abstract (arXiv)
Pedestrian Attribute Recognition (PAR) involves predicting fine-grained attributes such as clothing color, gender, and accessories from pedestrian imagery, yet is hindered by severe class imbalance, intricate attribute co-dependencies, and domain shifts. We introduce VLM-PAR, a modular vision-language framework built on frozen SigLIP 2 multilingual encoders. By first aligning image and prompt embeddings via refining visual features through a compact cross-attention fusion, VLM-PAR achieves significant accuracy improvement on the highly imbalanced PA100K benchmark, setting a new state-of-the-art performance, while also delivering significant gains in mean accuracy across PETA and Market-1501 benchmarks. These results underscore the efficacy of integrating large-scale vision-language pretraining with targeted cross-modal refinement to overcome imbalance and generalization challenges in PAR.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Driving VLMs and open-vocabulary detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 8 of its 15 references that are in the map. First posted on arXiv 22 Dec 2025.
Builds on
8 of 15 references.
References · 8
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
- 2017Improving Person Re-identification by Attribute and Identity Learningcited by 96
- 2017HydraPlus-Net: Attentive Deep Features for Pedestrian Analysiscited by 89
- 2021Cross-Attention is All You Need: Adapting Pretrained Transformers for Machine Translationcited by 74
- 2023SSPNet: Scale and Spatial Priors Guided Generalizable and Interpretable Pedestrian Attribute Recognitioncited by 7
- 2024CLEAR: Cross-Transformers with Pre-trained Language Model is All you need for Person Attribute Recognition and Retrievalcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Pedestrian Attribute Recognition via CLIP based Prompt Vision-Language Fusion
- 2025A Data-Centric Approach to Pedestrian Attribute Recognition: Synthetic Augmentation via Prompt-driven Diffusion Models
- 2026ReSAGE-PAR: Representational Similarity Assessment for Generative Expansion in Pedestrian Attribute Recognition
- 2024When Large Vision-Language Models Meet Person Re-Identification
- 2024ArtVLM: Attribute Recognition Through Vision-Based Prefix Language Modeling
- 2024An Empirical Study of Mamba-based Pedestrian Attribute Recognition
- 2025Black Sheep in the Herd: Playing with Spuriously Correlated Attributes for Vision-Language Recognition
- 2023Vision-Language Models for Vision Tasks: A Survey