mlsanityData to 14 Oct 2026

BiLMa: Bidirectional Local-Matching for Text-based Person Re-identification

arXiv 2309.04675 ↗First posted 9 Sep 2023cs.CVcited by 8

Not on the map. Why?

Abstract (arXiv)

Text-based person re-identification (TBPReID) aims to retrieve person images represented by a given textual query. In this task, how to effectively align images and texts globally and locally is a crucial challenge. Recent works have obtained high performances by solving Masked Language Modeling (MLM) to align image/text parts. However, they only performed uni-directional (i.e., from image to text) local-matching, leaving room for improvement by introducing opposite-directional (i.e., from text to image) local-matching. In this work, we introduce Bidirectional Local-Matching (BiLMa) framework that jointly optimize MLM and Masked Image Modeling (MIM) in TBPReID model training. With this framework, our model is trained so as the labels of randomly masked both image and text tokens are predicted by unmasked tokens. In addition, to narrow the semantic gap between image and text in MIM, we propose Semantic MIM (SemMIM), in which the labels of masked image tokens are automatically given by a state-of-the-art human parser. Experimental results demonstrate that our BiLMa framework with SemMIM achieves state-of-the-art Rank@1 and mAP scores on three benchmarks.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 25 of its 28 references that are in the map. First posted on arXiv 9 Sep 2023.

Builds on

25 of 28 references.

References · 25

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,375
  3. 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,153
  4. 2014Deep metric learning using Triplet networkcited by 422
  5. 2014Detect What You Can: Detecting and Representing Objects using Holistic Models and Body Partscited by 232
  6. 2019Self-Correction for Human Parsingcited by 180
  7. 2017Person Search with Natural Language Descriptioncited by 149
  8. 2017Dual-Path Convolutional Image-Text Embeddings with Instance Losscited by 145
  9. 2023Cross-Modal Implicit Relation Reasoning and Aligning for Text-to-Image Person Retrievalcited by 132
  10. 2021Semantically Self-Aligned Network for Text-to-Image Part-aware Person Re-identificationcited by 110
  11. 2017Look into Person: Self-supervised Structure-sensitive Learning and A New Benchmark for Human Parsingcited by 109
  12. 2021DSSL: Deep Surroundings-person Separation Learning for Text-based Person Retrievalcited by 102
13 more
  1. 2022CLIP-Driven Fine-grained Text-Image Person Re-identificationcited by 79
  2. 2022See Finer, See More: Implicit Modality Alignment for Text-based Person Retrievalcited by 65
  3. 2022Learning Granularity-Unified Representations for Text-to-Image Person Re-identificationcited by 62
  4. 2021TIPCB: A Simple but Effective Part-based Convolutional Baseline for Text-based Person Searchcited by 57
  5. 2023RaSa: Relation and Sensitivity Aware Representation Learning for Text-based Person Searchcited by 54
  6. 2015Deep Human Parsing with Active Template Regressioncited by 51
  7. 2023PLIP: Language-Image Pre-training for Person Representation Learningcited by 49
  8. 2023Masked Image Modeling with Local Multi-Scale Reconstructioncited by 43
  9. 2021Learning Semantic-Aligned Feature Representation for Text-based Person Searchcited by 40
  10. 2022How to Understand Masked Autoencoderscited by 38
  11. 2022Image-Specific Information Suppression and Implicit Local Alignment for Text-based Person Searchcited by 38
  12. 2022Look Before You Leap: Improving Text-based Person Retrieval by Learning A Consistent Cross-modal Common Manifoldcited by 38
  13. 2021AXM-Net: Implicit Cross-Modal Feature Alignment for Person Re-identificationcited by 34

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 3; 2025: 2; 2026: 3.

8 papers.

  1. 2024All in One Framework for Multimodal Re-identification in the Wildcited by 18
  2. 2025CAMeL: Cross-modality Adaptive Meta-Learning for Text-based Person Retrievalcited by 6
  3. 2024Knowing Where to Focus: Attention-Guided Alignment for Text-based Person Searchcited by 4
  4. 2026ITSELF: Attention Guided Fine-Grained Alignment for Vision-Language Retrievalcited by 3
  5. 2024AMNS: Attention-Weighted Selective Mask and Noise Label Suppression for Text-to-Image Person Retrievalcited by 2
  6. 2025An Empirical Study of Validating Synthetic Data for Text-Based Person Retrievalcited by 1
  7. 2026ARGOS: Who, Where, and When in Agentic Multi-Camera Person Searchcited by 0
  8. 2026Achieving Text-based Person Retrieval with Any Granularitycited by 0