Multi-Modal Object Re-Identification with Dual Semantic Guidance and Global-Local Mutual Modulation
Not on the map. Why?
Abstract (arXiv)
Multi-modal object Re-Identification (ReID) aims to retrieve target instances by leveraging complementary information across modalities. However, existing methods suffer from two challenges. First, they often fail to exploit well-aligned and reliable semantic priors, making them vulnerable to background clutter and cross-modal misalignment. On the other hand, they typically rely on holistic feature modeling, overlooking the synergy between global and local representations. To overcome these limitations, we propose a robust multi-modal ReID framework with dual semantic guidance and global-local mutual modulation, which mainly consists of three key components, namely the Text-Semantic Injector (TSI), the Masked Global-Local Modulator (MGLM), and the Hierarchical MoE Fusion (HMF). The TSI enhances semantic awareness by integrating clean and coherent textual features into visual tokens. The MGLM enables part-aware cross-modal interaction through joint guidance from soft masks and global context, improving fine-grained feature alignment. Finally, the HMF adaptively aggregates multi-spectral features under local semantic supervision, yielding discriminative and robust representations. Extensive experiments on three multi-modal ReID benchmarks demonstrate the effectiveness of the proposed method. The code will be made publicly available at https://github.com/zw-absin/DSGM upon acceptance.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 50 of its 72 references that are in the map. First posted on arXiv 31 Jul 2026.
Builds on
50 of 72 references.
References · 50
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2024GPT-4o System Cardcited by 4,467
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
- 2017Random Erasing Data Augmentationcited by 1,235
- 2017In Defense of the Triplet Loss for Person Re-Identificationcited by 784
- 2020Deep Learning for Person Re-identification: A Survey and Outlookcited by 547
- 2017Fine-tuning CNN Image Retrieval with No Human Annotationcited by 497
- 2018Hypergraph Neural Networkscited by 482
38 more
- 2017Beyond Part Models: Person Retrieval with Refined Part Pooling (and a Strong Convolutional Baseline)cited by 472
- 2021TransReID: Transformer-based Object Re-Identificationcited by 432
- 2019Omni-Scale Feature Learning for Person Re-Identificationcited by 292
- 2022CLIP-ReID: Exploiting Vision-Language Model for Image Re-Identification without Concrete Text Labelscited by 177
- 2023Zero-Shot Composed Image Retrieval with Textual Inversioncited by 171
- 2020Identity-Guided Human Semantic Parsing for Person Re-Identificationcited by 118
- 2021Counterfactual Attention Learning for Fine-Grained Visual Categorization and Re-identificationcited by 114
- 2021Watching You: Global-guided Reciprocal Learning for Video-based Person Re-identificationcited by 45
- 2023TF-CLIP: Learning Text-free CLIP for Video-based Person Re-Identificationcited by 40
- 2024Correlation Matching Transformation Transformers for UHD Image Restorationcited by 39
- 2024Magic Tokens: Select Diverse Tokens for Multi-modal Object Re-Identificationcited by 34
- 2023TOP-ReID: Multi-spectral Object Re-Identification with Token Permutationcited by 31
- 2024DeMo: Decoupled Feature-Based Mixture of Experts for Multi-Modal Object Re-Identificationcited by 29
- 2021A Video Is Worth Three Views: Trigeminal Transformers for Video-based Person Re-identificationcited by 28
- 2025IDEA: Inverted Text with Cooperative Deformable Aggregation for Multi-modal Object Re-Identificationcited by 27
- 2020Joint Self-Attention and Scale-Aggregation for Self-Calibrated Deraining Networkcited by 25
- 2023Deeply-Coupled Convolution-Transformer with Spatial-temporal Complementary Learning for Video-based Person Re-identificationcited by 21
- 2023Multi-Prompts Learning with Cross-Modal Alignment for Attribute-based Person Re-Identificationcited by 20
- 2024MambaPro: Multi-Modal Object Re-Identification with Mamba Aggregation and Synergistic Promptcited by 20
- 2023UniCat: Crafting a Stronger Fusion Baseline for Multimodal Re-Identificationcited by 18
- 2022Multi-spectral Vehicle Re-identification with Cross-directional Consistency Network and a High-quality Benchmarkcited by 17
- 2024Keypoint Promptable Re-Identificationcited by 15
- 2023Flare-Aware Cross-modal Enhancement Network for Multi-spectral Vehicle Re-identificationcited by 10
- 2023Dynamic Enhancement Network for Partial Multi-modality Person Re-identificationcited by 9
- 2024Other Tokens Matter: Exploring Global and Local Features of Vision Transformers for Object Re-Identificationcited by 9
- 2018MaskReID: A Mask Based Deep Ranking Neural Network for Person Re-identificationcited by 8
- 2024ProFD: Prompt-Guided Feature Disentangling for Occluded Person Re-Identificationcited by 8
- 2025ICPL-ReID: Identity-Conditional Prompt Learning for Multi-Spectral Object Re-Identificationcited by 8
- 2023GraFT: Gradual Fusion Transformer for Multimodal Re-Identificationcited by 7
- 2025MDReID: Modality-Decoupled Learning for Any-to-Any Multi-Modal Object Re-Identificationcited by 7
- 2026Neural Discrimination-Prompted Transformers for Efficient UHD Image Restoration and Enhancementcited by 7
- 2024Multiple Information Prompt Learning for Cloth-Changing Person Re-Identificationcited by 5
- 2025NEXT: Multi-Grained Mixture of Experts via Text-Modulation for Multi-Modal Object Re-Identificationcited by 5
- 2025SmartFreeEdit: Mask-Free Spatial-Aware Image Editing with Complex Instruction Understandingcited by 4
- 2025Reliable Multi-Modal Object Re-Identification via Modality-Aware Graph Reasoningcited by 4
- 2025Signal: Selective Interaction and Global-local Alignment for Multi-Modal Object Re-Identificationcited by 4
- 2025UGG-ReID: Uncertainty-Guided Graph Model for Multi-Modal Object Re-Identificationcited by 3
- 2026STMI: Segmentation-Guided Token Modulation with Cross-Modal Hypergraph Interaction for Multi-Modal Object Re-Identificationcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Multi-Modal Object Re-Identification with Prompt-S6 and Semantic-Aware Knowledge Guidance
- 2026TRIM-ReID: Duplication-Aware Token Reduction and Modality-Aligned Interaction for Multi-Modal Object Re-Identification
- 2026Unleashing MLLMs on the Edge: A Unified Framework for Cross-Modal ReID via Adaptive SVD Distillation
- 2025A CLIP-based Uncertainty Modal Modeling (UMM) Framework for Pedestrian Re-Identification in Autonomous Driving
- 2025X-ReID: Multi-granularity Information Interaction for Video-Based Visible-Infrared Person Re-Identification
- 2026A Generative AI Integrated Multimodal Framework for Low-Latency Multi-Camera Person Re-Identification
- 2025SCING:Towards More Efficient and Robust Person Re-Identification through Selective Cross-modal Prompt Tuning
- 2024MLLMReID: Multimodal Large Language Model-based Person Re-identification