mlsanityData to 7 Oct 2026

Multi-Modal Object Re-Identification with Dual Semantic Guidance and Global-Local Mutual Modulation

arXiv 2607.29207 ↗First posted 31 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Multi-modal object Re-Identification (ReID) aims to retrieve target instances by leveraging complementary information across modalities. However, existing methods suffer from two challenges. First, they often fail to exploit well-aligned and reliable semantic priors, making them vulnerable to background clutter and cross-modal misalignment. On the other hand, they typically rely on holistic feature modeling, overlooking the synergy between global and local representations. To overcome these limitations, we propose a robust multi-modal ReID framework with dual semantic guidance and global-local mutual modulation, which mainly consists of three key components, namely the Text-Semantic Injector (TSI), the Masked Global-Local Modulator (MGLM), and the Hierarchical MoE Fusion (HMF). The TSI enhances semantic awareness by integrating clean and coherent textual features into visual tokens. The MGLM enables part-aware cross-modal interaction through joint guidance from soft masks and global context, improving fine-grained feature alignment. Finally, the HMF adaptively aggregates multi-spectral features under local semantic supervision, yielding discriminative and robust representations. Extensive experiments on three multi-modal ReID benchmarks demonstrate the effectiveness of the proposed method. The code will be made publicly available at https://github.com/zw-absin/DSGM upon acceptance.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 50 of its 72 references that are in the map. First posted on arXiv 31 Jul 2026.

Builds on

50 of 72 references.

References · 50

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  5. 2024GPT-4o System Cardcited by 4,467
  6. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  7. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
  8. 2017Random Erasing Data Augmentationcited by 1,235
  9. 2017In Defense of the Triplet Loss for Person Re-Identificationcited by 784
  10. 2020Deep Learning for Person Re-identification: A Survey and Outlookcited by 547
  11. 2017Fine-tuning CNN Image Retrieval with No Human Annotationcited by 497
  12. 2018Hypergraph Neural Networkscited by 482
38 more
  1. 2017Beyond Part Models: Person Retrieval with Refined Part Pooling (and a Strong Convolutional Baseline)cited by 472
  2. 2021TransReID: Transformer-based Object Re-Identificationcited by 432
  3. 2019Omni-Scale Feature Learning for Person Re-Identificationcited by 292
  4. 2022CLIP-ReID: Exploiting Vision-Language Model for Image Re-Identification without Concrete Text Labelscited by 177
  5. 2023Zero-Shot Composed Image Retrieval with Textual Inversioncited by 171
  6. 2020Identity-Guided Human Semantic Parsing for Person Re-Identificationcited by 118
  7. 2021Counterfactual Attention Learning for Fine-Grained Visual Categorization and Re-identificationcited by 114
  8. 2021Watching You: Global-guided Reciprocal Learning for Video-based Person Re-identificationcited by 45
  9. 2023TF-CLIP: Learning Text-free CLIP for Video-based Person Re-Identificationcited by 40
  10. 2024Correlation Matching Transformation Transformers for UHD Image Restorationcited by 39
  11. 2024Magic Tokens: Select Diverse Tokens for Multi-modal Object Re-Identificationcited by 34
  12. 2023TOP-ReID: Multi-spectral Object Re-Identification with Token Permutationcited by 31
  13. 2024DeMo: Decoupled Feature-Based Mixture of Experts for Multi-Modal Object Re-Identificationcited by 29
  14. 2021A Video Is Worth Three Views: Trigeminal Transformers for Video-based Person Re-identificationcited by 28
  15. 2025IDEA: Inverted Text with Cooperative Deformable Aggregation for Multi-modal Object Re-Identificationcited by 27
  16. 2020Joint Self-Attention and Scale-Aggregation for Self-Calibrated Deraining Networkcited by 25
  17. 2023Deeply-Coupled Convolution-Transformer with Spatial-temporal Complementary Learning for Video-based Person Re-identificationcited by 21
  18. 2023Multi-Prompts Learning with Cross-Modal Alignment for Attribute-based Person Re-Identificationcited by 20
  19. 2024MambaPro: Multi-Modal Object Re-Identification with Mamba Aggregation and Synergistic Promptcited by 20
  20. 2023UniCat: Crafting a Stronger Fusion Baseline for Multimodal Re-Identificationcited by 18
  21. 2022Multi-spectral Vehicle Re-identification with Cross-directional Consistency Network and a High-quality Benchmarkcited by 17
  22. 2024Keypoint Promptable Re-Identificationcited by 15
  23. 2023Flare-Aware Cross-modal Enhancement Network for Multi-spectral Vehicle Re-identificationcited by 10
  24. 2023Dynamic Enhancement Network for Partial Multi-modality Person Re-identificationcited by 9
  25. 2024Other Tokens Matter: Exploring Global and Local Features of Vision Transformers for Object Re-Identificationcited by 9
  26. 2018MaskReID: A Mask Based Deep Ranking Neural Network for Person Re-identificationcited by 8
  27. 2024ProFD: Prompt-Guided Feature Disentangling for Occluded Person Re-Identificationcited by 8
  28. 2025ICPL-ReID: Identity-Conditional Prompt Learning for Multi-Spectral Object Re-Identificationcited by 8
  29. 2023GraFT: Gradual Fusion Transformer for Multimodal Re-Identificationcited by 7
  30. 2025MDReID: Modality-Decoupled Learning for Any-to-Any Multi-Modal Object Re-Identificationcited by 7
  31. 2026Neural Discrimination-Prompted Transformers for Efficient UHD Image Restoration and Enhancementcited by 7
  32. 2024Multiple Information Prompt Learning for Cloth-Changing Person Re-Identificationcited by 5
  33. 2025NEXT: Multi-Grained Mixture of Experts via Text-Modulation for Multi-Modal Object Re-Identificationcited by 5
  34. 2025SmartFreeEdit: Mask-Free Spatial-Aware Image Editing with Complex Instruction Understandingcited by 4
  35. 2025Reliable Multi-Modal Object Re-Identification via Modality-Aware Graph Reasoningcited by 4
  36. 2025Signal: Selective Interaction and Global-local Alignment for Multi-Modal Object Re-Identificationcited by 4
  37. 2025UGG-ReID: Uncertainty-Guided Graph Model for Multi-Modal Object Re-Identificationcited by 3
  38. 2026STMI: Segmentation-Guided Token Modulation with Cross-Modal Hypergraph Interaction for Multi-Modal Object Re-Identificationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Multi-Modal Object Re-Identification with Prompt-S6 and Semantic-Aware Knowledge Guidance
  2. 2026TRIM-ReID: Duplication-Aware Token Reduction and Modality-Aligned Interaction for Multi-Modal Object Re-Identification
  3. 2026Unleashing MLLMs on the Edge: A Unified Framework for Cross-Modal ReID via Adaptive SVD Distillation
  4. 2025A CLIP-based Uncertainty Modal Modeling (UMM) Framework for Pedestrian Re-Identification in Autonomous Driving
  5. 2025X-ReID: Multi-granularity Information Interaction for Video-Based Visible-Infrared Person Re-Identification
  6. 2026A Generative AI Integrated Multimodal Framework for Low-Latency Multi-Camera Person Re-Identification
  7. 2025SCING:Towards More Efficient and Robust Person Re-Identification through Selective Cross-modal Prompt Tuning
  8. 2024MLLMReID: Multimodal Large Language Model-based Person Re-identification