FUSE: Frequency-domain Unification and Spectral Energy Alignment for Multi-modal Object Re-Identification
Not on the map. Why?
Abstract (arXiv)
Despite significant progress in multi-modal Re-Identification (ReID), existing methods tend to emphasize low-frequency cues. Consequently, they focus on attributes such as color, illumination, and coarse appearance, while overlooking mid and high-frequency structures that encode geometric, textural, and identity-discriminative details. This imbalance leads to incomplete spectral representations and unstable cross-modal alignment. To overcome these limitations, we introduce FUSE, a frequency-domain framework that reformulates multi-modal ReID as a two-stage process of spectral disentanglement and energy alignment. The proposed Spectral Decomposition Module (SDM) adaptively partitions features into low, mid, and high-frequency subspaces, enabling hierarchical spectral modeling. The Cross-Modal Alignment Module (CAM) further enforces energy alignment and subspace complementarity across modalities via frequency-consistency regularization. In addition, FUSE incorporates learnable frequency modulation to enhance robustness under varying illumination and heterogeneous sensor conditions. Extensive experiments on RGBNT201, RGBNT100, and MSVR310 show that FUSE achieves 9.1% mAP and 9.5% Rank-1 improvements, establishing an interpretable frequency-domain paradigm for multi-modal representation learning.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 35 of its 59 references that are in the map. First posted on arXiv 18 Jun 2026.
Builds on
35 of 59 references.
References · 35
- 2020Deep Learning for Person Re-identification: A Survey and Outlookcited by 549
- 2017Beyond Part Models: Person Retrieval with Refined Part Pooling (and a Strong Convolutional Baseline)cited by 473
- 2021TransReID: Transformer-based Object Re-Identificationcited by 435
- 2019Bag of Tricks and A Strong Baseline for Deep Person Re-identificationcited by 430
- 2020Circle Loss: A Unified Perspective of Pair Similarity Optimizationcited by 403
- 2019High Frequency Component Helps Explain the Generalization of Convolutional Neural Networkscited by 310
- 2022How Do Vision Transformers Work?cited by 307
- 2019Omni-Scale Feature Learning for Person Re-Identificationcited by 295
- 2018Learning Discriminative Features with Multiple Granularities for Person Re-Identificationcited by 291
- 2018Harmonious Attention Network for Person Re-Identificationcited by 211
- 2021Counterfactual Attention Learning for Fine-Grained Visual Categorization and Re-identificationcited by 114
- 2017Multi-scale Deep Learning Architectures for Person Re-identificationcited by 44
23 more
- 2021OMPQ: Orthogonal Mixed Precision Quantizationcited by 39
- 2024Magic Tokens: Select Diverse Tokens for Multi-modal Object Re-Identificationcited by 35
- 2023TOP-ReID: Multi-spectral Object Re-Identification with Token Permutationcited by 32
- 2024DeMo: Decoupled Feature-Based Mixture of Experts for Multi-Modal Object Re-Identificationcited by 29
- 2025IDEA: Inverted Text with Cooperative Deformable Aggregation for Multi-modal Object Re-Identificationcited by 28
- 2021Heterogeneous Relational Complement for Vehicle Re-identificationcited by 25
- 2026Flow caching for autoregressive video generationcited by 25
- 2023Decoupled Contrastive Multi-View Clustering with High-Order Random Walkscited by 23
- 2024MambaPro: Multi-Modal Object Re-Identification with Mamba Aggregation and Synergistic Promptcited by 20
- 2021An Information Theory-inspired Strategy for Automatic Network Pruningcited by 17
- 2022Multi-spectral Vehicle Re-identification with Cross-directional Consistency Network and a High-quality Benchmarkcited by 17
- 2023Solving Oscillation Problem in Post-Training Quantization Through a Theoretical Perspectivecited by 17
- 2024RLE: A Unified Perspective of Data Augmentation for Cross-Spectral Re-identificationcited by 16
- 2024FAMNet: Frequency-aware Matching Network for Cross-domain Few-shot Medical Image Segmentationcited by 14
- 2024PartFormer: Awakening Latent Diverse Representation from Vision Transformer for Object Re-Identificationcited by 13
- 2023Flare-Aware Cross-modal Enhancement Network for Multi-spectral Vehicle Re-identificationcited by 10
- 2023Dynamic Enhancement Network for Partial Multi-modality Person Re-identificationcited by 10
- 2025MDReID: Modality-Decoupled Learning for Any-to-Any Multi-Modal Object Re-Identificationcited by 7
- 2026Bridging Day and Night: Target-Class Hallucination Suppression in Unpaired Image Translationcited by 6
- 2025GSAlign: Geometric and Semantic Alignment Network for Aerial-Ground Person Re-Identificationcited by 5
- 2024Knowing Where to Focus: Attention-Guided Alignment for Text-based Person Searchcited by 4
- 2026White-Balance First, Adjust Later: Cross-Camera Color Constancy via Vision-Language Evaluationcited by 4
- 2025FlexiReID: Adaptive Mixture of Expert for Multi-Modal Person Re-Identificationcited by 3
Built on by
Not cited yet.