A Theory-Inspired Framework for Few-Shot Cross-Modal Sketch Person Re-Identification
Not on the map. Why?
Abstract (arXiv)
Sketch based person re-identification aims to match hand-drawn sketches with RGB surveillance images, but remains challenging due to significant modality gaps and limited annotated data. To address this, we introduce KTCAA, a theoretically grounded framework for few-shot cross-modal generalization. Motivated by generalization theory, we identify two key factors influencing target domain risk: (1) domain discrepancy, which quantifies the alignment difficulty between source and target distributions; and (2) perturbation invariance, which evaluates the model's robustness to modality shifts. Based on these insights, we propose two components: (1) Alignment Augmentation (AA), which applies localized sketch-style transformations to simulate target distributions and facilitate progressive alignment; and (2) Knowledge Transfer Catalyst (KTC), which enhances invariance by introducing worst-case perturbations and enforcing consistency. These modules are jointly optimized under a meta-learning paradigm that transfers alignment knowledge from data-rich RGB domains to sketch-based scenarios. Experiments on multiple benchmarks demonstrate that KTCAA achieves state-of-the-art performance, particularly in data-scarce conditions.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 27 of its 54 references that are in the map. First posted on arXiv 24 Nov 2025.
Builds on
27 of 54 references.
References · 27
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2017Learning to Compare: Relation Network for Few-Shot Learningcited by 1,139
- 2017Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learningcited by 918
- 2016Universal adversarial perturbationscited by 774
- 2018Generalizing to Unseen Domains via Adversarial Data Augmentationcited by 451
- 2017Re-ranking Person Re-identification with k-reciprocal Encodingcited by 260
- 2018Dissecting Person Re-identification from the Viewpoint of Viewpointcited by 83
- 2023Diverse Embedding Expansion Network and Low-Light Cross-Modality Benchmark for Visible-Infrared Person Re-identificationcited by 79
- 2020Learning Meta Face Recognition in Unseen Domainscited by 61
- 2021Person Re-identification Method Based on Color Attack and Joint Defencecited by 56
- 2024Cross-Modality Perturbation Synergy Attack for Person Re-identificationcited by 45
15 more
- 2021Eliminate Deviation with Deviation for Data Augmentation and a General Multi-modal Data Learning Methodcited by 42
- 2024Magic Tokens: Select Diverse Tokens for Multi-modal Object Re-Identificationcited by 34
- 2025Towards Universal Modal Tracking with Online Dense Temporal Token Learningcited by 30
- 2024Beyond Augmentation: Empowering Model Robustness under Extreme Capture Environmentscited by 23
- 2024Learn from Downstream and Be Yourself in Multimodal Large Language Model Fine-Tuningcited by 19
- 2024All in One Framework for Multimodal Re-identification in the Wildcited by 18
- 2023CIFAR-10-Warehouse: Broad and More Realistic Testbeds in Model Generalization Analysiscited by 12
- 2025Robust Self-Paced Hashing for Cross-Modal Retrieval with Noisy Labelscited by 10
- 2023Shape-centered Representation Learning for Visible-Infrared Person Re-identificationcited by 9
- 2025LLaVA-ReID: Selective Multi-image Questioner for Interactive Person Re-Identificationcited by 9
- 2025Video-Level Language-Driven Video-Based Visible-Infrared Person Re-Identificationcited by 9
- 2020Hierarchical Bi-Directional Feature Perception Network for Person Re-Identificationcited by 4
- 2023Alice Benchmarks: Connecting Real World Re-Identification with the Syntheticcited by 4
- 2025Robust Duality Learning for Unsupervised Visible-Infrared Person Re-Identificationcited by 4
- 2023Beyond Domain Gap: Exploiting Subjectivity in Sketch-Based Person Retrievalcited by 3
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Statistical Characteristic-Guided Denoising for Rapid High-Resolution Transmission Electron Microscopy Imagingcited by 3
- 2026ReconMIL: Synergizing Latent Space Reconstruction with Bi-Stream Mamba for Whole Slide Image Analysiscited by 0
- 2026GS-STVSR: Ultra-Efficient Continuous Spatio-Temporal Video Super-Resolution via 2D Gaussian Splattingcited by 0
- 2026Open-Linguistic Concept Unified Learning for Cross-Site Interpretable Dermatology Image Diagnosiscited by 0
- 2026Advantage-Guided Gate: Reshaping Open-Ended Reasoning for Vision-Based Spatial Intelligencecited by 0
- 2026Advantage-Guided Gate: Reshaping Open-Ended Reasoning for Vision-Based Spatial Intelligence8 Aug 2026
- 2026Open-Linguistic Concept Unified Learning for Cross-Site Interpretable Dermatology Image Diagnosis4 Aug 2026
- 2026GS-STVSR: Ultra-Efficient Continuous Spatio-Temporal Video Super-Resolution via 2D Gaussian Splatting20 Apr 2026
- 2026ReconMIL: Synergizing Latent Space Reconstruction with Bi-Stream Mamba for Whole Slide Image Analysis20 Mar 2026
- 2026Statistical Characteristic-Guided Denoising for Rapid High-Resolution Transmission Electron Microscopy Imaging19 Mar 2026