SapiensID 2.0: Aligning Human Recognition Foundation Models with Human Perception
Not on the map. Why?
Abstract (arXiv)
While foundation models have significantly advanced human recognition across diverse modalities, they predominantly rely on static, geometric feature extraction. This approach fundamentally diverges from human perception. Consequently, current models often suffer from "semantic blindness," overfitting to transient noise while failing to leverage invariant soft biometrics, and struggle to capture temporal motion signatures. To bridge this gap, we propose SapiensID 2.0, a human recognition framework enriched with both semantic and temporal awareness. To overcome the lack of soft-biometric annotations, we transfer zero-shot semantic knowledge from Multimodal Large Language Models (MLLMs) into a discriminative embedding space. We resolve the dimensional mismatch between these spaces using Invariant Trait Alignment (ITA) to distill core persistent traits, and Transient Noise Disentanglement (TND) to decouple artifacts like clothing. Furthermore, we design a Kinematic Semantic Attention Head (K-SAH) that extends spatial attention across temporal windows. By tracking semantic patches over time, K-SAH captures rich kinematic signatures without requiring large-scale video datasets. Extensive experiments demonstrate that SapiensID 2.0 achieves state-of-the-art performance across image- and video-based person re-identification and gait recognition, while maintaining robust face recognition capabilities.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 40 of its 70 references that are in the map. First posted on arXiv 11 Aug 2026.
Builds on
40 of 70 references.
References · 40
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2021ViViT: A Video Vision Transformercited by 1,620
- 2017Person Transfer GAN to Bridge Domain Gap for Person Re-Identificationcited by 480
- 2022AdaFace: Quality Adaptive Margin for Face Recognitioncited by 391
- 2017Cross-Age LFW: A Database for Studying Cross-Age Face Recognition in Unconstrained Environmentscited by 260
- 2024MobileVLM V2: Faster and Stronger Baseline for Vision Language Modelcited by 174
- 2022Clothes-Changing Person Re-identification with RGB Modality Onlycited by 98
- 2023Beyond Appearance: a Semantic Controllable Self-Supervised Learning Framework for Human-Centric Visual Taskscited by 96
- 2020Person Re-identification by Contour Sketch under Moderate Clothing Changecited by 91
- 2024FastVLM: Efficient Vision Encoding for Vision Language Modelscited by 77
- 2021Large-Scale Spatio-Temporal Person Re-identification: Algorithms and Benchmarkcited by 47
28 more
- 2023Exploring Deep Models for Practical Gait Recognitioncited by 46
- 2024BigGait: Learning Gait Representation You Want by Large Vision Modelscited by 45
- 2023SkeletonGait: Gait Recognition Using Skeleton Mapscited by 41
- 2023Learning Clothing and Pose Invariant 3D Shape Representation for Long-Term Person Re-Identificationcited by 34
- 2023HAP: Structure-Aware Masked Image Modeling for Human-Centric Perceptioncited by 33
- 2023FarSight: A Physics-Driven Whole-Body Biometric System at Large Distance and Altitudecited by 27
- 2023Cross-Covariate Gait Recognition: A Benchmarkcited by 22
- 2025BiggerGait: Unlocking Gait Recognition with Layer-wise Representations from Large Vision Modelscited by 20
- 2025From Poses to Identity: Training-Free Person Re-Identification via Feature Centralizationcited by 17
- 2025SeCap: Self-Calibrating and Adaptive Prompts for Cross-view Person Re-Identification in Aerial-Ground Networkscited by 16
- 2025SapiensID: Foundation for Human Recognitioncited by 14
- 2025Person Recognition at Altitude and Range: Fusion of Face, Body Shape and Gaitcited by 14
- 2025On Denoising Walking Videos for Gait Recognitioncited by 14
- 2025LVFace: Progressive Cluster Optimization for Large Vision Models in Face Recognitioncited by 12
- 2025DIFFER: Disentangling Identity Features via Semantic Cues for Clothes-Changing Person Re-IDcited by 11
- 2025A Quality-Guided Mixture of Score-Fusion Experts Framework for Human Recognitioncited by 11
- 2022GEFF: Improving Any Clothes-Changing Person ReID Model using Gallery Enrichment with Face Featurescited by 10
- 2025HAMoBE: Hierarchical and Adaptive Mixture of Biometric Experts for Video-based Person ReIDcited by 10
- 2024DLCR: A Generative Data Expansion Framework via Diffusion for Clothes-Changing Person Re-IDcited by 8
- 2025ReID5o: Achieving Omni Multi-modal Person Re-identification in a Single Modelcited by 8
- 2025Learning from Synchronization: Self-Supervised Uncalibrated Multi-View Person Association in Challenging Scenescited by 7
- 2025Multi-modal Multi-platform Person Re-Identification: Benchmark and Methodcited by 6
- 2024VIGFace: Virtual Identity Generation for Privacy-Free Face Recognitioncited by 5
- 2025One-Shot Knowledge Transfer for Scalable Person Re-Identificationcited by 4
- 2025CarGait: Cross-Attention based Re-ranking for Gait recognitioncited by 3
- 2025IDFace: Face Template Protection for Efficient and Secure Identificationcited by 3
- 2023VILLS -- Video-Image Learning to Learn Semantics for Person Re-Identificationcited by 2
- 2025GIF: Generative Inspiration for Face Recognition at Scalecited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Learning by Neighbor-Aware Semantics, Deciding by Open-form Flows: Towards Robust Zero-Shot Skeleton Action Recognition
- 2026Supervised Classification Heads as Semantic Prototypes: Unlocking Vision-Language Alignment via Weight Recycling
- 2025SkeletonAgent: An Agentic Interaction Framework for Skeleton-based Action Recognition
- 2024Neuron: Learning Context-Aware Evolving Representations for Zero-Shot Skeleton Action Recognition
- 2026ITSELF: Attention Guided Fine-Grained Alignment for Vision-Language Retrieval
- 2026AlignFace: Human-Aligned Face Similarity Metric with Interpretable Concept Relations
- 2026NextMotionQA: Benchmarking and Judging Human Motion Understanding with Vision-Language Models
- 2025Time Blindness: Why Video-Language Models Can't See What Humans Can?