FarSight: A Physics-Driven Whole-Body Biometric System at Large Distance and Altitude
Not on the map. Why?
Abstract (arXiv)
Whole-body biometric recognition is an important area of research due to its vast applications in law enforcement, border security, and surveillance. This paper presents the end-to-end design, development and evaluation of FarSight, an innovative software system designed for whole-body (fusion of face, gait and body shape) biometric recognition. FarSight accepts videos from elevated platforms and drones as input and outputs a candidate list of identities from a gallery. The system is designed to address several challenges, including (i) low-quality imagery, (ii) large yaw and pitch angles, (iii) robust feature extraction to accommodate large intra-person variabilities and large inter-person similarities, and (iv) the large domain gap between training and test sets. FarSight combines the physics of imaging and deep learning models to enhance image restoration and biometric feature encoding. We test FarSight's effectiveness using the newly acquired IARPA Biometric Recognition and Identification at Altitude and Range (BRIAR) dataset. Notably, FarSight demonstrated a substantial performance increase on the BRIAR dataset, with gains of +11.82% Rank-20 identification and +11.3% TAR@1% FAR.
Key facts. Cited by 27 papers in the map (data through 14 Oct 2026). Builds on 36 of its 68 references that are in the map. First posted on arXiv 29 Jun 2023.
Builds on
36 of 68 references.
References · 36
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2015Fast R-CNNcited by 2,933
- 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 910
- 2016Simple Online and Realtime Trackingcited by 868
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 823
- 2019CenterNet: Keypoint Triplets for Object Detectioncited by 654
- 2020Deep Learning for Person Re-identification: A Survey and Outlookcited by 549
- 2020Tracking Objects as Pointscited by 483
- 2022AdaFace: Quality Adaptive Margin for Face Recognitioncited by 391
- 2015WIDER FACE: A Face Detection Benchmarkcited by 298
- 2018Harmonious Attention Network for Person Re-Identificationcited by 211
- 2019DeepHuman: 3D Human Reconstruction from a Single Imagecited by 182
24 more
- 2016Person Re-identification: Past, Present and Futurecited by 181
- 2018DSFD: Dual Shot Face Detectorcited by 116
- 2022Clothes-Changing Person Re-identification with RGB Modality Onlycited by 98
- 2022OpenGait: Revisiting Gait Recognition Toward Better Practicalitycited by 85
- 2018Deep Semantic Face Deblurringcited by 80
- 2021Cloth-Changing Person Re-identification from A Single Image with Gait Prediction and Regularizationcited by 69
- 2017On the Reconstruction of Face Images from Deep Face Templatescited by 67
- 2021Multiple Object Tracking with Correlation Learningcited by 67
- 2022Expanding Accurate Person Recognition to New Altitudes and Ranges: The BRIAR Datasetcited by 61
- 2021Accelerating Atmospheric Turbulence Simulation via Learned Phase-to-Space Transformcited by 50
- 2019On Learning Disentangled Representations for Gait Recognitioncited by 43
- 2022AT-DDPM: Restoring Faces degraded by Atmospheric Turbulence using Denoising Diffusion Probabilistic Modelscited by 34
- 2022Towards Discriminative Representation: Multi-view Trajectory Contrastive Learning for Online Multi-object Trackingcited by 33
- 2020TinaFace: Strong but Simple Baseline for Face Detectioncited by 31
- 2018Disentangling Features in 3D Face Shapes for Joint Face Reconstruction and Recognitioncited by 27
- 2020Simulating Anisoplanatic Turbulence by Sampling Inter-modal and Spatially Correlated Zernike Coefficientscited by 27
- 2022Controllable and Guided Face Synthesis for Unconstrained Face Recognitioncited by 22
- 2022Cluster and Aggregate: Face Recognition with Large Probe Setcited by 22
- 2019FAN: Feature Adaptation Network for Surveillance Face Recognition and Normalizationcited by 20
- 2019ATFaceGAN: Single Face Image Restoration and Recognition from Atmospheric Turbulencecited by 18
- 2022Tilt-then-Blur or Blur-then-Tilt? Clarifying the Atmospheric Turbulence Modelcited by 17
- 2022Real-Time Dense Field Phase-to-Space Simulation of Imaging through Atmospheric Turbulencecited by 16
- 2019Some Research Problems in Biometrics: The Future Beckonscited by 13
- 2022Multi-Modal Human Authentication Using Silhouettes, Gait and RGBcited by 12
Built on by
Citing papers per year: 2023: 4; 2024: 6; 2025: 9; 2026: 8.
27 papers.
Sort:
By area:
- 2024BigGait: Learning Gait Representation You Want by Large Vision Modelscited by 45
- 2024KeyPoint Relative Position Encoding for Face Recognitioncited by 38
- 2023Learning Clothing and Pose Invariant 3D Shape Representation for Long-Term Person Re-Identificationcited by 34
- 2023Physics-Driven Turbulence Image Restoration with Stochastic Refinementcited by 24
- 2025BiggerGait: Unlocking Gait Recognition with Layer-wise Representations from Large Vision Modelscited by 20
- 202550 Years of Automated Face Recognitioncited by 15
- 2025SapiensID: Foundation for Human Recognitioncited by 14
- 2025Person Recognition at Altitude and Range: Fusion of Face, Body Shape and Gaitcited by 14
- 2024Second FRCSyn-onGoing: Winning Solutions and Post-Challenge Analysis to Improve Face Recognition with Synthetic Datacited by 13
- 2024Open-Set Biometrics: Beyond Good Closed-Set Modelscited by 12
- 2025A Quality-Guided Mixture of Score-Fusion Experts Framework for Human Recognitioncited by 11
- 2025HAMoBE: Hierarchical and Adaptive Mixture of Biometric Experts for Video-based Person ReIDcited by 10
15 more
- 2023Whole-body Detection, Recognition and Identification at Altitude and Rangecited by 7
- 2024From Data to Insights: A Covariate Analysis of the IARPA BRIAR Dataset for Multimodal Biometric Recognition Algorithms at Altitude and Rangecited by 6
- 2025Generalizable Object Re-Identification via Visual In-Context Promptingcited by 4
- 2026LocalScore: Local Density-Aware Similarity Scoring for Biometricscited by 4
- 2026FusionAgent: A Multimodal Agent with Dynamic Model Selection for Human Recognitioncited by 4
- 2025Person Recognition in Aerial Surveillance: A Decade Surveycited by 3
- 2023VILLS -- Video-Image Learning to Learn Semantics for Person Re-Identificationcited by 2
- 2024Source-free Domain Adaptation for Video Object Detection Under Adverse Image Conditionscited by 2
- 2025A Quantitative Evaluation of the Expressivity of BMI, Pose and Gender in Body Embeddings for Recognition and Identificationcited by 2
- 2026IDSelect: A RL-Based Cost-Aware Selection Agent for Video-based Multi-Modal Person Recognitioncited by 1
- 2026SapiensID 2.0: Aligning Human Recognition Foundation Models with Human Perceptioncited by 1
- 2026AttriBE: Quantifying Attribute Expressivity in Body Embeddings for Recognition and Identificationcited by 0
- 2026Subtoken Vision Transformer for Fine-grained Recognitioncited by 0
- 2026Occluded Oculus: Operationalizing Stylistic Obscurementcited by 0
- 2026Restore What Matters: Lessons from Joint Restoration and Recognitioncited by 0
- 2026Restore What Matters: Lessons from Joint Restoration and Recognition12 Sep 2026
- 2026SapiensID 2.0: Aligning Human Recognition Foundation Models with Human Perception11 Aug 2026
- 2026Occluded Oculus: Operationalizing Stylistic Obscurement27 Jul 2026
- 2026Subtoken Vision Transformer for Fine-grained Recognition10 Jul 2026
- 2026AttriBE: Quantifying Attribute Expressivity in Body Embeddings for Recognition and Identification29 Apr 2026
- 2026FusionAgent: A Multimodal Agent with Dynamic Model Selection for Human Recognition27 Mar 2026
- 2026IDSelect: A RL-Based Cost-Aware Selection Agent for Video-based Multi-Modal Person Recognition22 Feb 2026
- 2026LocalScore: Local Density-Aware Similarity Scoring for Biometrics1 Feb 2026
- 2025Person Recognition in Aerial Surveillance: A Decade Survey21 Nov 2025
- 2025Generalizable Object Re-Identification via Visual In-Context Prompting28 Aug 2025
- 2025HAMoBE: Hierarchical and Adaptive Mixture of Biometric Experts for Video-based Person ReID7 Aug 2025
- 2025A Quality-Guided Mixture of Score-Fusion Experts Framework for Human Recognition31 Jul 2025
15 more
- 202550 Years of Automated Face Recognition30 May 2025
- 2025BiggerGait: Unlocking Gait Recognition with Layer-wise Representations from Large Vision Models23 May 2025
- 2025Person Recognition at Altitude and Range: Fusion of Face, Body Shape and Gait7 May 2025
- 2025SapiensID: Foundation for Human Recognition7 Apr 2025
- 2025A Quantitative Evaluation of the Expressivity of BMI, Pose and Gender in Body Embeddings for Recognition and Identification9 Mar 2025
- 2024Second FRCSyn-onGoing: Winning Solutions and Post-Challenge Analysis to Improve Face Recognition with Synthetic Data2 Dec 2024
- 2024From Data to Insights: A Covariate Analysis of the IARPA BRIAR Dataset for Multimodal Biometric Recognition Algorithms at Altitude and Range3 Sep 2024
- 2024Open-Set Biometrics: Beyond Good Closed-Set Models23 Jul 2024
- 2024Source-free Domain Adaptation for Video Object Detection Under Adverse Image Conditions23 Apr 2024
- 2024KeyPoint Relative Position Encoding for Face Recognition21 Mar 2024
- 2024BigGait: Learning Gait Representation You Want by Large Vision Models29 Feb 2024
- 2023VILLS -- Video-Image Learning to Learn Semantics for Person Re-Identification27 Nov 2023
- 2023Whole-body Detection, Recognition and Identification at Altitude and Range9 Nov 2023
- 2023Learning Clothing and Pose Invariant 3D Shape Representation for Long-Term Person Re-Identification21 Aug 2023
- 2023Physics-Driven Turbulence Image Restoration with Stochastic Refinement20 Jul 2023
- 2024BigGait: Learning Gait Representation You Want by Large Vision Modelscited by 45
- 2024KeyPoint Relative Position Encoding for Face Recognitioncited by 38
- 2023Learning Clothing and Pose Invariant 3D Shape Representation for Long-Term Person Re-Identificationcited by 34
- 2023Physics-Driven Turbulence Image Restoration with Stochastic Refinementcited by 24
- 2025BiggerGait: Unlocking Gait Recognition with Layer-wise Representations from Large Vision Modelscited by 20
- 202550 Years of Automated Face Recognitioncited by 15
- 2025SapiensID: Foundation for Human Recognitioncited by 14
- 2025Person Recognition at Altitude and Range: Fusion of Face, Body Shape and Gaitcited by 14
- 2024Second FRCSyn-onGoing: Winning Solutions and Post-Challenge Analysis to Improve Face Recognition with Synthetic Datacited by 13
- 2024Open-Set Biometrics: Beyond Good Closed-Set Modelscited by 12
- 2025A Quality-Guided Mixture of Score-Fusion Experts Framework for Human Recognitioncited by 11
- 2025HAMoBE: Hierarchical and Adaptive Mixture of Biometric Experts for Video-based Person ReIDcited by 10
12 most cited of 25 All 25 (JSON)
- 2026Restore What Matters: Lessons from Joint Restoration and Recognition12 Sep 2026
- 2026SapiensID 2.0: Aligning Human Recognition Foundation Models with Human Perception11 Aug 2026
- 2026Occluded Oculus: Operationalizing Stylistic Obscurement27 Jul 2026
- 2026Subtoken Vision Transformer for Fine-grained Recognition10 Jul 2026
- 2026AttriBE: Quantifying Attribute Expressivity in Body Embeddings for Recognition and Identification29 Apr 2026
- 2026LocalScore: Local Density-Aware Similarity Scoring for Biometrics1 Feb 2026
- 2025Person Recognition in Aerial Surveillance: A Decade Survey21 Nov 2025
- 2025Generalizable Object Re-Identification via Visual In-Context Prompting28 Aug 2025
- 2025HAMoBE: Hierarchical and Adaptive Mixture of Biometric Experts for Video-based Person ReID7 Aug 2025
- 2025A Quality-Guided Mixture of Score-Fusion Experts Framework for Human Recognition31 Jul 2025
- 202550 Years of Automated Face Recognition30 May 2025
- 2025BiggerGait: Unlocking Gait Recognition with Layer-wise Representations from Large Vision Models23 May 2025
12 newest of 25 All 25 (JSON)