# LiCAF: LiDAR-Camera Asymmetric Fusion for Gait Recognition

arXiv: https://arxiv.org/abs/2406.12355 · HTML: https://mlsanity.com/paper/2406.12355/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 19 of its 28 references that are in the map.
- First posted on arXiv 18 Jun 2024.

## Builds on (most cited first, 19 of 19)

- [An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale](https://mlsanity.com/paper/2010.11929/) (2020)
- [BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformers](https://mlsanity.com/paper/2203.17270/) (2022)
- [TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformers](https://mlsanity.com/paper/2203.11496/) (2022)
- [BEVFusion: A Simple and Robust LiDAR-Camera Fusion Framework](https://mlsanity.com/paper/2205.13790/) (2022)
- [Revisiting Point Cloud Shape Classification with a Simple and Effective Baseline](https://mlsanity.com/paper/2106.05304/) (2021)
- [Gait Recognition via Effective Global-Local Feature Representation and Local Temporal Aggregation](https://mlsanity.com/paper/2011.01461/) (2020)
- [Gait Recognition in the Wild with Dense 3D Representations and A Benchmark](https://mlsanity.com/paper/2204.02569/) (2022)
- [OpenGait: Revisiting Gait Recognition Toward Better Practicality](https://mlsanity.com/paper/2211.06597/) (2022)
- [Towards a Deeper Understanding of Skeleton-based Gait Recognition](https://mlsanity.com/paper/2204.07855/) (2022)
- [LidarGait: Benchmarking 3D Gait Recognition with Point Clouds](https://mlsanity.com/paper/2211.10598/) (2022)
- [A Comprehensive Survey on Deep Gait Recognition: Algorithms, Datasets and Challenges](https://mlsanity.com/paper/2206.13732/) (2022)
- [Spatial Transformer Network on Skeleton-based Gait Recognition](https://mlsanity.com/paper/2204.03873/) (2022)
- [Learning Rich Features for Gait Recognition by Integrating Skeletons and Silhouettes](https://mlsanity.com/paper/2110.13408/) (2021)
- [GaitGL: Learning Discriminative Global-Local Feature Representations for Gait Recognition](https://mlsanity.com/paper/2208.01380/) (2022)
- [Learning Deep Multimodal Feature Representation with Asymmetric Multi-layer Fusion](https://mlsanity.com/paper/2108.05009/) (2021)
- [GaitMixer: Skeleton-based Gait Representation Learning via Wide-spectrum Multi-axial Mixer](https://mlsanity.com/paper/2210.15491/) (2022)
- [LiDAR2Map: In Defense of LiDAR-Based Semantic Map Construction Using Online Camera Distillation](https://mlsanity.com/paper/2304.11379/) (2023)
- [PsyMo: A Dataset for Estimating Self-Reported Psychological Traits from Gait](https://mlsanity.com/paper/2308.10631/) (2023)
- [Condition-Adaptive Graph Convolution Learning for Skeleton-Based Gait Recognition](https://mlsanity.com/paper/2308.06707/) (2023)

## Built on by (most cited first, 1 of 1)

- [Walking Further: Semantic-aware Multimodal Gait Recognition Under Long-Range Conditions](https://mlsanity.com/paper/2603.14189/) (2026)

## Abstract (arXiv)

Gait recognition is a biometric technology that identifies individuals by using walking patterns. Due to the significant achievements of multimodal fusion in gait recognition, we consider employing LiDAR-camera fusion to obtain robust gait representations. However, existing methods often overlook intrinsic characteristics of modalities, and lack fine-grained fusion and temporal modeling. In this paper, we introduce a novel modality-sensitive network LiCAF for LiDAR-camera fusion, which employs an asymmetric modeling strategy. Specifically, we propose Asymmetric Cross-modal Channel Attention (ACCA) and Interlaced Cross-modal Temporal Modeling (ICTM) for cross-modal valuable channel information selection and powerful temporal modeling. Our method achieves state-of-the-art performance (93.9% in Rank-1 and 98.8% in Rank-5) on the SUSTech1K dataset, demonstrating its effectiveness.
