# Self-supervised Multi-view Person Association and Its Applications

arXiv: https://arxiv.org/abs/1805.08717 · HTML: https://mlsanity.com/paper/1805.08717/

## Key facts

- Cited by 12 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 22 May 2018.

## Built on by (most cited first, 12 of 12)

- [EgoHumans: An Egocentric 3D Multi-Human Benchmark](https://mlsanity.com/paper/2305.16487/) (2023)
- [Deep Gait Recognition: A Survey](https://mlsanity.com/paper/2102.09546/) (2021)
- [Harmony4D: A Video Dataset for In-The-Wild Close Human Interactions](https://mlsanity.com/paper/2410.20294/) (2024)
- [MMPTRACK: Large-scale Densely Annotated Multi-camera Multiple People Tracking Benchmark](https://mlsanity.com/paper/2111.15157/) (2021)
- [FLEX: Extrinsic Parameters-free Multi-view 3D Human Motion Reconstruction](https://mlsanity.com/paper/2105.01937/) (2021)
- [Multi-Camera Multi-Object Tracking on the Move via Single-Stage Global Association Approach](https://mlsanity.com/paper/2211.09663/) (2022)
- [Learning from Synchronization: Self-Supervised Uncalibrated Multi-View Person Association in Challenging Scenes](https://mlsanity.com/paper/2503.13739/) (2025)
- [LAMP: Localization Aware Multi-camera People Tracking in Metric 3D World](https://mlsanity.com/paper/2605.05390/) (2026)
- [UnsMOT: Unified Framework for Unsupervised Multi-Object Tracking with Geometric Topology Guidance](https://mlsanity.com/paper/2309.01078/) (2023)
- [Visual Self-supervised Learning Scheme for Dense Prediction Tasks on X-ray Images](https://mlsanity.com/paper/2310.08421/) (2023)
- [Self-Supervised Uncalibrated Multi-View Video Anonymization in the Operating Room](https://mlsanity.com/paper/2602.02850/) (2026)
- [TrackFish3D: Self-Supervised 3D Tracking of Schooling Fish from Multi-view Videos](https://mlsanity.com/paper/2609.38347/) (2026)

## Abstract (arXiv)

Reliable markerless motion tracking of people participating in a complex group activity from multiple moving cameras is challenging due to frequent occlusions, strong viewpoint and appearance variations, and asynchronous video streams. To solve this problem, reliable association of the same person across distant viewpoints and temporal instances is essential. We present a self-supervised framework to adapt a generic person appearance descriptor to the unlabeled videos by exploiting motion tracking, mutual exclusion constraints, and multi-view geometry. The adapted discriminative descriptor is used in a tracking-by-clustering formulation. We validate the effectiveness of our descriptor learning on WILDTRACK [14] and three new complex social scenes captured by multiple cameras with up to 60 people "in the wild". We report significant improvement in association accuracy (up to 18%) and stable and coherent 3D human skeleton tracking (5 to 10 times) over the baseline. Using the reconstructed 3D skeletons, we cut the input videos into a multi-angle video where the image of a specified person is shown from the best visible front-facing camera. Our algorithm detects inter-human occlusion to determine the camera switching moment while still maintaining the flow of the action well.