HieDG: A Hierarchical Discrete Geometry-Guided Framework for Multi-Animal Tracking
Not on the map. Why?
Abstract (arXiv)
Multi-animal tracking (MAT) is critical for wildlife monitoring and behavioral analysis, yet remains challenging due to uniform appearance, high density, and irregular motion. Existing methods typically follow heuristic- or query-based paradigms: the former relies on handcrafted geometric associations without end-to-end optimization, whereas the latter enables joint optimization but relies heavily on appearance embeddings. In such conditions, continuous geometric embeddings can be unstable, as small coordinate perturbations may disproportionately alter cross-frame attention weights, degrading identity association performance. To address this limitation, we propose HieDG, a Hierarchical Discrete Geometry-guided tracking framework that reformulates geometric dynamics as structured discrete representations within a query-based tracker. Instead of directly using raw geometric signals, HieDG employs a two-stage residual codebook to discretize position, scale, and velocity cues, transforming unstable continuous geometry into structured, stable discrete tokens. These tokens are aligned with visual embeddings and integrated into the tracking queries to enhance identity consistency. Extensive experiments on animal-specific benchmarks (AnimalTrack, BFT, and BuckTales) demonstrate state-of-the-art association performance with significant improvements in HOTA, AssA, and IDF1. Additional evaluations on generic multi-object tracking benchmarks, including DanceTrack and SportsMOT, show competitive performance, indicating the broader applicability of discretized geometric modeling beyond animal-specific scenarios.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 35 of its 52 references that are in the map. First posted on arXiv 1 Jul 2026.
Builds on
35 of 52 references.
References · 35
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2017Neural Discrete Representation Learningcited by 4,650
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2016Simple Online and Realtime Trackingcited by 862
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
- 2022Autoregressive Image Generation using Residual Quantizationcited by 706
- 2016Performance Measures and a Data Set for Multi-Target, Multi-Camera Trackingcited by 685
- 2021Vector-quantized Image Modeling with Improved VQGANcited by 656
- 2020HOTA: A Higher Order Metric for Evaluating Multi-Object Trackingcited by 546
- 2021TrackFormer: Multi-Object Tracking with Transformerscited by 515
23 more
- 2024YOLOv10: Real-Time End-to-End Object Detectioncited by 508
- 2020FairMOT: On the Fairness of Detection and Re-Identification in Multiple Object Trackingcited by 489
- 2020Tracking Objects as Pointscited by 483
- 2019Tracking without bells and whistlescited by 382
- 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 379
- 2020TransTrack: Multiple Object Tracking with Transformercited by 370
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 345
- 2019Towards Real-Time Multi-Object Trackingcited by 311
- 2020Quasi-Dense Similarity Learning for Multiple Object Trackingcited by 220
- 2021DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motioncited by 213
- 2022MOTRv2: Bootstrapping End-to-End Multi-Object Tracking by Pretrained Object Detectorscited by 148
- 2023Deep OC-SORT: Multi-Pedestrian Tracking by Adaptive Re-Identificationcited by 130
- 2023SportsMOT: A Large Multi-Object Tracking Dataset in Multiple Sports Scenescited by 130
- 2024OmniTokenizer: A Joint Image-Video Tokenizer for Visual Generationcited by 117
- 2020Rethinking the competition between detection and ReID in Multi-Object Trackingcited by 101
- 2023MeMOTR: Long-Term Memory-Augmented Transformer for Multi-Object Trackingcited by 86
- 2024Multiple Object Tracking as ID Predictioncited by 58
- 2021TransCenter: Transformers with Dense Representations for Multiple-Object Trackingcited by 42
- 2022AnimalTrack: A Benchmark for Multi-Animal Tracking in the Wildcited by 37
- 2024NetTrack: Tracking Highly Dynamic Objects with a Netcited by 22
- 2024BuckTales : A multi-UAV dataset for multi-object tracking and re-identification of wild antelopescited by 14
- 2021Online Multiple Object Tracking with Cross-Task Synergycited by 12
- 2023A polar prediction model for learning to represent visual transformationscited by 6
Built on by
Not cited yet.