Track without Appearance: Learn Box and Tracklet Embedding with Local and Global Motion Patterns for Vehicle Tracking
Not on the map. Why?
Abstract (arXiv)
Vehicle tracking is an essential task in the multi-object tracking (MOT) field. A distinct characteristic in vehicle tracking is that the trajectories of vehicles are fairly smooth in both the world coordinate and the image coordinate. Hence, models that capture motion consistencies are of high necessity. However, tracking with the standalone motion-based trackers is quite challenging because targets could get lost easily due to limited information, detection error and occlusion. Leveraging appearance information to assist object re-identification could resolve this challenge to some extent. However, doing so requires extra computation while appearance information is sensitive to occlusion as well. In this paper, we try to explore the significance of motion patterns for vehicle tracking without appearance information. We propose a novel approach that tackles the association issue for long-term tracking with the exclusive fully-exploited motion information. We address the tracklet embedding issue with the proposed reconstruct-to-embed strategy based on deep graph convolutional neural networks (GCN). Comprehensive experiments on the KITTI-car tracking dataset and UA-Detrac dataset show that the proposed method, though without appearance information, could achieve competitive performance with the state-of-the-art (SOTA) trackers. The source code will be available at https://github.com/GaoangW/LGMTracker.
Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). Builds on 37 of its 70 references that are in the map. First posted on arXiv 13 Aug 2021.
Builds on
37 of 70 references.
References · 37
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2017Graph Attention Networkscited by 8,854
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2019Objects as Pointscited by 1,172
- 2016Simple Online and Realtime Trackingcited by 862
- 2016Language Modeling with Gated Convolutional Networkscited by 688
- 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
- 2020HOTA: A Higher Order Metric for Evaluating Multi-Object Trackingcited by 546
- 2016MOT16: A Benchmark for Multi-Object Trackingcited by 531
- 2021TrackFormer: Multi-Object Tracking with Transformerscited by 515
- 2020Tracking Objects as Pointscited by 483
25 more
- 2019Tracking without bells and whistlescited by 382
- 2020TransTrack: Multiple Object Tracking with Transformercited by 370
- 2019Learning a Neural Solver for Multiple Object Trackingcited by 198
- 2019CityFlow: A City-Scale Benchmark for Multi-Target Multi-Camera Vehicle Tracking and Re-Identificationcited by 119
- 2020Chained-Tracker: Chaining Paired Attentive Regression Results for End-to-End Joint Multiple-Object Detection and Trackingcited by 115
- 2020GNN3DMOT: Graph Neural Network for 3D Multi-Object Tracking with Multi-Feature Learningcited by 113
- 2015UA-DETRAC: A New Benchmark and Protocol for Multi-Object Detection and Trackingcited by 98
- 2018Joint Monocular 3D Vehicle Detection and Trackingcited by 77
- 2019How To Train Your Deep Multi-Object Trackercited by 71
- 2020TubeTK: Adopting Tubes to Track Multi-Object in a One-Step Training Modelcited by 70
- 2019FAMNet: Joint Learning of Feature, Affinity and Multi-dimensional Assignment for Online Multiple Object Trackingcited by 65
- 2020Lifted Disjoint Paths with Application in Multiple Object Trackingcited by 55
- 2019Track to Reconstruct and Reconstruct to Trackcited by 49
- 2017Recurrent Autoregressive Networks for Online Multi-Object Trackingcited by 48
- 2015Near-Online Multi-target Tracking with Aggregated Local Flow Descriptorcited by 46
- 2020JRMOT: A Real-Time 3D Multi-Object Tracker and a New Large-Scale Datasetcited by 39
- 2018Exploit the Connectivity: Multi-Object Tracking with TrackletNetcited by 30
- 2015Learning Complexity-Aware Cascades for Deep Pedestrian Detectioncited by 18
- 2020Joint Object Detection and Multi-Object Tracking with Graph Neural Networkscited by 14
- 2020Exploring Severe Occlusion: Multi-Person 3D Pose Estimation with Gated Convolutioncited by 9
- 2014FollowMe: Efficient Online Min-Cost Flow Tracking with Bounded Memory and Computationcited by 8
- 2016Learning Optimal Parameters for Multi-target Tracking with Contextual Interactionscited by 8
- 2016A Multi-cut Formulation for Joint Segmentation and Tracking of Multiple Objectscited by 7
- 2020Tracklets Predicting Based Adaptive Graph Trackingcited by 6
- 2015Tracking Live Fish from Low-Contrast and Low-Frame-Rate Stereo Videoscited by 4
Built on by
Citing papers per year: 2021: 1; 2022: 8; 2023: 8; 2024: 9.
26 papers.
Sort:
By area:
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 345
- 2022StrongSORT: Make DeepSORT Great Againcited by 213
- 2022CAMO-MOT: Combined Appearance-Motion Optimization for 3D Multi-Object Tracking with Camera-LiDAR Fusioncited by 50
- 2022DeepFusionMOT: A 3D Multi-Object Tracking Framework Based on Camera-LiDAR Fusion with Deep Associationcited by 33
- 2022TripletTrack: 3D Object Tracking using Triplet Embeddings and LSTMcited by 26
- 2024EchoTrack: Auditory Referring Multi-Object Tracking for Autonomous Drivingcited by 18
- 2023DIVOTrack: A Novel Dataset and Baseline Method for Cross-View Multi-Object Tracking in DIVerse Open Scenescited by 17
- 2024Self-Supervised Multi-Object Tracking with Path Consistencycited by 16
- 2022In Pursuit of Many: A Review of Modern Multiple Object Tracking Systemscited by 12
- 2023CenterRadarNet: Joint 3D Object Detection and Tracking Framework using 4D FMCW Radarcited by 9
- 2022Recent Advances in Embedding Methods for Multi-Object Tracking: A Surveycited by 8
- 2023Ego-Vehicle Action Recognition based on Semi-Supervised Contrastive Learningcited by 8
14 more
- 2023You Only Need Two Detectors to Achieve Multi-Modal 3D Multi-Object Trackingcited by 8
- 2024Learning Data Association for Multi-Object Tracking using Only Coordinatescited by 8
- 2024Ego3DT: Tracking Every 3D Object in Ego-centric Videoscited by 7
- 2022Hierarchical Semi-Supervised Contrastive Learning for Contamination-Resistant Anomaly Detectioncited by 5
- 2023Single-Shot and Multi-Shot Feature Learning for Multi-Object Trackingcited by 5
- 2023Tracking Objects with 3D Representation from Videoscited by 2
- 2024CrossTracker: Robust Multi-modal 3D Multi-Object Tracking via Cross Correctioncited by 2
- 2021Tracklet-Switch Adversarial Attack against Pedestrian Multi-Object Tracking Trackerscited by 1
- 2023Towards Effective Multi-Moving-Camera Tracking: A New Dataset and Lightweight Link Modelcited by 1
- 2024AM-SORT: Adaptable Motion Predictor with Historical Trajectory Embedding for Multi-Object Trackingcited by 1
- 2024Heterogeneous Graph Transformer for Multiple Tiny Object Tracking in RGB-T Videoscited by 1
- 2023S3Track: Self-supervised Tracking with Soft Assignment Flowcited by 0
- 2024Hierarchical IoU Tracking based on Intervalcited by 0
- 2024RegTrack: Simplicity Beneath Complexity in Robust Multi-Modal 3D Multi-Object Trackingcited by 0
- 2024Heterogeneous Graph Transformer for Multiple Tiny Object Tracking in RGB-T Videos14 Dec 2024
- 2024CrossTracker: Robust Multi-modal 3D Multi-Object Tracking via Cross Correction28 Nov 2024
- 2024Ego3DT: Tracking Every 3D Object in Ego-centric Videos11 Oct 2024
- 2024RegTrack: Simplicity Beneath Complexity in Robust Multi-Modal 3D Multi-Object Tracking1 Sep 2024
- 2024Hierarchical IoU Tracking based on Interval19 Jun 2024
- 2024Self-Supervised Multi-Object Tracking with Path Consistency8 Apr 2024
- 2024Learning Data Association for Multi-Object Tracking using Only Coordinates12 Mar 2024
- 2024EchoTrack: Auditory Referring Multi-Object Tracking for Autonomous Driving28 Feb 2024
- 2024AM-SORT: Adaptable Motion Predictor with Historical Trajectory Embedding for Multi-Object Tracking25 Jan 2024
- 2023Towards Effective Multi-Moving-Camera Tracking: A New Dataset and Lightweight Link Model18 Dec 2023
- 2023Single-Shot and Multi-Shot Feature Learning for Multi-Object Tracking17 Nov 2023
- 2023CenterRadarNet: Joint 3D Object Detection and Tracking Framework using 4D FMCW Radar2 Nov 2023
14 more
- 2023Tracking Objects with 3D Representation from Videos8 Jun 2023
- 2023S3Track: Self-supervised Tracking with Soft Assignment Flow17 May 2023
- 2023You Only Need Two Detectors to Achieve Multi-Modal 3D Multi-Object Tracking18 Apr 2023
- 2023Ego-Vehicle Action Recognition based on Semi-Supervised Contrastive Learning2 Mar 2023
- 2023DIVOTrack: A Novel Dataset and Baseline Method for Cross-View Multi-Object Tracking in DIVerse Open Scenes15 Feb 2023
- 2022TripletTrack: 3D Object Tracking using Triplet Embeddings and LSTM28 Oct 2022
- 2022In Pursuit of Many: A Review of Modern Multiple Object Tracking Systems11 Sep 2022
- 2022CAMO-MOT: Combined Appearance-Motion Optimization for 3D Multi-Object Tracking with Camera-LiDAR Fusion6 Sep 2022
- 2022Hierarchical Semi-Supervised Contrastive Learning for Contamination-Resistant Anomaly Detection24 Jul 2022
- 2022Recent Advances in Embedding Methods for Multi-Object Tracking: A Survey22 May 2022
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Tracking27 Mar 2022
- 2022StrongSORT: Make DeepSORT Great Again28 Feb 2022
- 2022DeepFusionMOT: A 3D Multi-Object Tracking Framework Based on Camera-LiDAR Fusion with Deep Association24 Feb 2022
- 2021Tracklet-Switch Adversarial Attack against Pedestrian Multi-Object Tracking Trackers17 Nov 2021
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 345
- 2022StrongSORT: Make DeepSORT Great Againcited by 213
- 2022CAMO-MOT: Combined Appearance-Motion Optimization for 3D Multi-Object Tracking with Camera-LiDAR Fusioncited by 50
- 2022DeepFusionMOT: A 3D Multi-Object Tracking Framework Based on Camera-LiDAR Fusion with Deep Associationcited by 33
- 2022TripletTrack: 3D Object Tracking using Triplet Embeddings and LSTMcited by 26
- 2023DIVOTrack: A Novel Dataset and Baseline Method for Cross-View Multi-Object Tracking in DIVerse Open Scenescited by 17
- 2024Self-Supervised Multi-Object Tracking with Path Consistencycited by 16
- 2022In Pursuit of Many: A Review of Modern Multiple Object Tracking Systemscited by 12
- 2023CenterRadarNet: Joint 3D Object Detection and Tracking Framework using 4D FMCW Radarcited by 9
- 2022Recent Advances in Embedding Methods for Multi-Object Tracking: A Surveycited by 8
- 2023Ego-Vehicle Action Recognition based on Semi-Supervised Contrastive Learningcited by 8
- 2023You Only Need Two Detectors to Achieve Multi-Modal 3D Multi-Object Trackingcited by 8
12 most cited of 24 All 24 (JSON)
- 2024Heterogeneous Graph Transformer for Multiple Tiny Object Tracking in RGB-T Videos14 Dec 2024
- 2024CrossTracker: Robust Multi-modal 3D Multi-Object Tracking via Cross Correction28 Nov 2024
- 2024Ego3DT: Tracking Every 3D Object in Ego-centric Videos11 Oct 2024
- 2024Hierarchical IoU Tracking based on Interval19 Jun 2024
- 2024Self-Supervised Multi-Object Tracking with Path Consistency8 Apr 2024
- 2024Learning Data Association for Multi-Object Tracking using Only Coordinates12 Mar 2024
- 2024AM-SORT: Adaptable Motion Predictor with Historical Trajectory Embedding for Multi-Object Tracking25 Jan 2024
- 2023Towards Effective Multi-Moving-Camera Tracking: A New Dataset and Lightweight Link Model18 Dec 2023
- 2023Single-Shot and Multi-Shot Feature Learning for Multi-Object Tracking17 Nov 2023
- 2023CenterRadarNet: Joint 3D Object Detection and Tracking Framework using 4D FMCW Radar2 Nov 2023
- 2023Tracking Objects with 3D Representation from Videos8 Jun 2023
- 2023S3Track: Self-supervised Tracking with Soft Assignment Flow17 May 2023
12 newest of 24 All 24 (JSON)