End-to-end Learning of Multi-sensor 3D Tracking by Detection
Not on the map. Why?
Abstract (arXiv)
In this paper we propose a novel approach to tracking by detection that can exploit both cameras as well as LIDAR data to produce very accurate 3D trajectories. Towards this goal, we formulate the problem as a linear program that can be solved exactly, and learn convolutional networks for detection as well as matching in an end-to-end manner. We evaluate our model in the challenging KITTI dataset and show very competitive results.
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Jun 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 10; 2023: 3; 2024: 2.
25 papers.
Sort:
By area:
- 2022Global Tracking Transformerscited by 110
- 2021Invisible for both Camera and LiDAR: Security of Multi-Sensor Fusion based Perception in Autonomous Driving Under Physical-World Attackscited by 101
- 2021EagerMOT: 3D Multi-Object Tracking via Sensor Fusioncited by 83
- 2021Monocular Quasi-Dense 3D Object Trackingcited by 80
- 20214D Panoptic LiDAR Segmentationcited by 64
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
- 20213D-SiamRPN: An End-to-End Learning Method for Real-Time 3D Single Object Tracking Using Raw Point Cloudcited by 45
- 2022DeepFusionMOT: A 3D Multi-Object Tracking Framework Based on Camera-LiDAR Fusion with Deep Associationcited by 33
- 2022PolarMOT: How Far Can Geometric Relations Take Us in 3D Multi-Object Tracking?cited by 29
- 2022Forecasting from LiDAR via Future Object Detectioncited by 28
- 20223D Multi-Object Tracking Using Graph Neural Networks with Cross-Edge Modality Attentioncited by 27
- 2021Joint Multi-Object Detection and Tracking with Camera-LiDAR Fusion for Autonomous Drivingcited by 26
13 more
- 2022SoK: On the Semantic AI Security in Autonomous Drivingcited by 22
- 2021TrackMPNN: A Message Passing Graph Neural Architecture for Multi-Object Trackingcited by 21
- 2021Making Higher Order MOT Scalable: An Efficient Approximate Solver for Lifted Disjoint Pathscited by 19
- 2022Learning of Global Objective for Network Flow in Multi-Object Trackingcited by 11
- 2022Multi-Object Tracking and Segmentation via Neural Message Passingcited by 9
- 2024PNAS-MOT: Multi-Modal Object Tracking with Pareto Neural Architecture Searchcited by 9
- 2022Sequential Point Clouds: A Surveycited by 5
- 2022Interactive Multi-scale Fusion of 2D and 3D Features for Multi-object Trackingcited by 4
- 2023Privacy-preserving Pedestrian Tracking using Distributed 3D LiDARscited by 3
- 2024Navigating Threats: A Survey of Physical Adversarial Attacks on LiDAR Perception Systems in Autonomous Vehiclescited by 3
- 2023A survey on deep learning approaches for data integration in autonomous driving systemcited by 1
- 2021A Pedestrian Detection and Tracking Framework for Autonomous Cars: Efficient Fusion of Camera and LiDAR Datacited by 0
- 2023GOOD: General Optimization-based Fusion for 3D Object Detection via LiDAR-Camera Object Candidatescited by 0
- 2024Navigating Threats: A Survey of Physical Adversarial Attacks on LiDAR Perception Systems in Autonomous Vehicles30 Sep 2024
- 2024PNAS-MOT: Multi-Modal Object Tracking with Pareto Neural Architecture Search23 Mar 2024
- 2023A survey on deep learning approaches for data integration in autonomous driving system17 Jun 2023
- 2023Privacy-preserving Pedestrian Tracking using Distributed 3D LiDARs17 Mar 2023
- 2023GOOD: General Optimization-based Fusion for 3D Object Detection via LiDAR-Camera Object Candidates17 Mar 2023
- 2022PolarMOT: How Far Can Geometric Relations Take Us in 3D Multi-Object Tracking?3 Aug 2022
- 2022Multi-Object Tracking and Segmentation via Neural Message Passing15 Jul 2022
- 2022Sequential Point Clouds: A Survey20 Apr 2022
- 2022Forecasting from LiDAR via Future Object Detection30 Mar 2022
- 2022Interactive Multi-scale Fusion of 2D and 3D Features for Multi-object Tracking30 Mar 2022
- 2022Learning of Global Objective for Network Flow in Multi-Object Tracking30 Mar 2022
- 2022Global Tracking Transformers24 Mar 2022
13 more
- 20223D Multi-Object Tracking Using Graph Neural Networks with Cross-Edge Modality Attention21 Mar 2022
- 2022SoK: On the Semantic AI Security in Autonomous Driving10 Mar 2022
- 2022DeepFusionMOT: A 3D Multi-Object Tracking Framework Based on Camera-LiDAR Fusion with Deep Association24 Feb 2022
- 2021A Pedestrian Detection and Tracking Framework for Autonomous Cars: Efficient Fusion of Camera and LiDAR Data27 Aug 2021
- 2021Making Higher Order MOT Scalable: An Efficient Approximate Solver for Lifted Disjoint Paths24 Aug 2021
- 20213D-SiamRPN: An End-to-End Learning Method for Real-Time 3D Single Object Tracking Using Raw Point Cloud12 Aug 2021
- 2021Joint Multi-Object Detection and Tracking with Camera-LiDAR Fusion for Autonomous Driving10 Aug 2021
- 2021Invisible for both Camera and LiDAR: Security of Multi-Sensor Fusion based Perception in Autonomous Driving Under Physical-World Attacks17 Jun 2021
- 2021EagerMOT: 3D Multi-Object Tracking via Sensor Fusion29 Apr 2021
- 2021Monocular Quasi-Dense 3D Object Tracking12 Mar 2021
- 20214D Panoptic LiDAR Segmentation24 Feb 2021
- 2021TrackMPNN: A Message Passing Graph Neural Architecture for Multi-Object Tracking11 Jan 2021
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Survey2 Jan 2021
- 2022Global Tracking Transformerscited by 110
- 2021EagerMOT: 3D Multi-Object Tracking via Sensor Fusioncited by 83
- 2021Monocular Quasi-Dense 3D Object Trackingcited by 80
- 20214D Panoptic LiDAR Segmentationcited by 64
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
- 20213D-SiamRPN: An End-to-End Learning Method for Real-Time 3D Single Object Tracking Using Raw Point Cloudcited by 45
- 2022DeepFusionMOT: A 3D Multi-Object Tracking Framework Based on Camera-LiDAR Fusion with Deep Associationcited by 33
- 2022PolarMOT: How Far Can Geometric Relations Take Us in 3D Multi-Object Tracking?cited by 29
- 2022Forecasting from LiDAR via Future Object Detectioncited by 28
- 20223D Multi-Object Tracking Using Graph Neural Networks with Cross-Edge Modality Attentioncited by 27
- 2021Joint Multi-Object Detection and Tracking with Camera-LiDAR Fusion for Autonomous Drivingcited by 26
- 2022SoK: On the Semantic AI Security in Autonomous Drivingcited by 22
12 most cited of 24 All 24 (JSON)
- 2024Navigating Threats: A Survey of Physical Adversarial Attacks on LiDAR Perception Systems in Autonomous Vehicles30 Sep 2024
- 2024PNAS-MOT: Multi-Modal Object Tracking with Pareto Neural Architecture Search23 Mar 2024
- 2023A survey on deep learning approaches for data integration in autonomous driving system17 Jun 2023
- 2023Privacy-preserving Pedestrian Tracking using Distributed 3D LiDARs17 Mar 2023
- 2023GOOD: General Optimization-based Fusion for 3D Object Detection via LiDAR-Camera Object Candidates17 Mar 2023
- 2022PolarMOT: How Far Can Geometric Relations Take Us in 3D Multi-Object Tracking?3 Aug 2022
- 2022Multi-Object Tracking and Segmentation via Neural Message Passing15 Jul 2022
- 2022Sequential Point Clouds: A Survey20 Apr 2022
- 2022Forecasting from LiDAR via Future Object Detection30 Mar 2022
- 2022Interactive Multi-scale Fusion of 2D and 3D Features for Multi-object Tracking30 Mar 2022
- 2022Learning of Global Objective for Network Flow in Multi-Object Tracking30 Mar 2022
- 2022Global Tracking Transformers24 Mar 2022
12 newest of 24 All 24 (JSON)