Infrastructure-Based Object Detection and Tracking for Cooperative Driving Automation: A Survey
Not on the map. Why?
Abstract (arXiv)
Object detection plays a fundamental role in enabling Cooperative Driving Automation (CDA), which is regarded as the revolutionary solution to addressing safety, mobility, and sustainability issues of contemporary transportation systems. Although current computer vision technologies could provide satisfactory object detection results in occlusion-free scenarios, the perception performance of onboard sensors could be inevitably limited by the range and occlusion. Owing to flexible position and pose for sensor installation, infrastructure-based detection and tracking systems can enhance the perception capability for connected vehicles and thus quickly become one of the most popular research topics. In this paper, we review the research progress for infrastructure-based object detection and tracking systems. Architectures of roadside perception systems based on different types of sensors are reviewed to show a high-level description of the workflows for infrastructure-based perception systems. Roadside sensors and different perception methodologies are reviewed and analyzed with detailed literature to provide a low-level explanation for specific methods followed by Datasets and Simulators to draw an overall landscape of infrastructure-based object detection and tracking methods. Discussions are conducted to point out current opportunities, open problems, and anticipated future trends.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 30 of its 92 references that are in the map. First posted on arXiv 28 Jan 2022.
Builds on
30 of 92 references.
References · 30
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2015SSD: Single Shot MultiBox Detectorcited by 3,125
- 2015Fast R-CNNcited by 2,930
- 2018YOLOv3: An Incremental Improvementcited by 2,652
18 more
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,160
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
- 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,624
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
- 2014Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognitioncited by 719
- 2019Object Detection in 20 Years: A Surveycited by 528
- 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 517
- 2018Deep Learning for Generic Object Detection: A Surveycited by 392
- 2016ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentationcited by 291
- 2020LGSVL Simulator: A High Fidelity Simulator for Autonomous Drivingcited by 119
- 2019Cooperative Perception for 3D Object Detection in Driving Scenarios using Infrastructure Sensorscited by 110
- 2018Complex-YOLO: Real-time 3D Object Detection on Point Cloudscited by 56
- 2019CBNet: A Novel Composite Backbone Network Architecture for Object Detectioncited by 44
- 2020Cooperative LIDAR Object Detection via Feature Sharing in Deep Networkscited by 19
- 2021BAAI-VANJEE Roadside Dataset: Towards the Connected Automated Vehicle Highway technologies in Challenging Environments of Chinacited by 19
- 2022Hybrid Reinforcement Learning-Based Eco-Driving Strategy for Connected and Automated Vehicles at Signalized Intersectionscited by 15
Built on by
Citing papers per year: 2022: 5; 2023: 3; 2024: 2; 2025: 3; 2026: 1.
14 papers.
Sort:
By area:
- 2022PillarGrid: Deep Learning-based Cooperative Perception for 3D Object Detection from Onboard-Roadside LiDARcited by 25
- 2023Vehicle-to-Everything Cooperative Perception for Autonomous Drivingcited by 15
- 2022Real-time Full-stack Traffic Scene Perception for Autonomous Driving with Roadside Camerascited by 13
- 2022VINet: Lightweight, Scalable, and Heterogeneous Cooperative Perception for 3D Object Detectioncited by 8
- 2022PointSee: Image Enhances Point Cloudcited by 5
- 2022Cyber Mobility Mirror: A Deep Learning-based Real-World Object Perception Platform Using Roadside LiDARcited by 3
- 2023Cooperverse: A Mobile-Edge-Cloud Framework for Universal Cooperative Perception with Mixed Connectivity and Automationcited by 3
- 2025MIC-BEV: Multi-Infrastructure Camera Bird's-Eye-View Transformer with Relation-Aware Fusion for 3D Object Detectioncited by 3
- 2024On the Federated Learning Framework for Cooperative Perceptioncited by 2
- 2025Event-based Optical Marker Systems: A surveycited by 1
- 2026Unleashing the Capabilities of Large Vision-Language Models for Intelligent Perception of Roadside Infrastructurecited by 1
- 2023Framework for Quality Evaluation of Smart Roadside Infrastructure Sensors for Automated Driving Applicationscited by 0
- 2026Unleashing the Capabilities of Large Vision-Language Models for Intelligent Perception of Roadside Infrastructure15 Jan 2026
- 2025Which LiDAR scanning pattern is better for roadside perception: Repetitive or Non-repetitive?28 Oct 2025
- 2025MIC-BEV: Multi-Infrastructure Camera Bird's-Eye-View Transformer with Relation-Aware Fusion for 3D Object Detection28 Oct 2025
- 2025Event-based Optical Marker Systems: A survey29 Apr 2025
- 2024On the Federated Learning Framework for Cooperative Perception26 Apr 2024
- 2024Optimized Information Flow for Transformer Tracking13 Feb 2024
- 2023Vehicle-to-Everything Cooperative Perception for Autonomous Driving5 Oct 2023
- 2023Framework for Quality Evaluation of Smart Roadside Infrastructure Sensors for Automated Driving Applications16 Apr 2023
- 2023Cooperverse: A Mobile-Edge-Cloud Framework for Universal Cooperative Perception with Mixed Connectivity and Automation6 Feb 2023
- 2022VINet: Lightweight, Scalable, and Heterogeneous Cooperative Perception for 3D Object Detection14 Dec 2022
- 2022PointSee: Image Enhances Point Cloud3 Nov 2022
- 2022Real-time Full-stack Traffic Scene Perception for Autonomous Driving with Roadside Cameras20 Jun 2022
- 2022PillarGrid: Deep Learning-based Cooperative Perception for 3D Object Detection from Onboard-Roadside LiDARcited by 25
- 2023Vehicle-to-Everything Cooperative Perception for Autonomous Drivingcited by 15
- 2022VINet: Lightweight, Scalable, and Heterogeneous Cooperative Perception for 3D Object Detectioncited by 8
- 2022PointSee: Image Enhances Point Cloudcited by 5
- 2022Cyber Mobility Mirror: A Deep Learning-based Real-World Object Perception Platform Using Roadside LiDARcited by 3
- 2023Cooperverse: A Mobile-Edge-Cloud Framework for Universal Cooperative Perception with Mixed Connectivity and Automationcited by 3
- 2025MIC-BEV: Multi-Infrastructure Camera Bird's-Eye-View Transformer with Relation-Aware Fusion for 3D Object Detectioncited by 3
- 2024On the Federated Learning Framework for Cooperative Perceptioncited by 2
- 2025Event-based Optical Marker Systems: A surveycited by 1
- 2023Framework for Quality Evaluation of Smart Roadside Infrastructure Sensors for Automated Driving Applicationscited by 0
- 2024Optimized Information Flow for Transformer Trackingcited by 0
- 2025Which LiDAR scanning pattern is better for roadside perception: Repetitive or Non-repetitive?cited by 0
- 2025Which LiDAR scanning pattern is better for roadside perception: Repetitive or Non-repetitive?28 Oct 2025
- 2025MIC-BEV: Multi-Infrastructure Camera Bird's-Eye-View Transformer with Relation-Aware Fusion for 3D Object Detection28 Oct 2025
- 2025Event-based Optical Marker Systems: A survey29 Apr 2025
- 2024On the Federated Learning Framework for Cooperative Perception26 Apr 2024
- 2024Optimized Information Flow for Transformer Tracking13 Feb 2024
- 2023Vehicle-to-Everything Cooperative Perception for Autonomous Driving5 Oct 2023
- 2023Framework for Quality Evaluation of Smart Roadside Infrastructure Sensors for Automated Driving Applications16 Apr 2023
- 2023Cooperverse: A Mobile-Edge-Cloud Framework for Universal Cooperative Perception with Mixed Connectivity and Automation6 Feb 2023
- 2022VINet: Lightweight, Scalable, and Heterogeneous Cooperative Perception for 3D Object Detection14 Dec 2022
- 2022PointSee: Image Enhances Point Cloud3 Nov 2022
- 2022PillarGrid: Deep Learning-based Cooperative Perception for 3D Object Detection from Onboard-Roadside LiDAR12 Mar 2022
- 2022Cyber Mobility Mirror: A Deep Learning-based Real-World Object Perception Platform Using Roadside LiDAR28 Feb 2022