Providentia -- A Large-Scale Sensor System for the Assistance of Autonomous Vehicles and Its Evaluation
Not on the map. Why?
Abstract (arXiv)
The environmental perception of an autonomous vehicle is limited by its physical sensor ranges and algorithmic performance, as well as by occlusions that degrade its understanding of an ongoing traffic situation. This not only poses a significant threat to safety and limits driving speeds, but it can also lead to inconvenient maneuvers. Intelligent Infrastructure Systems can help to alleviate these problems. An Intelligent Infrastructure System can fill in the gaps in a vehicle's perception and extend its field of view by providing additional detailed information about its surroundings, in the form of a digital model of the current traffic situation, i.e. a digital twin. However, detailed descriptions of such systems and working prototypes demonstrating their feasibility are scarce. In this paper, we propose a hardware and software architecture that enables such a reliable Intelligent Infrastructure System to be built. We have implemented this system in the real world and demonstrate its ability to create an accurate digital twin of an extended highway stretch, thus enhancing an autonomous vehicle's perception beyond the limits of its on-board sensors. Furthermore, we evaluate the accuracy and reliability of the digital twin by using aerial images and earth observation methods for generating ground truth data.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 3; 2023: 4; 2024: 6; 2025: 1; 2026: 2.
17 papers.
Sort:
By area:
- 2024TUMTraf V2X Cooperative Perception Datasetcited by 66
- 2022A9-Dataset: Multi-Sensor Infrastructure-Based Dataset for Mobility Researchcited by 40
- 2023InfraDet3D: Multi-Modal 3D Object Detection based on Roadside Infrastructure Camera and LiDAR Sensorscited by 25
- 2024ActiveAnno3D -- An Active Learning Framework for Multi-Modal 3D Object Detectioncited by 17
- 2024TUMTraf Event: Calibration and Fusion Resulting in a Dataset for Roadside Event-Based and RGB Camerascited by 13
- 2022Real-Time and Robust 3D Object Detection Within Road-Side LiDARs Using Domain Adaptationcited by 10
- 2021A Review of Testing Object-Based Environment Perception for Safe Automated Drivingcited by 9
- 2022Real-Time And Robust 3D Object Detection with Roadside LiDARscited by 9
- 2023CAROM Air -- Vehicle Localization and Traffic Scene Reconstruction from Aerial Videoscited by 7
- 2023A9 Intersection Dataset: All You Need for Urban 3D Camera-LiDAR Roadside Perceptioncited by 4
- 2024Soar: Design and Deployment of A Smart Roadside Infrastructure System for Autonomous Drivingcited by 4
- 2023RMMDet: Road-Side Multitype and Multigroup Sensor Detection System for Autonomous Drivingcited by 3
5 more
- 2025Towards Vision Zero: The TUM Traffic Accid3nD Datasetcited by 2
- 2024Cooperative Visual-LiDAR Extrinsic Calibration Technology for Intersection Vehicle-Infrastructure: A reviewcited by 1
- 2024Augmented Intelligence in Smart Intersections: Local Digital Twins-Assisted Hybrid Autonomous Drivingcited by 1
- 2026RESOLVE: A Multi-Resolution and Multi-Modal Dataset for Roadside Cooperative Perceptioncited by 1
- 2026SGTA: Scene-Graph Based Multi-Modal Traffic Agent for Video Understandingcited by 0
- 2026RESOLVE: A Multi-Resolution and Multi-Modal Dataset for Roadside Cooperative Perception30 Jun 2026
- 2026SGTA: Scene-Graph Based Multi-Modal Traffic Agent for Video Understanding4 Apr 2026
- 2025Towards Vision Zero: The TUM Traffic Accid3nD Dataset15 Mar 2025
- 2024Augmented Intelligence in Smart Intersections: Local Digital Twins-Assisted Hybrid Autonomous Driving16 Oct 2024
- 2024Cooperative Visual-LiDAR Extrinsic Calibration Technology for Intersection Vehicle-Infrastructure: A review16 May 2024
- 2024Soar: Design and Deployment of A Smart Roadside Infrastructure System for Autonomous Driving21 Apr 2024
- 2024TUMTraf V2X Cooperative Perception Dataset2 Mar 2024
- 2024ActiveAnno3D -- An Active Learning Framework for Multi-Modal 3D Object Detection5 Feb 2024
- 2024TUMTraf Event: Calibration and Fusion Resulting in a Dataset for Roadside Event-Based and RGB Cameras16 Jan 2024
- 2023A9 Intersection Dataset: All You Need for Urban 3D Camera-LiDAR Roadside Perception15 Jun 2023
- 2023CAROM Air -- Vehicle Localization and Traffic Scene Reconstruction from Aerial Videos31 May 2023
- 2023InfraDet3D: Multi-Modal 3D Object Detection based on Roadside Infrastructure Camera and LiDAR Sensors29 Apr 2023
5 more
- 2023RMMDet: Road-Side Multitype and Multigroup Sensor Detection System for Autonomous Driving9 Mar 2023
- 2022Real-Time And Robust 3D Object Detection with Roadside LiDARs11 Jul 2022
- 2022A9-Dataset: Multi-Sensor Infrastructure-Based Dataset for Mobility Research13 Apr 2022
- 2022Real-Time and Robust 3D Object Detection Within Road-Side LiDARs Using Domain Adaptation31 Mar 2022
- 2021A Review of Testing Object-Based Environment Perception for Safe Automated Driving16 Feb 2021
- 2024TUMTraf V2X Cooperative Perception Datasetcited by 66
- 2022A9-Dataset: Multi-Sensor Infrastructure-Based Dataset for Mobility Researchcited by 40
- 2023InfraDet3D: Multi-Modal 3D Object Detection based on Roadside Infrastructure Camera and LiDAR Sensorscited by 25
- 2024ActiveAnno3D -- An Active Learning Framework for Multi-Modal 3D Object Detectioncited by 17
- 2024TUMTraf Event: Calibration and Fusion Resulting in a Dataset for Roadside Event-Based and RGB Camerascited by 13
- 2022Real-Time and Robust 3D Object Detection Within Road-Side LiDARs Using Domain Adaptationcited by 10
- 2021A Review of Testing Object-Based Environment Perception for Safe Automated Drivingcited by 9
- 2022Real-Time And Robust 3D Object Detection with Roadside LiDARscited by 9
- 2023CAROM Air -- Vehicle Localization and Traffic Scene Reconstruction from Aerial Videoscited by 7
- 2023A9 Intersection Dataset: All You Need for Urban 3D Camera-LiDAR Roadside Perceptioncited by 4
- 2024Soar: Design and Deployment of A Smart Roadside Infrastructure System for Autonomous Drivingcited by 4
- 2023RMMDet: Road-Side Multitype and Multigroup Sensor Detection System for Autonomous Drivingcited by 3
12 most cited of 16 All 16 (JSON)
- 2026RESOLVE: A Multi-Resolution and Multi-Modal Dataset for Roadside Cooperative Perception30 Jun 2026
- 2026SGTA: Scene-Graph Based Multi-Modal Traffic Agent for Video Understanding4 Apr 2026
- 2025Towards Vision Zero: The TUM Traffic Accid3nD Dataset15 Mar 2025
- 2024Cooperative Visual-LiDAR Extrinsic Calibration Technology for Intersection Vehicle-Infrastructure: A review16 May 2024
- 2024Soar: Design and Deployment of A Smart Roadside Infrastructure System for Autonomous Driving21 Apr 2024
- 2024TUMTraf V2X Cooperative Perception Dataset2 Mar 2024
- 2024ActiveAnno3D -- An Active Learning Framework for Multi-Modal 3D Object Detection5 Feb 2024
- 2024TUMTraf Event: Calibration and Fusion Resulting in a Dataset for Roadside Event-Based and RGB Cameras16 Jan 2024
- 2023A9 Intersection Dataset: All You Need for Urban 3D Camera-LiDAR Roadside Perception15 Jun 2023
- 2023CAROM Air -- Vehicle Localization and Traffic Scene Reconstruction from Aerial Videos31 May 2023
- 2023InfraDet3D: Multi-Modal 3D Object Detection based on Roadside Infrastructure Camera and LiDAR Sensors29 Apr 2023
- 2023RMMDet: Road-Side Multitype and Multigroup Sensor Detection System for Autonomous Driving9 Mar 2023
12 newest of 16 All 16 (JSON)