VALISENS: A Validated Innovative Multi-Sensor System for Cooperative Automated Driving
Not on the map. Why?
Abstract (arXiv)
Reliable perception remains a key challenge for Connected Automated Vehicles (CAVs) in complex real-world environments, where varying lighting conditions and adverse weather degrade sensing performance. While existing multi-sensor solutions improve local robustness, they remain constrained by limited sensing range, line-of-sight occlusions, and sensor failures on individual vehicles. This paper introduces VALISENS, a validated cooperative perception system that extends multi-sensor fusion beyond a single vehicle through Vehicle-to-Everything (V2X)-enabled collaboration between Connected Automated Vehicles (CAVs) and intelligent infrastructure. VALISENS integrates onboard and roadside LiDARs, radars, RGB cameras, and thermal cameras within a unified multi-agent perception framework. Thermal cameras enhances the detection of Vulnerable Road Users (VRUs) under challenging lighting conditions, while roadside sensors reduce occlusions and expand the effective perception range. In addition, an integrated sensor monitoring module continuously assesses sensor health and detects anomalies before system degradation occurs. The proposed system is implemented and evaluated in a dedicated real-world testbed. Experimental results show that VALISENS improves pedestrian situational awareness by up to 18% compared with vehicle-only sensing, while the sensor monitoring module achieves over 97% accuracy, demonstrating its effectiveness and its potential to support future Cooperative Intelligent Transport Systems (C-ITS) applications.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 29 of its 57 references that are in the map. First posted on arXiv 11 May 2025.
Builds on
29 of 57 references.
References · 29
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2022A ConvNet for the 2020scited by 3,579
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,715
- 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 941
- 2021Multiscale Vision Transformerscited by 897
- 2019PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detectioncited by 891
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 823
- 2023DETRs Beat YOLOs on Real-time Object Detectioncited by 533
- 2024YOLOv11: An Overview of the Key Architectural Enhancementscited by 425
17 more
- 2022DAIR-V2X: A Large-Scale Dataset for Vehicle-Infrastructure Cooperative 3D Object Detectioncited by 273
- 2022Robot Operating System 2: Design, Architecture, and Uses In The Wildcited by 199
- 2023V2V4Real: A Real-world Large-scale Dataset for Vehicle-to-Vehicle Cooperative Perceptioncited by 155
- 2023MTR++: Multi-Agent Motion Prediction with Symmetric Scene Modeling and Guided Intention Queryingcited by 140
- 2023V2X-Seq: A Large-Scale Sequential Dataset for Vehicle-Infrastructure Cooperative Perception and Forecastingcited by 114
- 2018Model Adaptation with Synthetic and Real Data for Semantic Dense Foggy Scene Understandingcited by 98
- 2022Rope3D: TheRoadside Perception Dataset for Autonomous Driving and Monocular 3D Object Detection Taskcited by 81
- 2022Boreas: A Multi-Season Autonomous Driving Datasetcited by 76
- 2024V2X-Real: a Large-Scale Dataset for Vehicle-to-Everything Cooperative Perceptioncited by 66
- 20204Seasons: A Cross-Season Dataset for Multi-Weather SLAM in Autonomous Drivingcited by 51
- 2022Model-Agnostic Multi-Agent Perception Frameworkcited by 51
- 2021Weather and Light Level Classification for Autonomous Driving: Dataset, Baseline and Active Learningcited by 20
- 2022Multi-modal Fusion Technology based on Vehicle Information: A Surveycited by 13
- 2025R-LiViT: A LiDAR-Visual-Thermal Dataset Enabling Vulnerable Road User Focused Roadside Perceptioncited by 9
- 2025Systematic Literature Review on Vehicular Collaborative Perception -- A Computer Vision Perspectivecited by 5
- 2022DSRC & C-V2X Comparison for Connected and Automated Vehicles in Different Traffic Scenarioscited by 2
- 2025The Components of Collaborative Joint Perception and Prediction -- A Conceptual Frameworkcited by 2
Built on by
Citing papers per year: 2025: 1.
1 paper.