mlsanityData to 14 Oct 2026

VALISENS: A Validated Innovative Multi-Sensor System for Cooperative Automated Driving

arXiv 2505.06980 ↗First posted 11 May 2025cs.RO cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Reliable perception remains a key challenge for Connected Automated Vehicles (CAVs) in complex real-world environments, where varying lighting conditions and adverse weather degrade sensing performance. While existing multi-sensor solutions improve local robustness, they remain constrained by limited sensing range, line-of-sight occlusions, and sensor failures on individual vehicles. This paper introduces VALISENS, a validated cooperative perception system that extends multi-sensor fusion beyond a single vehicle through Vehicle-to-Everything (V2X)-enabled collaboration between Connected Automated Vehicles (CAVs) and intelligent infrastructure. VALISENS integrates onboard and roadside LiDARs, radars, RGB cameras, and thermal cameras within a unified multi-agent perception framework. Thermal cameras enhances the detection of Vulnerable Road Users (VRUs) under challenging lighting conditions, while roadside sensors reduce occlusions and expand the effective perception range. In addition, an integrated sensor monitoring module continuously assesses sensor health and detects anomalies before system degradation occurs. The proposed system is implemented and evaluated in a dedicated real-world testbed. Experimental results show that VALISENS improves pedestrian situational awareness by up to 18% compared with vehicle-only sensing, while the sensor monitoring module achieves over 97% accuracy, demonstrating its effectiveness and its potential to support future Cooperative Intelligent Transport Systems (C-ITS) applications.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 29 of its 57 references that are in the map. First posted on arXiv 11 May 2025.

Builds on

29 of 57 references.

References · 29

  1. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  2. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  3. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  4. 2022A ConvNet for the 2020scited by 3,579
  5. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
  6. 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,715
  7. 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 941
  8. 2021Multiscale Vision Transformerscited by 897
  9. 2019PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detectioncited by 891
  10. 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 823
  11. 2023DETRs Beat YOLOs on Real-time Object Detectioncited by 533
  12. 2024YOLOv11: An Overview of the Key Architectural Enhancementscited by 425
17 more
  1. 2022DAIR-V2X: A Large-Scale Dataset for Vehicle-Infrastructure Cooperative 3D Object Detectioncited by 273
  2. 2022Robot Operating System 2: Design, Architecture, and Uses In The Wildcited by 199
  3. 2023V2V4Real: A Real-world Large-scale Dataset for Vehicle-to-Vehicle Cooperative Perceptioncited by 155
  4. 2023MTR++: Multi-Agent Motion Prediction with Symmetric Scene Modeling and Guided Intention Queryingcited by 140
  5. 2023V2X-Seq: A Large-Scale Sequential Dataset for Vehicle-Infrastructure Cooperative Perception and Forecastingcited by 114
  6. 2018Model Adaptation with Synthetic and Real Data for Semantic Dense Foggy Scene Understandingcited by 98
  7. 2022Rope3D: TheRoadside Perception Dataset for Autonomous Driving and Monocular 3D Object Detection Taskcited by 81
  8. 2022Boreas: A Multi-Season Autonomous Driving Datasetcited by 76
  9. 2024V2X-Real: a Large-Scale Dataset for Vehicle-to-Everything Cooperative Perceptioncited by 66
  10. 20204Seasons: A Cross-Season Dataset for Multi-Weather SLAM in Autonomous Drivingcited by 51
  11. 2022Model-Agnostic Multi-Agent Perception Frameworkcited by 51
  12. 2021Weather and Light Level Classification for Autonomous Driving: Dataset, Baseline and Active Learningcited by 20
  13. 2022Multi-modal Fusion Technology based on Vehicle Information: A Surveycited by 13
  14. 2025R-LiViT: A LiDAR-Visual-Thermal Dataset Enabling Vulnerable Road User Focused Roadside Perceptioncited by 9
  15. 2025Systematic Literature Review on Vehicular Collaborative Perception -- A Computer Vision Perspectivecited by 5
  16. 2022DSRC & C-V2X Comparison for Connected and Automated Vehicles in Different Traffic Scenarioscited by 2
  17. 2025The Components of Collaborative Joint Perception and Prediction -- A Conceptual Frameworkcited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.