Vehicle-to-Everything Cooperative Perception for Autonomous Driving
Not on the map. Why?
Abstract (arXiv)
Achieving fully autonomous driving with enhanced safety and efficiency relies on vehicle-to-everything cooperative perception, which enables vehicles to share perception data, thereby enhancing situational awareness and overcoming the limitations of the sensing ability of individual vehicles. Vehicle-to-everything cooperative perception plays a crucial role in extending the perception range, increasing detection accuracy, and supporting more robust decision-making and control in complex environments. This paper provides a comprehensive survey of recent developments in vehicle-to-everything cooperative perception, introducing mathematical models that characterize the perception process under different collaboration strategies. Key techniques for enabling reliable perception sharing, such as agent selection, data alignment, and feature fusion, are examined in detail. In addition, major challenges are discussed, including differences in agents and models, uncertainty in perception outputs, and the impact of communication constraints such as transmission delay and data loss. The paper concludes by outlining promising research directions, including privacy-preserving artificial intelligence methods, collaborative intelligence, and integrated sensing frameworks to support future advancements in vehicle-to-everything cooperative perception.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 98 of its 237 references that are in the map. First posted on arXiv 5 Oct 2023.
Builds on
98 of 237 references.
References · 98
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2017Squeeze-and-Excitation Networkscited by 4,789
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
- 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,694
- 2020Point Transformercited by 1,470
- 2018Variational image compression with a scale hyperpriorcited by 935
- 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 792
- 2018Evidential Deep Learning to Quantify Classification Uncertaintycited by 732
- 2019Introduction to Multi-Armed Banditscited by 481
- 2018A Survey of Unsupervised Deep Domain Adaptationcited by 361
38 more
- 2022V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformercited by 320
- 2021OPV2V: An Open Benchmark Dataset and Fusion Pipeline for Perception with Vehicle-to-Vehicle Communicationcited by 304
- 2020V2VNet: Vehicle-to-Vehicle Communication for Joint Perception and Predictioncited by 292
- 2022DAIR-V2X: A Large-Scale Dataset for Vehicle-Infrastructure Cooperative 3D Object Detectioncited by 273
- 2022Where2comm: Communication-Efficient Collaborative Perception via Spatial Confidence Mapscited by 255
- 2022CoBEVT: Cooperative Bird's Eye View Semantic Segmentation with Sparse Transformerscited by 227
- 2023Scene as Occupancycited by 209
- 2021Learning Distilled Collaboration Graph for Multi-Agent Perceptioncited by 194
- 2023Universal Instance Perception as Object Discovery and Retrievalcited by 192
- 2019F-Cooper: Feature based Cooperative Perception for Autonomous Vehicle Edge Computing System Using 3D Point Cloudscited by 171
- 2019Cooper: Cooperative Perception for Connected Autonomous Vehicles based on 3D Point Cloudscited by 165
- 2020When2com: Multi-Agent Perception via Communication Graph Groupingcited by 157
- 2022V2X-Sim: Multi-Agent Collaborative Perception Dataset and Benchmark for Autonomous Drivingcited by 157
- 2023V2V4Real: A Real-world Large-scale Dataset for Vehicle-to-Vehicle Cooperative Perceptioncited by 155
- 2022Robust Collaborative 3D Object Detection in Presence of Pose Errorscited by 129
- 2020Who2com: Collaborative Perception via Learnable Handshake Communicationcited by 127
- 2023V2X-Seq: A Large-Scale Sequential Dataset for Vehicle-Infrastructure Cooperative Perception and Forecastingcited by 114
- 2019Cooperative Perception for 3D Object Detection in Driving Scenarios using Infrastructure Sensorscited by 110
- 2022COOPERNAUT: End-to-End Driving with Cooperative Perception for Networked Vehiclescited by 95
- 2023Collaborative Perception in Autonomous Driving: Methods, Datasets and Challengescited by 87
- 2022Latency-Aware Collaborative Perceptioncited by 86
- 2023Collaboration Helps Camera Overtake LiDAR in 3D Detectioncited by 81
- 2023DeepAccident: A Motion and Accident Prediction Benchmark for V2X Autonomous Drivingcited by 73
- 2023HM-ViT: Hetero-modal Vehicle-to-Vehicle Cooperative perception with vision transformercited by 70
- 2022Bridging the Domain Gap for Multi-Agent Perceptioncited by 60
- 2023Asynchrony-Robust Collaborative Perception via Bird's Eye View Flowcited by 58
- 2023Spatio-Temporal Domain Awareness for Multi-Agent Collaborative Perceptioncited by 52
- 2022Model-Agnostic Multi-Agent Perception Frameworkcited by 51
- 2021Adversarial Attacks On Multi-Agent Communicationcited by 49
- 2022Learning for Vehicle-to-Vehicle Cooperative Perception under Lossy Communicationcited by 47
- 2020Learning to Communicate and Correct Pose Errorscited by 46
- 2022Uncertainty Quantification of Collaborative Detection for Self-Drivingcited by 46
- 2021Keypoints-Based Deep Feature Fusion for Cooperative Vehicle Detection of Autonomous Drivingcited by 45
- 2023CORE: Cooperative Reconstruction for Multi-Agent Perceptioncited by 41
- 2023Federated Learning for Connected and Automated Vehicles: A Survey of Existing Approaches and Challengescited by 40
- 2023Towards Vehicle-to-everything Autonomous Driving: A Survey on Collaborative Perceptioncited by 38
- 2023Among Us: Adversarially Robust Collaborative Perception by Consensuscited by 37
- 2019Learning an Uncertainty-Aware Object Detector for Autonomous Drivingcited by 34
50 most cited of 98 All 98 (JSON)
Built on by
Citing papers per year: 2025: 4; 2026: 11.
15 papers.
Sort:
By area:
- 2025V2X-UniPool: Unifying Multimodal Perception and Knowledge Reasoning for Autonomous Drivingcited by 14
- 2025Generative AI for Autonomous Driving: Frontiers and Opportunitiescited by 7
- 2025Systematic Literature Review on Vehicular Collaborative Perception -- A Computer Vision Perspectivecited by 5
- 2026WhisperNet: A Scalable Solution for Bandwidth-Efficient Collaborationcited by 2
- 2026Infrastructure-Centric World Models: Bridging Temporal Depth and Spatial Breadth for Roadside Perceptioncited by 1
- 2026AFFormer: Adaptive Feature Fusion Transformer for V2X Cooperative Perception under Channel Impairmentscited by 1
- 2025A Survey on Deep Multi-Task Learning in Connected Autonomous Vehiclescited by 0
- 2026Towards Efficient 3D Object Detection for Vehicle-Infrastructure Collaboration via Risk-Intent Selectioncited by 0
- 2026Talk2DM: Enabling Natural Language Querying and Commonsense Reasoning for Vehicle-Road-Cloud Integrated Dynamic Maps with Large Language Modelscited by 0
- 2026Safety-Aligned 3D Object Detection: Single-Vehicle, Cooperative, and End-to-End Perspectivescited by 0
- 2026Unsupervised Multi-agent and Single-agent Perception from Cooperative Viewscited by 0
- 2026Adaptation-Free Heterogeneous Collaborative Perception with Unseen Agent Configurationscited by 0
3 more
- 2026HMS-SCP: Task-Oriented Multi-Scale Semantic Communication for V2X Cooperative Perceptioncited by 0
- 2026Risk-Adaptive Edge--Cloud Visual Reasoning for Communication-Efficient Autonomous Drivingcited by 0
- 2026CoCam4D: Geometry-Aware Cooperative 4D Perception for Camera-Only Autonomous Drivingcited by 0
- 2026CoCam4D: Geometry-Aware Cooperative 4D Perception for Camera-Only Autonomous Driving8 Oct 2026
- 2026Risk-Adaptive Edge--Cloud Visual Reasoning for Communication-Efficient Autonomous Driving15 Aug 2026
- 2026HMS-SCP: Task-Oriented Multi-Scale Semantic Communication for V2X Cooperative Perception3 Jul 2026
- 2026Adaptation-Free Heterogeneous Collaborative Perception with Unseen Agent Configurations26 May 2026
- 2026AFFormer: Adaptive Feature Fusion Transformer for V2X Cooperative Perception under Channel Impairments3 May 2026
- 2026Infrastructure-Centric World Models: Bridging Temporal Depth and Spatial Breadth for Roadside Perception19 Apr 2026
- 2026Unsupervised Multi-agent and Single-agent Perception from Cooperative Views7 Apr 2026
- 2026Safety-Aligned 3D Object Detection: Single-Vehicle, Cooperative, and End-to-End Perspectives2 Apr 2026
- 2026WhisperNet: A Scalable Solution for Bandwidth-Efficient Collaboration2 Mar 2026
- 2026Talk2DM: Enabling Natural Language Querying and Commonsense Reasoning for Vehicle-Road-Cloud Integrated Dynamic Maps with Large Language Models12 Feb 2026
- 2026Towards Efficient 3D Object Detection for Vehicle-Infrastructure Collaboration via Risk-Intent Selection6 Jan 2026
- 2025A Survey on Deep Multi-Task Learning in Connected Autonomous Vehicles29 Jul 2025
3 more
- 2025V2X-UniPool: Unifying Multimodal Perception and Knowledge Reasoning for Autonomous Drivingcited by 14
- 2026Talk2DM: Enabling Natural Language Querying and Commonsense Reasoning for Vehicle-Road-Cloud Integrated Dynamic Maps with Large Language Modelscited by 0
- 2026Risk-Adaptive Edge--Cloud Visual Reasoning for Communication-Efficient Autonomous Drivingcited by 0
- 2026Risk-Adaptive Edge--Cloud Visual Reasoning for Communication-Efficient Autonomous Driving15 Aug 2026
- 2026Talk2DM: Enabling Natural Language Querying and Commonsense Reasoning for Vehicle-Road-Cloud Integrated Dynamic Maps with Large Language Models12 Feb 2026
- 2025V2X-UniPool: Unifying Multimodal Perception and Knowledge Reasoning for Autonomous Driving3 Jun 2025
- 2025Systematic Literature Review on Vehicular Collaborative Perception -- A Computer Vision Perspectivecited by 5
- 2026WhisperNet: A Scalable Solution for Bandwidth-Efficient Collaborationcited by 2
- 2026AFFormer: Adaptive Feature Fusion Transformer for V2X Cooperative Perception under Channel Impairmentscited by 1
- 2025A Survey on Deep Multi-Task Learning in Connected Autonomous Vehiclescited by 0
- 2026Towards Efficient 3D Object Detection for Vehicle-Infrastructure Collaboration via Risk-Intent Selectioncited by 0
- 2026Unsupervised Multi-agent and Single-agent Perception from Cooperative Viewscited by 0
- 2026Adaptation-Free Heterogeneous Collaborative Perception with Unseen Agent Configurationscited by 0
- 2026HMS-SCP: Task-Oriented Multi-Scale Semantic Communication for V2X Cooperative Perceptioncited by 0
- 2026CoCam4D: Geometry-Aware Cooperative 4D Perception for Camera-Only Autonomous Drivingcited by 0
- 2026CoCam4D: Geometry-Aware Cooperative 4D Perception for Camera-Only Autonomous Driving8 Oct 2026
- 2026HMS-SCP: Task-Oriented Multi-Scale Semantic Communication for V2X Cooperative Perception3 Jul 2026
- 2026Adaptation-Free Heterogeneous Collaborative Perception with Unseen Agent Configurations26 May 2026
- 2026AFFormer: Adaptive Feature Fusion Transformer for V2X Cooperative Perception under Channel Impairments3 May 2026
- 2026Unsupervised Multi-agent and Single-agent Perception from Cooperative Views7 Apr 2026
- 2026WhisperNet: A Scalable Solution for Bandwidth-Efficient Collaboration2 Mar 2026
- 2026Towards Efficient 3D Object Detection for Vehicle-Infrastructure Collaboration via Risk-Intent Selection6 Jan 2026
- 2025A Survey on Deep Multi-Task Learning in Connected Autonomous Vehicles29 Jul 2025
- 2025Systematic Literature Review on Vehicular Collaborative Perception -- A Computer Vision Perspective6 Apr 2025