V2XP-ASG: Generating Adversarial Scenes for Vehicle-to-Everything Perception
Not on the map. Why?
Abstract (arXiv)
Recent advancements in Vehicle-to-Everything communication technology have enabled autonomous vehicles to share sensory information to obtain better perception performance. With the rapid growth of autonomous vehicles and intelligent infrastructure, the V2X perception systems will soon be deployed at scale, which raises a safety-critical question: textithow can we evaluate and improve its performance under challenging traffic scenarios before the real-world deployment? Collecting diverse large-scale real-world test scenes seems to be the most straightforward solution, but it is expensive and time-consuming, and the collections can only cover limited scenarios. To this end, we propose the first open adversarial scene generator V2XP-ASG that can produce realistic, challenging scenes for modern LiDAR-based multi-agent perception systems. V2XP-ASG learns to construct an adversarial collaboration graph and simultaneously perturb multiple agents' poses in an adversarial and plausible manner. The experiments demonstrate that V2XP-ASG can effectively identify challenging scenes for a large range of V2X perception systems. Meanwhile, by training on the limited number of generated challenging scenes, the accuracy of V2X perception systems can be further improved by 12.3% on challenging and 4% on normal scenes. Our code will be released at https://github.com/XHwind/V2XP-ASG.
Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). Builds on 39 of its 65 references that are in the map. First posted on arXiv 27 Sep 2022.
Builds on
39 of 65 references.
References · 39
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
- 2022V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformercited by 320
- 2021OPV2V: An Open Benchmark Dataset and Fusion Pipeline for Perception with Vehicle-to-Vehicle Communicationcited by 304
- 2020V2VNet: Vehicle-to-Vehicle Communication for Joint Perception and Predictioncited by 292
- 2022DAIR-V2X: A Large-Scale Dataset for Vehicle-Infrastructure Cooperative 3D Object Detectioncited by 270
- 2022Where2comm: Communication-Efficient Collaborative Perception via Spatial Confidence Mapscited by 255
- 2022CoBEVT: Cooperative Bird's Eye View Semantic Segmentation with Sparse Transformerscited by 227
- 2021Learning Distilled Collaboration Graph for Multi-Agent Perceptioncited by 194
- 2021TrafficSim: Learning to Simulate Realistic Multi-Agent Behaviorscited by 192
- 2019Cooper: Cooperative Perception for Connected Autonomous Vehicles based on 3D Point Cloudscited by 165
- 2020When2com: Multi-Agent Perception via Communication Graph Groupingcited by 157
27 more
- 2022V2X-Sim: Multi-Agent Collaborative Perception Dataset and Benchmark for Autonomous Drivingcited by 157
- 2019Adversarial Sensor Attack on LiDAR-based Perception in Autonomous Drivingcited by 151
- 2020Physically Realizable Adversarial Examples for LiDAR Object Detectioncited by 137
- 2021Generating Useful Accident-Prone Driving Scenarios via a Learned Traffic Priorcited by 136
- 2021AdvSim: Generating Safety-Critical Scenarios for Self-Driving Vehiclescited by 132
- 2020Who2com: Collaborative Perception via Learnable Handshake Communicationcited by 127
- 2022COOPERNAUT: End-to-End Driving with Cooperative Perception for Networked Vehiclescited by 95
- 2022Latency-Aware Collaborative Perceptioncited by 86
- 2021SceneGen: Learning to Generate Realistic Traffic Scenescited by 83
- 2018GenAttack: Practical Black-box Attacks with Gradient-Free Optimizationcited by 82
- 2018Scalable End-to-End Autonomous Vehicle Testing via Rare-event Simulationcited by 76
- 2022Autonomous Vehicles on the Edge: A Survey on Autonomous Vehicle Racingcited by 56
- 2022Federated Learning via Decentralized Dataset Distillation in Resource-Constrained Edge Environmentscited by 49
- 2021Adversarial Attacks On Multi-Agent Communicationcited by 48
- 2022Uncertainty Quantification of Collaborative Detection for Self-Drivingcited by 46
- 2021Keypoints-Based Deep Feature Fusion for Cooperative Vehicle Detection of Autonomous Drivingcited by 45
- 2022Adaptive Feature Fusion for Cooperative Perception using LiDAR Point Cloudscited by 29
- 2021Fooling LiDAR Perception via Adversarial Trajectory Perturbationcited by 25
- 2019Efficient Black-box Assessment of Autonomous Vehicle Safetycited by 23
- 2022Robustness and Adaptability of Reinforcement Learning based Cooperative Autonomous Driving in Mixed-autonomy Trafficcited by 15
- 2022Uncertainty estimation of pedestrian future trajectory using Bayesian approximationcited by 12
- 2022Leveraging Dynamic Objects for Relative Localization Correction in a Connected Autonomous Vehicle Networkcited by 8
- 2022Federated Learning Framework Coping with Hierarchical Heterogeneity in Cooperative ITScited by 7
- 2020Auto-calibration Method Using Stop Signs for Urban Autonomous Driving Applicationscited by 5
- 2022Edge-Aided Sensor Data Sharing in Vehicular Communication Networkscited by 3
- 2020Simulating Autonomous Driving in Massive Mixed Urban Trafficcited by 2
- 2020Universally Safe Swerve Manoeuvres for Autonomous Drivingcited by 1
Built on by
Citing papers per year: 2023: 10; 2024: 6; 2025: 6; 2026: 6.
28 papers.
Sort:
By area:
- 2023V2V4Real: A Real-world Large-scale Dataset for Vehicle-to-Vehicle Cooperative Perceptioncited by 155
- 2023Diffusion Model as Representation Learnercited by 95
- 2023SSCBench: A Large-Scale 3D Semantic Scene Completion Benchmark for Autonomous Drivingcited by 72
- 2023HM-ViT: Hetero-modal Vehicle-to-Vehicle Cooperative perception with vision transformercited by 70
- 2024Communication-Efficient Collaborative Perception via Information Filling with Codebookcited by 67
- 2023Asynchrony-Robust Collaborative Perception via Bird's Eye View Flowcited by 58
- 2023Spatio-Temporal Domain Awareness for Multi-Agent Collaborative Perceptioncited by 52
- 2023Towards Vehicle-to-everything Autonomous Driving: A Survey on Collaborative Perceptioncited by 38
- 2023Adaptive Communications in Collaborative Perception with Domain Alignment for Autonomous Drivingcited by 19
- 2023Vehicle-to-Everything Cooperative Perception for Autonomous Drivingcited by 15
- 2024RoCo:Robust Collaborative Perception By Iterative Object Matching and Pose Adjustmentcited by 12
- 2024Collaborative Perception Datasets in Autonomous Driving: A Surveycited by 11
16 more
- 2024CooPre: Cooperative Pretraining for V2X Cooperative Perceptioncited by 11
- 2023Optimizing the Placement of Roadside LiDARs for Autonomous Drivingcited by 7
- 2025Learning to Detect Objects from Multi-Agent LiDAR Scans without Manual Labelscited by 7
- 2024RCDN: Towards Robust Camera-Insensitivity Collaborative Perception via Dynamic Feature-based 3D Neural Modelingcited by 6
- 2024Multi-V2X: A Large Scale Multi-modal Multi-penetration-rate Dataset for Cooperative Perceptioncited by 4
- 2025Adversarial Generation and Collaborative Evolution of Safety-Critical Scenarios for Autonomous Vehiclescited by 4
- 2026MDrive: Benchmarking Closed-Loop Cooperative Driving for End-to-End Multi-agent Systemscited by 4
- 2025Knowledge-Informed Multi-Agent Trajectory Prediction at Signalized Intersections for Infrastructure-to-Everythingcited by 2
- 2025Advancing Autonomous Driving System Testing: Demands, Challenges, and Future Directionscited by 1
- 2026V2VCrafter: Consistent Street-View Image Generation Across Vehiclescited by 1
- 2025Integrated Simulation Framework for Adversarial Attacks on Autonomous Vehiclescited by 0
- 2025SemOD: Semantic Enabled Object Detection Network under Various Weather Conditionscited by 0
- 2026AgentComm-Bench: Stress-Testing Cooperative Embodied AI Under Latency, Packet Loss, and Bandwidth Collapsecited by 0
- 2026Unsupervised Multi-agent and Single-agent Perception from Cooperative Viewscited by 0
- 2026SimBEV2X: A Large-Scale Dataset and Data Generation Tool for Multi-Task Vehicle-to-Everything Cooperative Perceptioncited by 0
- 2026VIPS: Vehicle-Infrastructure Cooperative Planning Benchmark via Pseudo-Simulationcited by 0
- 2026VIPS: Vehicle-Infrastructure Cooperative Planning Benchmark via Pseudo-Simulation2 Sep 2026
- 2026SimBEV2X: A Large-Scale Dataset and Data Generation Tool for Multi-Task Vehicle-to-Everything Cooperative Perception27 Jul 2026
- 2026V2VCrafter: Consistent Street-View Image Generation Across Vehicles28 May 2026
- 2026MDrive: Benchmarking Closed-Loop Cooperative Driving for End-to-End Multi-agent Systems11 May 2026
- 2026Unsupervised Multi-agent and Single-agent Perception from Cooperative Views7 Apr 2026
- 2026AgentComm-Bench: Stress-Testing Cooperative Embodied AI Under Latency, Packet Loss, and Bandwidth Collapse18 Mar 2026
- 2025Advancing Autonomous Driving System Testing: Demands, Challenges, and Future Directions9 Dec 2025
- 2025SemOD: Semantic Enabled Object Detection Network under Various Weather Conditions27 Nov 2025
- 2025Integrated Simulation Framework for Adversarial Attacks on Autonomous Vehicles31 Aug 2025
- 2025Adversarial Generation and Collaborative Evolution of Safety-Critical Scenarios for Autonomous Vehicles20 Aug 2025
- 2025Learning to Detect Objects from Multi-Agent LiDAR Scans without Manual Labels11 Mar 2025
- 2025Knowledge-Informed Multi-Agent Trajectory Prediction at Signalized Intersections for Infrastructure-to-Everything23 Jan 2025
16 more
- 2024Multi-V2X: A Large Scale Multi-modal Multi-penetration-rate Dataset for Cooperative Perception8 Sep 2024
- 2024CooPre: Cooperative Pretraining for V2X Cooperative Perception20 Aug 2024
- 2024RoCo:Robust Collaborative Perception By Iterative Object Matching and Pose Adjustment1 Aug 2024
- 2024RCDN: Towards Robust Camera-Insensitivity Collaborative Perception via Dynamic Feature-based 3D Neural Modeling27 May 2024
- 2024Communication-Efficient Collaborative Perception via Information Filling with Codebook8 May 2024
- 2024Collaborative Perception Datasets in Autonomous Driving: A Survey22 Apr 2024
- 2023Optimizing the Placement of Roadside LiDARs for Autonomous Driving11 Oct 2023
- 2023Vehicle-to-Everything Cooperative Perception for Autonomous Driving5 Oct 2023
- 2023Asynchrony-Robust Collaborative Perception via Bird's Eye View Flow29 Sep 2023
- 2023Adaptive Communications in Collaborative Perception with Domain Alignment for Autonomous Driving15 Sep 2023
- 2023Towards Vehicle-to-everything Autonomous Driving: A Survey on Collaborative Perception31 Aug 2023
- 2023Diffusion Model as Representation Learner21 Aug 2023
- 2023Spatio-Temporal Domain Awareness for Multi-Agent Collaborative Perception26 Jul 2023
- 2023SSCBench: A Large-Scale 3D Semantic Scene Completion Benchmark for Autonomous Driving15 Jun 2023
- 2023HM-ViT: Hetero-modal Vehicle-to-Vehicle Cooperative perception with vision transformer20 Apr 2023
- 2023V2V4Real: A Real-world Large-scale Dataset for Vehicle-to-Vehicle Cooperative Perception14 Mar 2023
- 2025Adversarial Generation and Collaborative Evolution of Safety-Critical Scenarios for Autonomous Vehiclescited by 4
- 2026MDrive: Benchmarking Closed-Loop Cooperative Driving for End-to-End Multi-agent Systemscited by 4
- 2025Advancing Autonomous Driving System Testing: Demands, Challenges, and Future Directionscited by 1
- 2026VIPS: Vehicle-Infrastructure Cooperative Planning Benchmark via Pseudo-Simulationcited by 0
- 2026VIPS: Vehicle-Infrastructure Cooperative Planning Benchmark via Pseudo-Simulation2 Sep 2026
- 2026MDrive: Benchmarking Closed-Loop Cooperative Driving for End-to-End Multi-agent Systems11 May 2026
- 2025Advancing Autonomous Driving System Testing: Demands, Challenges, and Future Directions9 Dec 2025
- 2025Adversarial Generation and Collaborative Evolution of Safety-Critical Scenarios for Autonomous Vehicles20 Aug 2025
- 2023Diffusion Model as Representation Learnercited by 95
- 2026V2VCrafter: Consistent Street-View Image Generation Across Vehiclescited by 1
- 2026V2VCrafter: Consistent Street-View Image Generation Across Vehicles28 May 2026
- 2023Diffusion Model as Representation Learner21 Aug 2023
- 2023V2V4Real: A Real-world Large-scale Dataset for Vehicle-to-Vehicle Cooperative Perceptioncited by 155
- 2023SSCBench: A Large-Scale 3D Semantic Scene Completion Benchmark for Autonomous Drivingcited by 72
- 2023HM-ViT: Hetero-modal Vehicle-to-Vehicle Cooperative perception with vision transformercited by 70
- 2024Communication-Efficient Collaborative Perception via Information Filling with Codebookcited by 67
- 2023Asynchrony-Robust Collaborative Perception via Bird's Eye View Flowcited by 58
- 2023Spatio-Temporal Domain Awareness for Multi-Agent Collaborative Perceptioncited by 52
- 2023Towards Vehicle-to-everything Autonomous Driving: A Survey on Collaborative Perceptioncited by 38
- 2023Adaptive Communications in Collaborative Perception with Domain Alignment for Autonomous Drivingcited by 19
- 2023Vehicle-to-Everything Cooperative Perception for Autonomous Drivingcited by 15
- 2024RoCo:Robust Collaborative Perception By Iterative Object Matching and Pose Adjustmentcited by 12
- 2024Collaborative Perception Datasets in Autonomous Driving: A Surveycited by 11
- 2024CooPre: Cooperative Pretraining for V2X Cooperative Perceptioncited by 11
12 most cited of 22 All 22 (JSON)
- 2026SimBEV2X: A Large-Scale Dataset and Data Generation Tool for Multi-Task Vehicle-to-Everything Cooperative Perception27 Jul 2026
- 2026Unsupervised Multi-agent and Single-agent Perception from Cooperative Views7 Apr 2026
- 2026AgentComm-Bench: Stress-Testing Cooperative Embodied AI Under Latency, Packet Loss, and Bandwidth Collapse18 Mar 2026
- 2025SemOD: Semantic Enabled Object Detection Network under Various Weather Conditions27 Nov 2025
- 2025Integrated Simulation Framework for Adversarial Attacks on Autonomous Vehicles31 Aug 2025
- 2025Learning to Detect Objects from Multi-Agent LiDAR Scans without Manual Labels11 Mar 2025
- 2025Knowledge-Informed Multi-Agent Trajectory Prediction at Signalized Intersections for Infrastructure-to-Everything23 Jan 2025
- 2024Multi-V2X: A Large Scale Multi-modal Multi-penetration-rate Dataset for Cooperative Perception8 Sep 2024
- 2024CooPre: Cooperative Pretraining for V2X Cooperative Perception20 Aug 2024
- 2024RoCo:Robust Collaborative Perception By Iterative Object Matching and Pose Adjustment1 Aug 2024
- 2024RCDN: Towards Robust Camera-Insensitivity Collaborative Perception via Dynamic Feature-based 3D Neural Modeling27 May 2024
- 2024Communication-Efficient Collaborative Perception via Information Filling with Codebook8 May 2024
12 newest of 22 All 22 (JSON)