Learning to Communicate and Correct Pose Errors
Not on the map. Why?
Abstract (arXiv)
Learned communication makes multi-agent systems more effective by aggregating distributed information. However, it also exposes individual agents to the threat of erroneous messages they might receive. In this paper, we study the setting proposed in V2VNet, where nearby self-driving vehicles jointly perform object detection and motion forecasting in a cooperative manner. Despite a huge performance boost when the agents solve the task together, the gain is quickly diminished in the presence of pose noise since the communication relies on spatial transformations. Hence, we propose a novel neural reasoning framework that learns to communicate, to estimate potential errors, and finally, to reach a consensus about those errors. Experiments confirm that our proposed framework significantly improves the robustness of multi-agent self-driving perception and motion forecasting systems under realistic and severe localization noise.
Key facts. Cited by 46 papers in the map (data through 14 Oct 2026). First posted on arXiv 10 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 7; 2023: 11; 2024: 14; 2025: 8; 2026: 5.
46 papers.
Sort:
By area:
- 2022V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformercited by 320
- 2021Learning Distilled Collaboration Graph for Multi-Agent Perceptioncited by 194
- 20223D Object Detection for Autonomous Driving: A Comprehensive Surveycited by 132
- 2022Robust Collaborative 3D Object Detection in Presence of Pose Errorscited by 129
- 2023Collaborative Perception in Autonomous Driving: Methods, Datasets and Challengescited by 87
- 2024An Extensible Framework for Open Heterogeneous Collaborative Perceptioncited by 87
- 2022Latency-Aware Collaborative Perceptioncited by 86
- 2024Communication-Efficient Collaborative Perception via Information Filling with Codebookcited by 68
- 2023CORE: Cooperative Reconstruction for Multi-Agent Perceptioncited by 41
- 2023Towards Vehicle-to-everything Autonomous Driving: A Survey on Collaborative Perceptioncited by 38
- 2023Among Us: Adversarially Robust Collaborative Perception by Consensuscited by 37
- 2023Interruption-Aware Cooperative Perception for V2X Communication-Aided Autonomous Drivingcited by 25
34 more
- 2023BM2CP: Efficient Collaborative Perception with LiDAR-Camera Modalitiescited by 20
- 2023S2R-ViT for Multi-Agent Cooperative Perception: Bridging the Gap from Simulation to Realitycited by 18
- 2023Vehicle-to-Everything Cooperative Perception for Autonomous Drivingcited by 15
- 2022A Cooperative Perception System Robust to Localization Errorscited by 14
- 2022Analyzing Infrastructure LiDAR Placement with Realistic LiDAR Simulation Librarycited by 14
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directionscited by 14
- 2024A Survey on Intermediate Fusion Methods for Collaborative Perception Categorized by Real World Challengescited by 13
- 2024DSRC: Learning Density-insensitive and Semantic-aware Collaborative Representation against Corruptionscited by 13
- 2024RoCo:Robust Collaborative Perception By Iterative Object Matching and Pose Adjustmentcited by 12
- 2022Collaborative Perception for Autonomous Driving: Current Status and Future Trendcited by 10
- 2023Adv3D: Generating Safety-Critical 3D Objects through Closed-Loop Simulationcited by 10
- 2024EMIFF: Enhanced Multi-scale Image Feature Fusion for Vehicle-Infrastructure Cooperative 3D Object Detectioncited by 9
- 2024Robust Collaborative Perception without External Localization and Clock Devicescited by 8
- 2025V2X-ReaLO: An Open Online Framework and Dataset for Cooperative Perception in Realitycited by 8
- 2023MASS: Mobility-Aware Sensor Scheduling of Cooperative Perception for Connected Automated Drivingcited by 7
- 2023Optimizing the Placement of Roadside LiDARs for Autonomous Drivingcited by 7
- 2024UVCPNet: A UAV-Vehicle Collaborative Perception Network for 3D Object Detectioncited by 7
- 2025Learning to Detect Objects from Multi-Agent LiDAR Scans without Manual Labelscited by 7
- 2024RCDN: Towards Robust Camera-Insensitivity Collaborative Perception via Dynamic Feature-based 3D Neural Modelingcited by 6
- 2024AdvGPS: Adversarial GPS for Multi-Agent Perception Attackcited by 5
- 2024Breaking Data Silos: Cross-Domain Learning for Multi-Agent Perception from Independent Private Sourcescited by 5
- 2025Systematic Literature Review on Vehicular Collaborative Perception -- A Computer Vision Perspectivecited by 5
- 2026EIMC: Efficient Instance-aware Multi-modal Collaborative Perceptioncited by 4
- 2024Evaluating Roadside Perception for Autonomous Vehicles: Insights from Field Testingcited by 3
- 2025V2X-DGPE: Addressing Domain Gaps and Pose Errors for Robust Collaborative 3D Object Detectioncited by 3
- 2025CoBEVMoE: Heterogeneity-aware Feature Fusion with Dynamic Mixture-of-Experts for Collaborative Perceptioncited by 3
- 2024Self-Localized Collaborative Perceptioncited by 2
- 2024Cooperative Visual-LiDAR Extrinsic Calibration Technology for Intersection Vehicle-Infrastructure: A reviewcited by 1
- 2026SiMO: Single-Modality-Operable Multimodal Collaborative Perceptioncited by 1
- 2025Wireless Communication as an Information Sensor for Multi-agent Cooperative Perception: A Surveycited by 0
- 2025Communication-Efficient Multi-Agent 3D Detection via Hybrid Collaborationcited by 0
- 2026UECP: Uncertainty-Enhanced Collaborative Perceptioncited by 0
- 2026CoAnchor: Robust Collaborative Perception under Spatio-Temporal Misalignment via Object-Level Anchorscited by 0
- 2026SV2V-RSim: A Comprehensive Benchmark for Self-Selective V2V Cooperative Perception with Near-Realistic Datacited by 0
- 2026SV2V-RSim: A Comprehensive Benchmark for Self-Selective V2V Cooperative Perception with Near-Realistic Data26 Sep 2026
- 2026CoAnchor: Robust Collaborative Perception under Spatio-Temporal Misalignment via Object-Level Anchors21 Aug 2026
- 2026UECP: Uncertainty-Enhanced Collaborative Perception22 Jun 2026
- 2026SiMO: Single-Modality-Operable Multimodal Collaborative Perception9 Mar 2026
- 2026EIMC: Efficient Instance-aware Multi-modal Collaborative Perception3 Mar 2026
- 2025CoBEVMoE: Heterogeneity-aware Feature Fusion with Dynamic Mixture-of-Experts for Collaborative Perception21 Sep 2025
- 2025Communication-Efficient Multi-Agent 3D Detection via Hybrid Collaboration9 Aug 2025
- 2025Wireless Communication as an Information Sensor for Multi-agent Cooperative Perception: A Survey30 Apr 2025
- 2025Systematic Literature Review on Vehicular Collaborative Perception -- A Computer Vision Perspective6 Apr 2025
- 2025V2X-ReaLO: An Open Online Framework and Dataset for Cooperative Perception in Reality13 Mar 2025
- 2025Learning to Detect Objects from Multi-Agent LiDAR Scans without Manual Labels11 Mar 2025
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directions5 Mar 2025
34 more
- 2025V2X-DGPE: Addressing Domain Gaps and Pose Errors for Robust Collaborative 3D Object Detection4 Jan 2025
- 2024DSRC: Learning Density-insensitive and Semantic-aware Collaborative Representation against Corruptions14 Dec 2024
- 2024RoCo:Robust Collaborative Perception By Iterative Object Matching and Pose Adjustment1 Aug 2024
- 2024Self-Localized Collaborative Perception18 Jun 2024
- 2024UVCPNet: A UAV-Vehicle Collaborative Perception Network for 3D Object Detection7 Jun 2024
- 2024RCDN: Towards Robust Camera-Insensitivity Collaborative Perception via Dynamic Feature-based 3D Neural Modeling27 May 2024
- 2024Cooperative Visual-LiDAR Extrinsic Calibration Technology for Intersection Vehicle-Infrastructure: A review16 May 2024
- 2024Communication-Efficient Collaborative Perception via Information Filling with Codebook8 May 2024
- 2024Robust Collaborative Perception without External Localization and Clock Devices5 May 2024
- 2024A Survey on Intermediate Fusion Methods for Collaborative Perception Categorized by Real World Challenges24 Apr 2024
- 2024EMIFF: Enhanced Multi-scale Image Feature Fusion for Vehicle-Infrastructure Cooperative 3D Object Detection23 Feb 2024
- 2024Breaking Data Silos: Cross-Domain Learning for Multi-Agent Perception from Independent Private Sources6 Feb 2024
- 2024AdvGPS: Adversarial GPS for Multi-Agent Perception Attack30 Jan 2024
- 2024An Extensible Framework for Open Heterogeneous Collaborative Perception25 Jan 2024
- 2024Evaluating Roadside Perception for Autonomous Vehicles: Insights from Field Testing22 Jan 2024
- 2023Adv3D: Generating Safety-Critical 3D Objects through Closed-Loop Simulation2 Nov 2023
- 2023BM2CP: Efficient Collaborative Perception with LiDAR-Camera Modalities23 Oct 2023
- 2023Optimizing the Placement of Roadside LiDARs for Autonomous Driving11 Oct 2023
- 2023Vehicle-to-Everything Cooperative Perception for Autonomous Driving5 Oct 2023
- 2023Towards Vehicle-to-everything Autonomous Driving: A Survey on Collaborative Perception31 Aug 2023
- 2023CORE: Cooperative Reconstruction for Multi-Agent Perception21 Jul 2023
- 2023S2R-ViT for Multi-Agent Cooperative Perception: Bridging the Gap from Simulation to Reality16 Jul 2023
- 2023Interruption-Aware Cooperative Perception for V2X Communication-Aided Autonomous Driving24 Apr 2023
- 2023Among Us: Adversarially Robust Collaborative Perception by Consensus16 Mar 2023
- 2023MASS: Mobility-Aware Sensor Scheduling of Cooperative Perception for Connected Automated Driving25 Feb 2023
- 2023Collaborative Perception in Autonomous Driving: Methods, Datasets and Challenges16 Jan 2023
- 2022Analyzing Infrastructure LiDAR Placement with Realistic LiDAR Simulation Library29 Nov 2022
- 2022Robust Collaborative 3D Object Detection in Presence of Pose Errors14 Nov 2022
- 2022A Cooperative Perception System Robust to Localization Errors12 Oct 2022
- 2022Collaborative Perception for Autonomous Driving: Current Status and Future Trend22 Aug 2022
- 2022Latency-Aware Collaborative Perception18 Jul 2022
- 20223D Object Detection for Autonomous Driving: A Comprehensive Survey19 Jun 2022
- 2022V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformer20 Mar 2022
- 2021Learning Distilled Collaboration Graph for Multi-Agent Perception1 Nov 2021
- 2022V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformercited by 320
- 20223D Object Detection for Autonomous Driving: A Comprehensive Surveycited by 132
- 2022Robust Collaborative 3D Object Detection in Presence of Pose Errorscited by 129
- 2023Collaborative Perception in Autonomous Driving: Methods, Datasets and Challengescited by 87
- 2024An Extensible Framework for Open Heterogeneous Collaborative Perceptioncited by 87
- 2022Latency-Aware Collaborative Perceptioncited by 86
- 2024Communication-Efficient Collaborative Perception via Information Filling with Codebookcited by 68
- 2023CORE: Cooperative Reconstruction for Multi-Agent Perceptioncited by 41
- 2023Towards Vehicle-to-everything Autonomous Driving: A Survey on Collaborative Perceptioncited by 38
- 2023Among Us: Adversarially Robust Collaborative Perception by Consensuscited by 37
- 2023Interruption-Aware Cooperative Perception for V2X Communication-Aided Autonomous Drivingcited by 25
- 2023BM2CP: Efficient Collaborative Perception with LiDAR-Camera Modalitiescited by 20
12 most cited of 44 All 44 (JSON)
- 2026SV2V-RSim: A Comprehensive Benchmark for Self-Selective V2V Cooperative Perception with Near-Realistic Data26 Sep 2026
- 2026CoAnchor: Robust Collaborative Perception under Spatio-Temporal Misalignment via Object-Level Anchors21 Aug 2026
- 2026UECP: Uncertainty-Enhanced Collaborative Perception22 Jun 2026
- 2026SiMO: Single-Modality-Operable Multimodal Collaborative Perception9 Mar 2026
- 2026EIMC: Efficient Instance-aware Multi-modal Collaborative Perception3 Mar 2026
- 2025Communication-Efficient Multi-Agent 3D Detection via Hybrid Collaboration9 Aug 2025
- 2025Wireless Communication as an Information Sensor for Multi-agent Cooperative Perception: A Survey30 Apr 2025
- 2025Systematic Literature Review on Vehicular Collaborative Perception -- A Computer Vision Perspective6 Apr 2025
- 2025V2X-ReaLO: An Open Online Framework and Dataset for Cooperative Perception in Reality13 Mar 2025
- 2025Learning to Detect Objects from Multi-Agent LiDAR Scans without Manual Labels11 Mar 2025
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directions5 Mar 2025
- 2025V2X-DGPE: Addressing Domain Gaps and Pose Errors for Robust Collaborative 3D Object Detection4 Jan 2025
12 newest of 44 All 44 (JSON)