Active Asymmetric Multi-Agent Multimodal Learning under Uncertainty
Not on the map. Why?
Abstract (arXiv)
Multi-agent systems are increasingly equipped with heterogeneous multimodal sensors, enabling richer perception but introducing modality-specific and agent-dependent uncertainty. Existing multi-agent collaboration frameworks typically reason at the agent level, assume homogeneous sensing, and handle uncertainty implicitly, limiting robustness under sensor corruption. We propose Active Asymmetric Multi-Agent Multimodal Learning under Uncertainty (A2MAML), a principled approach for uncertainty-aware, modality-level collaboration. A2MAML models each modality-specific feature as a stochastic estimate with uncertainty prediction, actively selects reliable agent-modality pairs, and aggregates information via Bayesian inverse-variance weighting. This formulation enables fine-grained, modality-level fusion, supports asymmetric modality availability, and provides a principled mechanism to suppress corrupted or noisy modalities. Extensive experiments on connected autonomous driving scenarios for collaborative accident detection demonstrate that A2MAML consistently outperforms both single-agent and collaborative baselines, achieving up to 18.7% higher accident detection rate.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 46 references that are in the map. First posted on arXiv 4 Feb 2026.
Builds on
27 of 46 references.
References · 27
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2019LXMERT: Learning Cross-Modality Encoder Representations from Transformerscited by 1,548
- 2019Attention is not Explanationcited by 916
- 2017Counterfactual Multi-Agent Policy Gradientscited by 733
- 2019Multi-Agent Reinforcement Learning: A Selective Overview of Theories and Algorithmscited by 555
- 2020Hands-on Bayesian Neural Networks -- a Tutorial for Deep Learning Userscited by 336
- 2022V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformercited by 320
- 2020V2VNet: Vehicle-to-Vehicle Communication for Joint Perception and Predictioncited by 292
15 more
- 2023Multimodal Deep Learningcited by 257
- 2022Where2comm: Communication-Efficient Collaborative Perception via Spatial Confidence Mapscited by 255
- 2020When2com: Multi-Agent Perception via Communication Graph Groupingcited by 157
- 2020Who2com: Collaborative Perception via Learnable Handshake Communicationcited by 127
- 2022COOPERNAUT: End-to-End Driving with Cooperative Perception for Networked Vehiclescited by 95
- 2025Self-Rewarding Vision-Language Model via Reasoning Decompositioncited by 95
- 2022Multi-Robot Collaborative Perception with Graph Neural Networkscited by 34
- 2021AutoCast: Scalable Infrastructure-less Cooperative Perception for Distributed Collaborative Drivingcited by 26
- 2025Stable and Efficient Single-Rollout RL for Multimodal Reasoningcited by 8
- 2025CAML: Collaborative Auxiliary Modality Learning for Multi-Agent Systemscited by 6
- 2021Decision Making of Connected Automated Vehicles at An Unsignalized Roundabout Considering Personalized Driving Behaviourscited by 5
- 2023Data-Driven Distributionally Robust Optimal Control with State-Dependent Noisecited by 5
- 2024Towards Efficient Risk-Sensitive Policy Gradient: An Iteration Complexity Analysiscited by 5
- 2023Collaborative Decision-Making Using Spatiotemporal Graphs in Connected Autonomycited by 3
- 2025MMCD: Multi-Modal Collaborative Decision-Making for Connected Autonomy with Knowledge Distillationcited by 2
Built on by
Not cited yet.