Collaborative State Fusion in Partially Known Multi-agent Environments

arXiv 2410.15137 ↗First posted 19 Oct 2024cs.LG cs.MAcited by 0

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

In this paper, we study the collaborative state fusion problem in a multi-agent environment, where mobile agents collaborate to track movable targets. Due to the limited sensing range and potential errors of on-board sensors, it is necessary to aggregate individual observations to provide target state fusion for better target state estimation. Existing schemes do not perform well due to (1) impractical assumption of the fully known prior target state-space model and (2) observation outliers from individual sensors. To address the issues, we propose a two-stage collaborative fusion framework, namely underlineLearnable Weighted Runderlineobust underlineFusion (textsfLoF). textsfLoF combines a local state estimator (e.g., Kalman Filter) with a learnable weight generator to address the mismatch between the prior state-space model and underlying patterns of moving targets. Moreover, given observation outliers, we develop a time-series soft medoid(TSM) scheme to perform robust fusion. We evaluate textsfLoF in a collaborative detection simulation environment with promising results. In an example setting with 4 agents and 2 targets, textsfLoF leads to a 9.1% higher fusion gain compared to the state-of-the-art.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 12 of its 36 references that are in the map. First posted on arXiv 19 Oct 2024.

Builds on

12 of 36 references.

References · 12

2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 850
2017Provable defenses against adversarial examples via the convex outer adversarial polytopecited by 567
2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 485
2017Formal Guarantees on the Robustness of a Classifier against Adversarial Manipulationcited by 185
2021KalmanNet: Neural Network Aided Kalman Filtering for Partially Known Dynamicscited by 132
2019Robust Model Predictive Shielding for Safe Reinforcement Learning with Stochastic Dynamicscited by 47
2020Reliable Graph Neural Networks via Robust Aggregationcited by 43
2020The Emergence of Adversarial Communication in Multi-Agent Reinforcement Learningcited by 28
2022Uncertainty Quantification for Traffic Forecasting: A Unified Approachcited by 22
2020Scalable Reinforcement Learning Policies for Multi-Agent Controlcited by 12
2024On Newton's Method to Unlearn Neural Networkscited by 5
2020Multi-view Sensor Fusion by Integrating Model-based Estimation and Graph Learning for Collaborative Object Localizationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way