CoAdapt: An LLM-based Framework for Adaptive Collaborative Perception in IIoT Robotic Swarms
Not on the map. Why?
Abstract (arXiv)
Industrial IoT environments increasingly deploy autonomous mobile robots for tasks such as material handling, product assembly, or infrastructure inspection. In such deployments, collaborative perception enables robots to share LiDAR observations and collectively construct a richer model of their environment than an individual agent could produce alone. However, industrial environments are dynamic spaces where robot positions shift continuously, network bandwidth fluctuates, and the marginal contribution of robots to perception quality varies at runtime. Existing collaborative perception approaches are designed for static participation assumptions and cannot adapt to these dynamics without sacrificing either detection precision or communication efficiency. This paper presents CoAdapt, an adaptive collaborative perception framework for IIoT robotic swarms in which a Large Language Model (LLM) serves as a runtime fusion controller, jointly deciding which robots participate in the fusion process and which fusion algorithm to apply based on the current spatial configuration and network state. The LLM reasons over structured natural language descriptions of the scene derived from raw LiDAR point clouds, requiring no taskspecific training and generalizing to unseen swarm topologies. Evaluated on the OPV2V benchmark across 25 scenarios, our approach achieves a 38% reduction in communication cost while maintaining detection precision comparable to static baseline approaches.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 42 references that are in the map. First posted on arXiv 15 Sep 2026.
Builds on
27 of 42 references.
References · 27
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,715
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
- 2023AWQ: Activation-aware Weight Quantization for LLM Compression and Accelerationcited by 1,298
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,035
- 2018Open3D: A Modern Library for 3D Data Processingcited by 721
- 2022V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformercited by 320
- 2021OPV2V: An Open Benchmark Dataset and Fusion Pipeline for Perception with Vehicle-to-Vehicle Communicationcited by 304
- 2020V2VNet: Vehicle-to-Vehicle Communication for Joint Perception and Predictioncited by 292
- 2024A Survey on Knowledge Distillation of Large Language Modelscited by 284
- 2024Unlocking Efficiency in Large Language Model Inference: A Comprehensive Survey of Speculative Decodingcited by 269
- 2022Where2comm: Communication-Efficient Collaborative Perception via Spatial Confidence Mapscited by 255
- 2022CoBEVT: Cooperative Bird's Eye View Semantic Segmentation with Sparse Transformerscited by 227
15 more
- 2021Learning Distilled Collaboration Graph for Multi-Agent Perceptioncited by 194
- 2019F-Cooper: Feature based Cooperative Perception for Autonomous Vehicle Edge Computing System Using 3D Point Cloudscited by 171
- 2019Cooper: Cooperative Perception for Connected Autonomous Vehicles based on 3D Point Cloudscited by 165
- 2020When2com: Multi-Agent Perception via Communication Graph Groupingcited by 157
- 2023SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Modelscited by 153
- 2020Who2com: Collaborative Perception via Learnable Handshake Communicationcited by 127
- 2023Collaborative Perception in Autonomous Driving: Methods, Datasets and Challengescited by 87
- 2022Latency-Aware Collaborative Perceptioncited by 86
- 2024Communication-Efficient Collaborative Perception via Information Filling with Codebookcited by 68
- 2023Self-Adaptive Large Language Model (LLM)-Based Multiagent Systemscited by 31
- 2025CoSDH: Communication-Efficient Collaborative Perception via Supply-Demand Awareness and Intermediate-Late Hybridizationcited by 28
- 2025V2V-LLM: Vehicle-to-Vehicle Cooperative Autonomous Driving with Multimodal Large Language Modelscited by 27
- 2024LLM-as-BT-Planner: Leveraging LLMs for Behavior Tree Generation in Robot Task Planningcited by 19
- 2025Collaborative Perception Datasets for Autonomous Driving: A Reviewcited by 8
- 2025Generative AI for Self-Adaptive Systems: State of the Art and Research Roadmapcited by 5
Built on by
Not cited yet.