A Camera-Cooperative ISAC Framework for Multimodal Non-Cooperative UAVs Sensing
Not on the map. Why?
Abstract (arXiv)
The detection of non-cooperative unmanned aerial vehicles (UAVs) presents significant challenges for Integrated Sensing and Communication (ISAC) systems due to the inherent limitations of single-modal perception and the competition for shared communication and sensing resources. To address these challenges, this paper proposes a novel Camera-Cooperative ISAC (CC-ISAC) framework that employs multimodal sensing to enable efficient UAV beam steering and tracking. The proposed framework employs cameras for coarse-grained airspace monitoring and utilizes ISAC for fine-grained, high-precision sensing, forming a complementary perception loop that enhances both sensing accuracy and resource efficiency. Within this framework, two key modules are developed: (1) a Vision-to-Echo Data Alignment (V2EDA) model that aligns visual and echo-domain features through cross-attention mechanisms, and (2) a Multimodal Fusion-Based Estimation (MMFE) model that integrates historical multimodal data with current observations for robust state estimation. Extensive evaluations conducted on the DeepSense 6G dataset demonstrate that the proposed framework achieves an average reduction of 71% in beam steering overhead and 1.69-11.15% in tracking overhead while maintaining high angular estimation accuracy. The CC-ISAC framework effectively mitigates resource contention between sensing and communication, enabling reliable UAV surveillance while freeing substantial system resources for additional communication tasks, thereby representing a practical advancement in ISAC system design.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 44 references that are in the map. First posted on arXiv 21 May 2026.
Builds on
21 of 44 references.
References · 21
- 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,624
- 2022Rethinking Network Design and Local Geometry in Point Cloud: A Simple Residual MLP Frameworkcited by 376
- 2021Integrated Sensing and Communications: Towards Dual-functional Wireless Networks for 6G and Beyondcited by 88
- 2023CRN: Camera Radar Net for Accurate, Robust, Efficient 3D Perceptioncited by 81
- 2023Radar-Camera Fusion for Object Detection and Semantic Segmentation in Autonomous Driving: A Comprehensive Reviewcited by 57
- 2022DeepSense 6G: A Large-Scale Real-World Multi-Modal Sensing and Communication Datasetcited by 53
- 2023Gold-YOLO: Efficient Object Detector via Gather-and-Distribute Mechanismcited by 51
- 2020Real-Time Drone Detection and Tracking With Visible, Thermal and Acoustic Sensorscited by 21
- 2022Computer Vision Aided mmWave Beam Alignment in V2X Communicationscited by 14
- 2023Intelligent Multi-Modal Sensing-Communication Integration: Synesthesia of Machinescited by 14
- 2023ASF-YOLO: A Novel YOLO Model with Attentional Scale Sequence Fusion for Cell Instance Segmentationcited by 11
- 2024Radar and Camera Fusion for Object Detection and Tracking: A Comprehensive Surveycited by 9
9 more
- 2016Initial Access in 5G mm-Wave Cellular Networkscited by 8
- 2023Global-Local MAV Detection under Challenging Conditions based on Appearance and Motioncited by 7
- 2023Communication and Control in Collaborative UAVs: Recent Advances and Future Trendscited by 6
- 2025SIMAC: A Semantic-Driven Integrated Multimodal Sensing And Communication Frameworkcited by 6
- 2024Environment Semantic Communication: Enabling Distributed Sensing Aided Networkscited by 5
- 2019Ubiquitous Acoustic Sensing on Commodity IoT Devices: A Surveycited by 4
- 2023Vehicle Cameras Guide mmWave Beams: Approach and Real-World V2V Demonstrationcited by 3
- 2025Large Language Model-Driven Distributed Integrated Multimodal Sensing and Semantic Communicationscited by 2
- 2019Extended Kalman Filter Beam Tracking for Millimeter Wave Vehicular Communicationscited by 1
Built on by
Not cited yet.