mlsanityData to 14 Oct 2026

Synesthesia of Machines (SoM)-Enhanced Sub-THz ISAC Transmission for Air-Ground Network

arXiv 2506.12831 ↗First posted 15 Jun 2025eess.SP cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Integrated sensing and communication (ISAC) within sub-THz frequencies is crucial for future air-ground networks, but unique propagation characteristics and hardware limitations present challenges in optimizing ISAC performance while increasing operational latency. This paper introduces a multi-modal sensing fusion framework inspired by synesthesia of machine (SoM) to enhance sub-THz ISAC transmission. By exploiting inherent degrees of freedom in sub-THz hardware and channels, the framework optimizes the radio-frequency environment. Squint-aware beam management is developed to improve air-ground network adaptability, enabling three-dimensional dynamic ISAC links. Leveraging multi-modal information, the framework enhances ISAC performance and reduces latency. Visual data rapidly localizes users and targets, while a customized multi-modal learning algorithm optimizes the hybrid precoder. A new metric provides comprehensive performance evaluation, and extensive experiments demonstrate that the proposed scheme significantly improves ISAC efficiency.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 49 references that are in the map. First posted on arXiv 15 Jun 2025.

Builds on

30 of 49 references.

References · 30

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 523
  3. 2021Vision-Aided 6G Wireless Communications: Blockage Prediction and Proactive Handoffcited by 30
  4. 2020A Comprehensive Overview on 5G-and-Beyond Networks with UAVs: From Communications to Sensing and Intelligencecited by 21
  5. 2023Intelligent Multi-Modal Sensing-Communication Integration: Synesthesia of Machinescited by 15
  6. 2022An Overview of 5G Advanced Evolution in 3GPP Release 18cited by 14
  7. 2021Cram'er-Rao Bound Optimization for Joint Radar-Communication Designcited by 13
  8. 2020Single Image Dehazing Using Ranking Convolutional Neural Networkcited by 12
  9. 2023Integrated Sensing and Communication Signals Toward 5G-A and 6G: A Surveycited by 12
  10. 2020Bayesian Predictive Beamforming for Vehicular Networks: A Low-overhead Joint Radar-Communication Approachcited by 11
  11. 2022Self-Supervised RF Signal Representation Learning for NextG Signal Classification with Deep Learningcited by 11
  12. 2023Integrated Sensing and Communications Towards Proactive Beamforming in mmWave V2I via Multi-Modal Feature Fusion (MMFF)cited by 7
18 more
  1. 2025SynthSoM: A synthetic intelligent multi-modal sensing-communication dataset for Synesthesia of Machines (SoM)cited by 7
  2. 2022Integrated Sensing and Communication with mmWave Massive MIMO: A Compressed Sampling Perspectivecited by 6
  3. 2019Estimating Doubly-Selective Channels for Hybrid mmWave Massive MIMO Systems: A Doubly-Sparse Approachcited by 4
  4. 2021Deep Learning Based Channel Covariance Matrix Estimation with User Location and Scene Imagescited by 4
  5. 2022THz ISAC: A Physical-Layer Perspective of Terahertz Integrated Sensing and Communicationcited by 4
  6. 2024Unsupervised Learning for Joint Beamforming Design in RIS-aided ISAC Systemscited by 3
  7. 2021A Unified 3D Beam Training and Tracking Procedure for Terahertz Communicationcited by 2
  8. 2022On the Performance Gain of Integrated Sensing and Communications: A Subspace Correlation Perspectivecited by 2
  9. 2023YOLO: An Efficient Terahertz Band Integrated Sensing and Communications Scheme with Beam Squintcited by 2
  10. 2024A LiDAR-Aided Channel Model for Vehicular Intelligent Sensing-Communication Integrationcited by 2
  11. 2024Synesthesia of Machines (SoM)-Enhanced ISAC Precoding for Vehicular Networks with Double Dynamicscited by 2
  12. 2021Terahertz Ultra-Massive MIMO-Based Aeronautical Communications in Space-Air-Ground Integrated Networkscited by 1
  13. 2022Spatial-chirp Codebook-based Hierarchical Beam Training for Extremely Large-Scale Massive MIMOcited by 1
  14. 2022RIS-assisted Integrated Sensing and Communications: A Subspace Rotation Approachcited by 1
  15. 2022Joint Delay-Phase Precoding Under True-Time Delay Constraints in Wideband Sub-THz Hybrid Massive MIMO Systemscited by 1
  16. 2023Hybrid Arrays: How Many RF Chains Are Required to Prevent Beam Squint?cited by 1
  17. 2024Superposed IM-OFDM (S-IM-OFDM): An Enhanced OFDM for Integrated Sensing and Communicationscited by 1
  18. 2024Synesthesia of Machine (SoM)-Driven Analog Precoder Optimization for Enhanced ISAC Performance in Sub-THz Systemscited by 1

Built on by

Not cited yet.