mlsanityData to 14 Oct 2026

Multi-Modality Sensing in mmWave Beamforming for Connected Vehicles Using Deep Learning

arXiv 2504.06173 ↗First posted 8 Apr 2025cs.NI cs.AI cs.ETcited by 3

Not on the map. Why?

Abstract (arXiv)

Beamforming techniques are considered as essential parts to compensate severe path losses in millimeter-wave (mmWave) communications. In particular, these techniques adopt large antenna arrays and formulate narrow beams to obtain satisfactory received powers. However, performing accurate beam alignment over narrow beams for efficient link configuration by traditional standard defined beam selection approaches, which mainly rely on channel state information and beam sweeping through exhaustive searching, imposes computational and communications overheads. And, such resulting overheads limit their potential use in vehicle-to-infrastructure (V2I) and vehicle-to-vehicle (V2V) communications involving highly dynamic scenarios. In comparison, utilizing out-of-band contextual information, such as sensing data obtained from sensor devices, provides a better alternative to reduce overheads. This paper presents a deep learning-based solution for utilizing the multi-modality sensing data for predicting the optimal beams having sufficient mmWave received powers so that the best V2I and V2V line-of-sight links can be ensured proactively. The proposed solution has been tested on real-world measured mmWave sensing and communication data, and the results show that it can achieve up to 98.19% accuracies while predicting top-13 beams. Correspondingly, when compared to existing been sweeping approach, the beam sweeping searching space and time overheads are greatly shortened roughly by 79.67% and 91.89%, respectively which confirm a promising solution for beamforming in mmWave enabled communications.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 39 of its 71 references that are in the map. First posted on arXiv 8 Apr 2025.

Builds on

39 of 71 references.

References · 39

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  3. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  4. 2022DeepSense 6G: A Large-Scale Real-World Multi-Modal Sensing and Communication Datasetcited by 53
  5. 2021Vision-Position Multi-Modal Beam Prediction Using Real Millimeter Wave Datasetscited by 24
  6. 2022LiDAR Aided Future Beam Prediction in Real-World Millimeter Wave V2I Communicationscited by 22
  7. 2023A Survey of Beam Management for mmWave and THz Communications Towards 6Gcited by 21
  8. 2019LIDAR Data for Deep Learning-Based mmWave Beam-Selectioncited by 15
  9. 2022Deep Learning on Multimodal Sensor Data at the Wireless Edge for Vehicular Networkcited by 15
  10. 2022Computer Vision Aided mmWave Beam Alignment in V2X Communicationscited by 15
  11. 2022Position Aided Beam Prediction in the Real World: How Useful GPS Locations Actually Are?cited by 13
  12. 2021Federated mmWave Beam Selection Utilizing LIDAR Datacited by 12
27 more
  1. 2023AI/ML for Beam Management in 5G-Advanced: A Standardization Perspectivecited by 8
  2. 2021LIDAR and Position-Aided mmWave Beam Selection with Non-local CNNs and Curriculum Trainingcited by 6
  3. 2022Deep Learning-based Link Configuration for Radar-aided Multiuser mmWave Vehicle-to-Infrastructure Communicationcited by 6
  4. 2024Advancing Ultra-Reliable 6G: Transformer and Semantic Localization Empowered Robust Beamforming in Millimeter-Wave Communicationscited by 6
  5. 2022Proactively Predicting Dynamic 6G Link Blockages Using LiDAR and In-Band Signaturescited by 5
  6. 2023Multiverse at the Edge: Interacting Real World and Digital Twins for Wireless Beamformingcited by 5
  7. 2024Environment Semantic Communication: Enabling Distributed Sensing Aided Networkscited by 5
  8. 2021A Deep Learning Approach to Location- and Orientation-aided 3D Beam Selection for mmWave Communicationscited by 4
  9. 2023Point Cloud-based Proactive Link Quality Prediction for Millimeter-wave Communicationscited by 4
  10. 2023mmWave Enabled Connected Autonomous Vehicles: A Use Case with V2V Cooperative Perceptioncited by 4
  11. 2024Sub-6GHz Assisted mmWave Hybrid Beamforming with Heterogeneous Graph Neural Networkcited by 4
  12. 2024DeepSense-V2V: A Vehicle-to-Vehicle Multi-Modal Sensing, Localization, and Communications Datasetcited by 4
  13. 2022Location-Aided Beamforming in Mobile Millimeter-Wave Networkscited by 3
  14. 2023Vision Aided Environment Semantics Extraction and Its Application in mmWave Beam Selectioncited by 3
  15. 2023Environment Semantic Aided Communication: A Real World Demonstration for Beam Predictioncited by 3
  16. 2023Millimeter Wave V2V Beam Tracking using Radar: Algorithms and Real-World Demonstrationcited by 3
  17. 2023Vehicle Cameras Guide mmWave Beams: Approach and Real-World V2V Demonstrationcited by 3
  18. 2024Position Aware 60 GHz mmWave Beamforming for V2V Communications Utilizing Deep Learningcited by 3
  19. 2024Radio Maps for Beam Alignment in mmWave Communications with Location Uncertaintycited by 3
  20. 2024Localization in Digital Twin MIMO Networks: A Case for Massive Fingerprintingcited by 3
  21. 2024Harnessing Multimodal Sensing for Multi-user Beamforming in mmWave Systemscited by 3
  22. 2024VOMTC: Vision Objects for Millimeter and Terahertz Communicationscited by 3
  23. 2021Location Information Assisted Beamforming Design for Reconfigurable Intelligent Surface Aided Communication Systemscited by 2
  24. 2023Enhancing Reliability in Federated mmWave Networks: A Practical and Scalable Solution using Radar-Aided Dynamic Blockage Recognitioncited by 2
  25. 2023On the Impact of an IRS on the Out-of-Band Performance in Sub-6 GHz & mmWave Frequenciescited by 2
  26. 2022Overhead-Free Blockage Detection and Precoding Through Physics-Based Graph Neural Networks: LIDAR Data Meets Ray Tracingcited by 1
  27. 2022User Identification: A Key Enabler for Multi-User Vision-Aided Communicationscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.