mlsanityData to 14 Oct 2026

BeamLLM: Vision-Empowered mmWave Beam Prediction with Large Language Models

arXiv 2503.10432 ↗First posted 13 Mar 2025cs.LG cs.CLcited by 5

Not on the map. Why?

Abstract (arXiv)

In this paper, we propose BeamLLM, a vision-aided millimeter-wave (mmWave) beam prediction framework leveraging large language models (LLMs) to address the challenges of high training overhead and latency in mmWave communication systems. By combining computer vision (CV) with LLMs' cross-modal reasoning capabilities, the framework extracts user equipment (UE) positional features from RGB images and aligns visual-temporal features with LLMs' semantic space through reprogramming techniques. Evaluated on a realistic vehicle-to-infrastructure (V2I) scenario, the proposed method achieves 61.01% top-1 accuracy and 97.39% top-3 accuracy in standard prediction tasks, significantly outperforming traditional deep learning models. In few-shot prediction scenarios, the performance degradation is limited to 12.56% (top-1) and 5.55% (top-3) from time sample 1 to 10, demonstrating superior prediction capability.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 14 of its 16 references that are in the map. First posted on arXiv 13 Mar 2025.

Builds on

14 of 16 references.

References · 14

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,630
  3. 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,181
  4. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 700
  5. 2021CAT: Cross Attention in Vision Transformercited by 92
  6. 2022DeepSense 6G: A Large-Scale Real-World Multi-Modal Sensing and Communication Datasetcited by 53
  7. 2024LLM4CP: Adapting Large Language Models for Channel Predictioncited by 42
  8. 2022LiDAR Aided Future Beam Prediction in Real-World Millimeter Wave V2I Communicationscited by 22
  9. 2024Beam Prediction based on Large Language Modelscited by 20
  10. 2021Radar Aided 6G Beam Prediction: Deep Learning Algorithms and Real-World Demonstrationcited by 17
  11. 2022Position Aided Beam Prediction in the Real World: How Useful GPS Locations Actually Are?cited by 13
  12. 2021Computer Vision Aided Beam Tracking in A Real-World Millimeter Wave Deploymentcited by 11
2 more
  1. 2021Learning to Estimate RIS-Aided mmWave Channelscited by 4
  2. 2025Port-LLM: A Port Prediction Method for Fluid Antenna based on Large Language Modelscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 1.

5 papers.

  1. 2025LVM4CSI: Enabling Direct Application of Pre-Trained Large Vision Models for Wireless Channel Taskscited by 8
  2. 2025M2BeamLLM: Multimodal Sensing-empowered mmWave Beam Prediction with Large Language Modelscited by 4
  3. 2025BERT4beam: Large AI Model Enabled Generalized Beamforming Optimizationcited by 1
  4. 2025Vehicle-to-Infrastructure Collaborative Spatial Perception via Multimodal Large Language Modelscited by 0
  5. 2026CM-MAE: A Physics-Guided Cross-Modal Self-Supervised Learning Framework for Vision-Wireless Applicationscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Segment-Wise Flow Matching for Vision-Aided mmWave V2I Beam Prediction ↗
  2. 2026Knowledge Distillation for mmWave Beam Prediction Using Sub-6 GHz Channels
  3. 2022Towards Intelligent Millimeter and Terahertz Communication for 6G: Computer Vision-aided Beamforming
  4. 2023Deep Learning based Fast and Accurate Beamforming for Millimeter-Wave Systems ↗
  5. 2026Can Language Models Understand mmWave Data? Benchmarking Large Language Models for mmWave Radar-Based Human Understanding
  6. 2025mmExpert: Integrating Large Language Models for Comprehensive mmWave Data Synthesis and Understanding
  7. 2021LIDAR and Position-Aided mmWave Beam Selection with Non-local CNNs and Curriculum Training
  8. 2022Grid-Free MIMO Beam Alignment through Site-Specific Deep Learning