mlsanityData to 14 Oct 2026

Structure-Aware Multimodal LLM Framework for Trustworthy Near-Field Beam Prediction

arXiv 2603.16143 ↗First posted 17 Mar 2026eess.SP cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

In near-field extremely large-scale multiple-input multiple-output (XL-MIMO) systems, spherical wavefront propagation expands the traditional beam codebook into the joint angular-distance domain, rendering conventional beam training prohibitively inefficient, especially in complex 3-dimensional (3D) low-altitude environments. Furthermore, since near-field beam variations are deeply coupled not only with user positions but also with the physical surroundings, precise beam alignment demands profound environmental understanding capabilities. To address this, we propose a large language model (LLM)-driven multimodal framework that fuses historical GPS data, RGB image, LiDAR data, and strategically designed task-specific textual prompts. By utilizing the powerful emergent reasoning and generalization capabilities of the LLM, our approach learns complex spatial dynamics to achieve superior environmental comprehension...

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 36 references that are in the map. First posted on arXiv 17 Mar 2026.

Builds on

22 of 36 references.

References · 22

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  5. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
  6. 2023Sionna RT: Differentiable Ray Tracing for Radio Propagation Modelingcited by 62
  7. 2022DeepSense 6G: A Large-Scale Real-World Multi-Modal Sensing and Communication Datasetcited by 53
  8. 2023A Tutorial on Extremely Large-Scale MIMO for 6G: Fundamentals, Signal Processing, and Applicationscited by 27
  9. 2021Vision-Position Multi-Modal Beam Prediction Using Real Millimeter Wave Datasetscited by 24
  10. 2022LiDAR Aided Future Beam Prediction in Real-World Millimeter Wave V2I Communicationscited by 22
  11. 2024Beam Prediction based on Large Language Modelscited by 20
  12. 2023AI/ML for Beam Management in 5G-Advanced: A Standardization Perspectivecited by 8
10 more
  1. 2023The Bridge Toward 6G: 5G-Advanced Evolution in 3GPP Release 19cited by 7
  2. 2025Multimodal-Wireless: A Large-Scale Dataset for Sensing and Communicationcited by 6
  3. 2022Hierarchical Codebook based Multiuser Beam Training for Millimeter Wave Massive MIMOcited by 4
  4. 2024Near-Field Communications: A Comprehensive Surveycited by 4
  5. 2025M2BeamLLM: Multimodal Sensing-empowered mmWave Beam Prediction with Large Language Modelscited by 4
  6. 2023Two-Stage Hierarchical Beam Training for Near-Field Communicationscited by 3
  7. 2022Near-Field Wideband Channel Estimation for Extremely Large-Scale MIMOcited by 2
  8. 2025Keypoint Detection Empowered Near-Field User Localization and Channel Reconstructioncited by 1
  9. 2025Multi-Modal Large Models Based Beam Prediction: An Example Empowered by DeepSeekcited by 1
  10. 2025Large-Model AI for Near Field Beam Prediction: A CNN-GPT2 Framework for 6G XL-MIMOcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Multi-Modal Environment-Aware Beam Management for Massive MIMO: A Geometry-Driven Virtual Base Station Framework
  2. 2026BeamAgent: LLM-Aided MIMO Beamforming with Decoupled Intent Parsing and Alternating Optimization for Joint Site Selection and Precoding
  3. 2024Near-Field Spot Beamfocusing: A Correlation-Aware Transfer Learning Approach
  4. 2025BeamLLM: Vision-Empowered mmWave Beam Prediction with Large Language Models
  5. 2026Diffusion-Based Generative Priors for Efficient Beam Alignment in Directional Networks
  6. 2026BeamCKMDiff: Beam-Aware Channel Knowledge Map Construction via Diffusion Transformer
  7. 2022Grid-Free MIMO Beam Alignment through Site-Specific Deep Learning
  8. 2026QuaMoE-DRF: Proactive Beam and Rate Adaptation via Multimodal Dynamic Radio Map Forecasting in ISAC Networks