LiDAR Aided Future Beam Prediction in Real-World Millimeter Wave V2I Communications
Not on the map. Why?
Abstract (arXiv)
This paper presents the first large-scale real-world evaluation for using LiDAR data to guide the mmWave beam prediction task. A machine learning (ML) model that leverages the LiDAR sensory data to predict the current and future beams was developed. Based on the large-scale real-world dataset, DeepSense 6G, this model was evaluated in a vehicle-to-infrastructure communication scenario with highly-mobile vehicles. The experimental results show that the developed LiDAR-aided beam prediction and tracking model can predict the optimal beam in 95% of the cases and with more than 90% reduction in the beam training overhead. The LiDAR-aided beam tracking achieves comparable accuracy performance to a baseline solution that has perfect knowledge of the previous optimal beams, without requiring any knowledge about the previous optimal beam information and without any need for beam calibration. This highlights a promising solution for the critical beam alignment challenges in mmWave and terahertz communication systems.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Mar 2022.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 2; 2023: 4; 2024: 2; 2025: 8; 2026: 6.
22 papers.
Sort:
By area:
- 2022DeepSense 6G: A Large-Scale Real-World Multi-Modal Sensing and Communication Datasetcited by 53
- 2023Multimodal Transformers for Wireless Communications: A Case Study in Beam Predictioncited by 8
- 2023Camera Based mmWave Beam Prediction: Towards Multi-Candidate Real-World Scenarioscited by 6
- 2023A Multi-Modal Simulation Framework to Enable Digital Twin-based V2X Communications in Dynamic Environmentscited by 5
- 2025BeamLLM: Vision-Empowered mmWave Beam Prediction with Large Language Modelscited by 5
- 2025Resource-Efficient Beam Prediction in mmWave Communications with Multimodal Realistic Simulation Frameworkcited by 5
- 2024DeepSense-V2V: A Vehicle-to-Vehicle Multi-Modal Sensing, Localization, and Communications Datasetcited by 4
- 2025M2BeamLLM: Multimodal Sensing-empowered mmWave Beam Prediction with Large Language Modelscited by 4
- 2023Vehicle Cameras Guide mmWave Beams: Approach and Real-World V2V Demonstrationcited by 3
- 2024Generative AI Empowered LiDAR Point Cloud Generation with Multimodal Transformercited by 3
- 2025Beam Selection in ISAC using Contextual Bandit with Multi-modal Transformer and Transfer Learningcited by 3
- 2025Multi-Modality Sensing in mmWave Beamforming for Connected Vehicles Using Deep Learningcited by 3
10 more
- 2026Multi-Modal Data-Enhanced Foundation Models for Prediction and Control in Wireless Networks: A Surveycited by 3
- 2025Multimodal Mixture-of-Experts for ISAC in Low-Altitude Wireless Networkscited by 2
- 2022Millimeter Wave Drones with Cameras: Computer Vision Aided Wireless Beam Predictioncited by 1
- 2026Equivariant Multi-agent Reinforcement Learning for Multimodal Vehicle-to-Infrastructure Systemscited by 1
- 2026QuaMoE-DRF: Proactive Beam and Rate Adaptation via Multimodal Dynamic Radio Map Forecasting in ISAC Networkscited by 1
- 2025GPS-Aided Deep Learning for Beam Prediction and Tracking in UAV mmWave Communicationcited by 0
- 2025Refined Bayesian Optimization for Efficient Beam Alignment in Intelligent Indoor Wireless Environmentscited by 0
- 2026Structure-Aware Multimodal LLM Framework for Trustworthy Near-Field Beam Predictioncited by 0
- 2026Enwar 3.0: An Agentic Multi-Modal LLM Orchestrator for Situation-Aware Beamforming, Blockage Prediction, and Handover Managementcited by 0
- 2026Look Once, Beam Twice: Camera-Primed Real-Time Double-Directional mmWave Beam Management for Vehicular Connectivitycited by 0
- 2026QuaMoE-DRF: Proactive Beam and Rate Adaptation via Multimodal Dynamic Radio Map Forecasting in ISAC Networks1 Jul 2026
- 2026Look Once, Beam Twice: Camera-Primed Real-Time Double-Directional mmWave Beam Management for Vehicular Connectivity6 May 2026
- 2026Enwar 3.0: An Agentic Multi-Modal LLM Orchestrator for Situation-Aware Beamforming, Blockage Prediction, and Handover Management4 May 2026
- 2026Equivariant Multi-agent Reinforcement Learning for Multimodal Vehicle-to-Infrastructure Systems8 Apr 2026
- 2026Structure-Aware Multimodal LLM Framework for Trustworthy Near-Field Beam Prediction17 Mar 2026
- 2026Multi-Modal Data-Enhanced Foundation Models for Prediction and Control in Wireless Networks: A Survey6 Jan 2026
- 2025Multimodal Mixture-of-Experts for ISAC in Low-Altitude Wireless Networks1 Dec 2025
- 2025Refined Bayesian Optimization for Efficient Beam Alignment in Intelligent Indoor Wireless Environments12 Nov 2025
- 2025M2BeamLLM: Multimodal Sensing-empowered mmWave Beam Prediction with Large Language Models17 Jun 2025
- 2025GPS-Aided Deep Learning for Beam Prediction and Tracking in UAV mmWave Communication23 May 2025
- 2025Multi-Modality Sensing in mmWave Beamforming for Connected Vehicles Using Deep Learning8 Apr 2025
- 2025Resource-Efficient Beam Prediction in mmWave Communications with Multimodal Realistic Simulation Framework7 Apr 2025
10 more
- 2025BeamLLM: Vision-Empowered mmWave Beam Prediction with Large Language Models13 Mar 2025
- 2025Beam Selection in ISAC using Contextual Bandit with Multi-modal Transformer and Transfer Learning11 Mar 2025
- 2024DeepSense-V2V: A Vehicle-to-Vehicle Multi-Modal Sensing, Localization, and Communications Dataset25 Jun 2024
- 2024Generative AI Empowered LiDAR Point Cloud Generation with Multimodal Transformer20 May 2024
- 2023Multimodal Transformers for Wireless Communications: A Case Study in Beam Prediction21 Sep 2023
- 2023Vehicle Cameras Guide mmWave Beams: Approach and Real-World V2V Demonstration20 Aug 2023
- 2023Camera Based mmWave Beam Prediction: Towards Multi-Candidate Real-World Scenarios14 Aug 2023
- 2023A Multi-Modal Simulation Framework to Enable Digital Twin-based V2X Communications in Dynamic Environments13 Mar 2023
- 2022DeepSense 6G: A Large-Scale Real-World Multi-Modal Sensing and Communication Dataset17 Nov 2022
- 2022Millimeter Wave Drones with Cameras: Computer Vision Aided Wireless Beam Prediction14 Nov 2022
- 2022DeepSense 6G: A Large-Scale Real-World Multi-Modal Sensing and Communication Datasetcited by 53
- 2023Multimodal Transformers for Wireless Communications: A Case Study in Beam Predictioncited by 8
- 2023Camera Based mmWave Beam Prediction: Towards Multi-Candidate Real-World Scenarioscited by 6
- 2023A Multi-Modal Simulation Framework to Enable Digital Twin-based V2X Communications in Dynamic Environmentscited by 5
- 2025BeamLLM: Vision-Empowered mmWave Beam Prediction with Large Language Modelscited by 5
- 2025Resource-Efficient Beam Prediction in mmWave Communications with Multimodal Realistic Simulation Frameworkcited by 5
- 2024DeepSense-V2V: A Vehicle-to-Vehicle Multi-Modal Sensing, Localization, and Communications Datasetcited by 4
- 2025M2BeamLLM: Multimodal Sensing-empowered mmWave Beam Prediction with Large Language Modelscited by 4
- 2023Vehicle Cameras Guide mmWave Beams: Approach and Real-World V2V Demonstrationcited by 3
- 2024Generative AI Empowered LiDAR Point Cloud Generation with Multimodal Transformercited by 3
- 2025Beam Selection in ISAC using Contextual Bandit with Multi-modal Transformer and Transfer Learningcited by 3
- 2025Multi-Modality Sensing in mmWave Beamforming for Connected Vehicles Using Deep Learningcited by 3
12 most cited of 20 All 20 (JSON)
- 2026QuaMoE-DRF: Proactive Beam and Rate Adaptation via Multimodal Dynamic Radio Map Forecasting in ISAC Networks1 Jul 2026
- 2026Look Once, Beam Twice: Camera-Primed Real-Time Double-Directional mmWave Beam Management for Vehicular Connectivity6 May 2026
- 2026Equivariant Multi-agent Reinforcement Learning for Multimodal Vehicle-to-Infrastructure Systems8 Apr 2026
- 2026Structure-Aware Multimodal LLM Framework for Trustworthy Near-Field Beam Prediction17 Mar 2026
- 2026Multi-Modal Data-Enhanced Foundation Models for Prediction and Control in Wireless Networks: A Survey6 Jan 2026
- 2025Refined Bayesian Optimization for Efficient Beam Alignment in Intelligent Indoor Wireless Environments12 Nov 2025
- 2025M2BeamLLM: Multimodal Sensing-empowered mmWave Beam Prediction with Large Language Models17 Jun 2025
- 2025GPS-Aided Deep Learning for Beam Prediction and Tracking in UAV mmWave Communication23 May 2025
- 2025Multi-Modality Sensing in mmWave Beamforming for Connected Vehicles Using Deep Learning8 Apr 2025
- 2025Resource-Efficient Beam Prediction in mmWave Communications with Multimodal Realistic Simulation Framework7 Apr 2025
- 2025BeamLLM: Vision-Empowered mmWave Beam Prediction with Large Language Models13 Mar 2025
- 2025Beam Selection in ISAC using Contextual Bandit with Multi-modal Transformer and Transfer Learning11 Mar 2025
12 newest of 20 All 20 (JSON)