Multi-Modal Beam Prediction Challenge 2022: Towards Generalization
Not on the map. Why?
Abstract (arXiv)
Beam management is a challenging task for millimeter wave (mmWave) and sub-terahertz communication systems, especially in scenarios with highly-mobile users. Leveraging external sensing modalities such as vision, LiDAR, radar, position, or a combination of them, to address this beam management challenge has recently attracted increasing interest from both academia and industry. This is mainly motivated by the dependency of the beam direction decision on the user location and the geometry of the surrounding environment -- information that can be acquired from the sensory data. To realize the promised beam management gains, such as the significant reduction in beam alignment overhead, in practice, however, these solutions need to account for important aspects. For example, these multi-modal sensing aided beam selection approaches should be able to generalize their learning to unseen scenarios and should be able to operate in realistic dense deployments. The "Multi-Modal Beam Prediction Challenge 2022: Towards Generalization" competition is offered to provide a platform for investigating these critical questions. In order to facilitate the generalizability study, the competition offers a large-scale multi-modal dataset with co-existing communication and sensing data collected across multiple real-world locations and different times of the day. In this paper, along with the detailed descriptions of the problem statement and the development dataset, we provide a baseline solution that utilizes the user position data to predict the optimal beam indices. The objective of this challenge is to go beyond a simple feasibility study and enable necessary research in this direction, paving the way towards generalizable multi-modal sensing-aided beam management for real-world future communication systems.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). First posted on arXiv 15 Sep 2022.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 2; 2023: 2; 2024: 2; 2025: 1; 2026: 4.
11 papers.
- 2022DeepSense 6G: A Large-Scale Real-World Multi-Modal Sensing and Communication Datasetcited by 53
- 2023Domain Generalization in Machine Learning Models for Wireless Communications: Concepts, State-of-the-Art, and Open Issuescited by 12
- 2023Multimodal Transformers for Wireless Communications: A Case Study in Beam Predictioncited by 8
- 2024Multi-Modal Transformer and Reinforcement Learning-based Beam Managementcited by 8
- 2024DeepSense-V2V: A Vehicle-to-Vehicle Multi-Modal Sensing, Localization, and Communications Datasetcited by 4
- 2026Multi-Modal Data-Enhanced Foundation Models for Prediction and Control in Wireless Networks: A Surveycited by 3
- 2022Millimeter Wave Drones with Cameras: Computer Vision Aided Wireless Beam Predictioncited by 1
- 2025Multi-Modal Sensor Fusion for Proactive Blockage Prediction in mmWave Vehicular Networkscited by 1
- 2026Enwar 3.0: An Agentic Multi-Modal LLM Orchestrator for Situation-Aware Beamforming, Blockage Prediction, and Handover Managementcited by 0
- 2026Resolving Multi-Target Association in OFDM-based ISAC via Vision-aided Multi-Modal Learningcited by 0
- 2026RFWeave: Learning Wireless Propagation Across Scenes and Transceiver Configurationscited by 0
- 2026RFWeave: Learning Wireless Propagation Across Scenes and Transceiver Configurations12 Oct 2026
- 2026Resolving Multi-Target Association in OFDM-based ISAC via Vision-aided Multi-Modal Learning20 Jun 2026
- 2026Enwar 3.0: An Agentic Multi-Modal LLM Orchestrator for Situation-Aware Beamforming, Blockage Prediction, and Handover Management4 May 2026
- 2026Multi-Modal Data-Enhanced Foundation Models for Prediction and Control in Wireless Networks: A Survey6 Jan 2026
- 2025Multi-Modal Sensor Fusion for Proactive Blockage Prediction in mmWave Vehicular Networks21 Jul 2025
- 2024Multi-Modal Transformer and Reinforcement Learning-based Beam Management22 Oct 2024
- 2024DeepSense-V2V: A Vehicle-to-Vehicle Multi-Modal Sensing, Localization, and Communications Dataset25 Jun 2024
- 2023Multimodal Transformers for Wireless Communications: A Case Study in Beam Prediction21 Sep 2023
- 2023Domain Generalization in Machine Learning Models for Wireless Communications: Concepts, State-of-the-Art, and Open Issues13 Mar 2023
- 2022DeepSense 6G: A Large-Scale Real-World Multi-Modal Sensing and Communication Dataset17 Nov 2022
- 2022Millimeter Wave Drones with Cameras: Computer Vision Aided Wireless Beam Prediction14 Nov 2022