mlsanityData to 7 Oct 2026

DeepSense 6G: A Large-Scale Real-World Multi-Modal Sensing and Communication Dataset

arXiv 2211.09769 ↗First posted 17 Nov 2022eess.SP cs.CV cs.LGcited by 53

Not on the map. Why?

Abstract (arXiv)

This article presents the DeepSense 6G dataset, which is a large-scale dataset based on real-world measurements of co-existing multi-modal sensing and communication data. The DeepSense 6G dataset is built to advance deep learning research in a wide range of applications in the intersection of multi-modal sensing, communication, and positioning. This article provides a detailed overview of the DeepSense dataset structure, adopted testbeds, data collection and processing methodology, deployment scenarios, and example applications, with the objective of facilitating the adoption and reproducibility of multi-modal sensing and communication datasets.

Key facts. Cited by 53 papers in the map (data through 7 Oct 2026). Builds on 16 of its 23 references that are in the map. First posted on arXiv 17 Nov 2022.

Builds on

16 of 23 references.

References · 16

  1. 2018YOLOv3: An Incremental Improvementcited by 2,652
  2. 2019DeepMIMO: A Generic Deep Learning Dataset for Millimeter Wave and Massive MIMO Applicationscited by 121
  3. 2021Integrated Sensing and Communications: Towards Dual-functional Wireless Networks for 6G and Beyondcited by 88
  4. 2021Vision-Aided 6G Wireless Communications: Blockage Prediction and Proactive Handoffcited by 30
  5. 2021Vision-Position Multi-Modal Beam Prediction Using Real Millimeter Wave Datasetscited by 24
  6. 2022LiDAR Aided Future Beam Prediction in Real-World Millimeter Wave V2I Communicationscited by 22
  7. 2019ViWi: A Deep Learning Dataset Framework for Vision-Aided Wireless Communicationscited by 21
  8. 2021An Overview of Signal Processing Techniques for Joint Communication and Radar Sensingcited by 19
  9. 2021A Survey on Fundamental Limits of Integrated Sensing and Communicationcited by 19
  10. 2021Radar Aided 6G Beam Prediction: Deep Learning Algorithms and Real-World Demonstrationcited by 17
  11. 2022Integrated Sensing and Communication for 6G: Ten Key Machine Learning Rolescited by 11
  12. 2022Multi-Modal Beam Prediction Challenge 2022: Towards Generalizationcited by 10
4 more
  1. 2022Computer Vision Aided Blockage Prediction in Real-World Millimeter Wave Deploymentscited by 9
  2. 2021LIDAR and Position-Aided mmWave Beam Selection with Non-local CNNs and Curriculum Trainingcited by 6
  3. 20195G mmWave Cooperative Positioning and Mapping using Multi-Model PHD Filter and Map Fusioncited by 4
  4. 2019Passive Radar at the Roadside Unit to Configure Millimeter Wave Vehicle-to-Infrastructure Linkscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 1; 2023: 9; 2024: 10; 2025: 18; 2026: 15.

53 papers.

Sort:

By area:

  1. 2023Sionna RT: Differentiable Ray Tracing for Radio Propagation Modelingcited by 61
  2. 2023Real-Time Digital Twins: Vision and Research Directions for 6G and Beyondcited by 26
  3. 2023Learning Radio Environments by Differentiable Ray Tracingcited by 23
  4. 2024A Survey on Integrated Sensing, Communication, and Computationcited by 12
  5. 2024Radar and Camera Fusion for Object Detection and Tracking: A Comprehensive Surveycited by 9
  6. 2023Multimodal Transformers for Wireless Communications: A Case Study in Beam Predictioncited by 8
  7. 2024Multi-Modal Transformer and Reinforcement Learning-based Beam Managementcited by 8
  8. 2023Camera Based mmWave Beam Prediction: Towards Multi-Candidate Real-World Scenarioscited by 6
  9. 2024Differentiable and Learnable Wireless Simulation with Geometric Transformerscited by 5
  10. 2025Retrieval Augmented Generation with Multi-Modal LLM Framework for Wireless Environmentscited by 5
  11. 2025BeamLLM: Vision-Empowered mmWave Beam Prediction with Large Language Modelscited by 5
  12. 2025Resource-Efficient Beam Prediction in mmWave Communications with Multimodal Realistic Simulation Frameworkcited by 5
38 more
  1. 2024DeepSense-V2V: A Vehicle-to-Vehicle Multi-Modal Sensing, Localization, and Communications Datasetcited by 4
  2. 2025M2BeamLLM: Multimodal Sensing-empowered mmWave Beam Prediction with Large Language Modelscited by 4
  3. 2023Vehicle Cameras Guide mmWave Beams: Approach and Real-World V2V Demonstrationcited by 3
  4. 2023Joint Sensing and Task-Oriented Communications with Image and Wireless Data Modalities for Dynamic Spectrum Accesscited by 3
  5. 2024Position Aware 60 GHz mmWave Beamforming for V2V Communications Utilizing Deep Learningcited by 3
  6. 2024Generative AI Empowered LiDAR Point Cloud Generation with Multimodal Transformercited by 3
  7. 2025Beam Selection in ISAC using Contextual Bandit with Multi-modal Transformer and Transfer Learningcited by 3
  8. 2025Multi-Modality Sensing in mmWave Beamforming for Connected Vehicles Using Deep Learningcited by 3
  9. 2026Multi-Modal Data-Enhanced Foundation Models for Prediction and Control in Wireless Networks: A Surveycited by 3
  10. 2022Toward an AI-enabled Connected Industry: AGV Communication and Sensor Measurement Datasetscited by 2
  11. 2023Enhancing Reliability in Federated mmWave Networks: A Practical and Scalable Solution using Radar-Aided Dynamic Blockage Recognitioncited by 2
  12. 2023Non-contact Multimodal Indoor Human Monitoring Systems: A Surveycited by 2
  13. 2024CAVIAR: Co-simulation of 6G Communications, 3D Scenarios and AI for Digital Twinscited by 2
  14. 2025Great X: A Unified Multi-Modal Simulator Bridging the Sim2Real Gap for 6Gcited by 2
  15. 2025Large Model Enabled Embodied Intelligence for 6G Integrated Perception, Communication, and Computation Networkcited by 2
  16. 2024Vision-Assisted Digital Twin Creation for mmWave Beam Managementcited by 1
  17. 2024AI-Powered CPS-Enabled Vulnerable-User-Aware Urban Transportation Digital Twin: Methods and Applicationscited by 1
  18. 2025Vision Aided Channel Prediction for Vehicular Communications: A Case Study of Received Power Prediction Using RGB Imagescited by 1
  19. 2025Multi-Modal Sensor Fusion for Proactive Blockage Prediction in mmWave Vehicular Networkscited by 1
  20. 2025MMSense: Adapting Vision-based Foundation Model for Multi-task Multi-modal Wireless Sensingcited by 1
  21. 2026Wireless Dataset Similarity: Measuring Distances in Supervised and Unsupervised Machine Learningcited by 1
  22. 2026QuaMoE-DRF: Proactive Beam and Rate Adaptation via Multimodal Dynamic Radio Map Forecasting in ISAC Networkscited by 1
  23. 2025GenSC-6G: A Prototype Testbed for Integrated Generative AI, Quantum, and Semantic Communicationcited by 0
  24. 2025GPS-Aided Deep Learning for Beam Prediction and Tracking in UAV mmWave Communicationcited by 0
  25. 2025Physics-Informed Parametric Bandits for Beam Alignment in mmWave Communicationscited by 0
  26. 2025Autoencoder for Position-Assisted Beam Prediction in mmWave ISAC Systemscited by 0
  27. 2025Sensing and Understanding the World over Air: A Large Multimodal Model for Mobile Networkscited by 0
  28. 2025A Sensing Dataset Protocol for Benchmarking and Multi-Task Wireless Sensingcited by 0
  29. 2025Empower Low-Altitude Economy: A Reliability-Aware Dynamic Weighting Allocation for Multi-modal UAV Beam Predictioncited by 0
  30. 2026Multi-Modal Sensing and Fusion in mmWave Beamforming for Connected Vehicles: A Transformer Based Frameworkcited by 0
  31. 2026Agentic AI for Embodied-enhanced Beam Prediction in Low-Altitude Economy Networkscited by 0
  32. 2026Structure-Aware Multimodal LLM Framework for Trustworthy Near-Field Beam Predictioncited by 0
  33. 2026Environment-Aware Channel Prediction for Vehicular Communications: A Multimodal Visual Feature Fusion Frameworkcited by 0
  34. 2026RF-LEGO: Modularized Signal Processing-Deep Learning Co-Design for RF Sensing via Deep Unrollingcited by 0
  35. 2026Look Once, Beam Twice: Camera-Primed Real-Time Double-Directional mmWave Beam Management for Vehicular Connectivitycited by 0
  36. 2026A Camera-Cooperative ISAC Framework for Multimodal Non-Cooperative UAVs Sensingcited by 0
  37. 2026CM-MAE: A Physics-Guided Cross-Modal Self-Supervised Learning Framework for Vision-Wireless Applicationscited by 0
  38. 2026EMRB: A Multi-Level Benchmark for Evaluating LLM Reasoning over Raw Electromagnetic Signalscited by 0

50 most cited of 53 All 53 (JSON)