Enabling Visual Recognition at Radio Frequency
Not on the map. Why?
Abstract (arXiv)
This paper introduces PanoRadar, a novel RF imaging system that brings RF resolution close to that of LiDAR, while providing resilience against conditions challenging for optical signals. Our LiDAR-comparable 3D imaging results enable, for the first time, a variety of visual recognition tasks at radio frequency, including surface normal estimation, semantic segmentation, and object detection. PanoRadar utilizes a rotating single-chip mmWave radar, along with a combination of novel signal processing and machine learning algorithms, to create high-resolution 3D images of the surroundings. Our system accurately estimates robot motion, allowing for coherent imaging through a dense grid of synthetic antennas. It also exploits the high azimuth resolution to enhance elevation resolution using learning-based methods. Furthermore, PanoRadar tackles 3D learning via 2D convolutions and addresses challenges due to the unique characteristics of RF signals. Our results demonstrate PanoRadar's robust performance across 12 buildings.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 24 of its 93 references that are in the map. First posted on arXiv 29 May 2024.
Builds on
24 of 93 references.
References · 24
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,241
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
- 2015Fast R-CNNcited by 2,933
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,162
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,161
- 2020A Survey of Deep Active Learningcited by 554
- 2022DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detectioncited by 224
- 2019The Oxford Radar RobotCar Dataset: A Radar Extension to the Oxford RobotCar Datasetcited by 134
12 more
- 2022Boreas: A Multi-Season Autonomous Driving Datasetcited by 76
- 2021AdaFusion: Visual-LiDAR Fusion with Adaptive Weights for Place Recognitioncited by 36
- 2018Eliminating the Blind Spot: Adapting 3D Object Detection and Monocular Depth Estimation to 360deg Panoramic Imagerycited by 35
- 2019See Through Smoke: Robust Indoor Mapping with Low-cost mmWave Radarcited by 35
- 2019Making the Invisible Visible: Action Recognition Through Walls and Occlusionscited by 25
- 2022Pointillism: Accurate 3D bounding box estimation with multi-radarscited by 23
- 2022High Resolution Point Clouds from mmWave Radarcited by 23
- 2018mD-Track: Leveraging Multi-Dimensionality in Passive Indoor Wi-Fi Trackingcited by 17
- 2018Probably Unknown: Deep Inverse Sensor Modelling In Radarcited by 16
- 20213DRIMR: 3D Reconstruction and Imaging via mmWave Radar based on Deep Learningcited by 16
- 2020Deep Depth Estimation from Visual-Inertial SLAMcited by 13
- 2021DeepPoint: A Deep Learning Model for 3D Reconstruction in Point Clouds via mmWave Radarcited by 5
Built on by
Citing papers per year: 2025: 6; 2026: 5.
11 papers.
- 2025Towards Foundational Models for Single-Chip Radarcited by 6
- 2025Scalable RF Simulation in Generative 4D Worldscited by 2
- 2025RaLD: Generating High-Resolution 3D Radar Point Clouds with Latent Diffusioncited by 1
- 2025RaGNNarok: A Light-Weight Graph Neural Network for Enhancing Radar Point Clouds on Unmanned Ground Vehiclescited by 0
- 2025Towards Seeing Bones at Radio Frequencycited by 0
- 2025Wave-Former: Through-Occlusion 3D Reconstruction via Wireless Shape Completioncited by 0
- 2026Rascene: High-Fidelity 3D Scene Imaging with mmWave Communication Signalscited by 0
- 2026RF-LEGO: Modularized Signal Processing-Deep Learning Co-Design for RF Sensing via Deep Unrollingcited by 0
- 2026GeRaF: Neural Geometry Reconstruction from Radio Frequency Signalscited by 0
- 2026Seeing through boxes: Non-Line-of-Sight 3D Reconstruction from Radar Signalscited by 0
- 2026GRADE: Single-Frame Generative Radar Depth Estimation Under Visual Degradationcited by 0
- 2026GRADE: Single-Frame Generative Radar Depth Estimation Under Visual Degradation9 Sep 2026
- 2026Seeing through boxes: Non-Line-of-Sight 3D Reconstruction from Radar Signals27 May 2026
- 2026GeRaF: Neural Geometry Reconstruction from Radio Frequency Signals27 May 2026
- 2026RF-LEGO: Modularized Signal Processing-Deep Learning Co-Design for RF Sensing via Deep Unrolling11 Apr 2026
- 2026Rascene: High-Fidelity 3D Scene Imaging with mmWave Communication Signals3 Apr 2026
- 2025Wave-Former: Through-Occlusion 3D Reconstruction via Wireless Shape Completion18 Nov 2025
- 2025RaLD: Generating High-Resolution 3D Radar Point Clouds with Latent Diffusion10 Nov 2025
- 2025Towards Seeing Bones at Radio Frequency22 Sep 2025
- 2025Towards Foundational Models for Single-Chip Radar15 Sep 2025
- 2025Scalable RF Simulation in Generative 4D Worlds16 Aug 2025
- 2025RaGNNarok: A Light-Weight Graph Neural Network for Enhancing Radar Point Clouds on Unmanned Ground Vehicles1 Jul 2025