# Enabling Visual Recognition at Radio Frequency

arXiv: https://arxiv.org/abs/2405.19516 · HTML: https://mlsanity.com/paper/2405.19516/

## Key facts

- Cited by 11 papers in the map (data through 14 Oct 2026).
- Builds on 24 of its 93 references that are in the map.
- First posted on arXiv 29 May 2024.

## Builds on (most cited first, 24 of 24)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [The Unreasonable Effectiveness of Deep Features as a Perceptual Metric](https://mlsanity.com/paper/1801.03924/) (2018)
- [Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks](https://mlsanity.com/paper/1506.01497/) (2015)
- [Feature Pyramid Networks for Object Detection](https://mlsanity.com/paper/1612.03144/) (2016)
- [DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs](https://mlsanity.com/paper/1606.00915/) (2016)
- [Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation](https://mlsanity.com/paper/1802.02611/) (2018)
- [Fast R-CNN](https://mlsanity.com/paper/1504.08083/) (2015)
- [Rich feature hierarchies for accurate object detection and semantic segmentation](https://mlsanity.com/paper/1311.2524/) (2013)
- [Rethinking Atrous Convolution for Semantic Image Segmentation](https://mlsanity.com/paper/1706.05587/) (2017)
- [A Survey of Deep Active Learning](https://mlsanity.com/paper/2009.00236/) (2020)
- [DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detection](https://mlsanity.com/paper/2203.08195/) (2022)
- [The Oxford Radar RobotCar Dataset: A Radar Extension to the Oxford RobotCar Dataset](https://mlsanity.com/paper/1909.01300/) (2019)
- [Boreas: A Multi-Season Autonomous Driving Dataset](https://mlsanity.com/paper/2203.10168/) (2022)
- [AdaFusion: Visual-LiDAR Fusion with Adaptive Weights for Place Recognition](https://mlsanity.com/paper/2111.11739/) (2021)
- [Eliminating the Blind Spot: Adapting 3D Object Detection and Monocular Depth Estimation to 360deg Panoramic Imagery](https://mlsanity.com/paper/1808.06253/) (2018)
- [See Through Smoke: Robust Indoor Mapping with Low-cost mmWave Radar](https://mlsanity.com/paper/1911.00398/) (2019)
- [Making the Invisible Visible: Action Recognition Through Walls and Occlusions](https://mlsanity.com/paper/1909.09300/) (2019)
- [Pointillism: Accurate 3D bounding box estimation with multi-radars](https://mlsanity.com/paper/2203.04440/) (2022)
- [High Resolution Point Clouds from mmWave Radar](https://mlsanity.com/paper/2206.09273/) (2022)
- [mD-Track: Leveraging Multi-Dimensionality in Passive Indoor Wi-Fi Tracking](https://mlsanity.com/paper/1812.03103/) (2018)
- [Probably Unknown: Deep Inverse Sensor Modelling In Radar](https://mlsanity.com/paper/1810.08151/) (2018)
- [3DRIMR: 3D Reconstruction and Imaging via mmWave Radar based on Deep Learning](https://mlsanity.com/paper/2108.02858/) (2021)
- [Deep Depth Estimation from Visual-Inertial SLAM](https://mlsanity.com/paper/2008.00092/) (2020)
- [DeepPoint: A Deep Learning Model for 3D Reconstruction in Point Clouds via mmWave Radar](https://mlsanity.com/paper/2109.09188/) (2021)

## Built on by (most cited first, 11 of 11)

- [Towards Foundational Models for Single-Chip Radar](https://mlsanity.com/paper/2509.12482/) (2025)
- [Scalable RF Simulation in Generative 4D Worlds](https://mlsanity.com/paper/2508.12176/) (2025)
- [RaLD: Generating High-Resolution 3D Radar Point Clouds with Latent Diffusion](https://mlsanity.com/paper/2511.07067/) (2025)
- [RaGNNarok: A Light-Weight Graph Neural Network for Enhancing Radar Point Clouds on Unmanned Ground Vehicles](https://mlsanity.com/paper/2507.00937/) (2025)
- [Towards Seeing Bones at Radio Frequency](https://mlsanity.com/paper/2509.17979/) (2025)
- [Wave-Former: Through-Occlusion 3D Reconstruction via Wireless Shape Completion](https://mlsanity.com/paper/2511.14152/) (2025)
- [Rascene: High-Fidelity 3D Scene Imaging with mmWave Communication Signals](https://mlsanity.com/paper/2604.02603/) (2026)
- [RF-LEGO: Modularized Signal Processing-Deep Learning Co-Design for RF Sensing via Deep Unrolling](https://mlsanity.com/paper/2604.10183/) (2026)
- [GeRaF: Neural Geometry Reconstruction from Radio Frequency Signals](https://mlsanity.com/paper/2605.29097/) (2026)
- [Seeing through boxes: Non-Line-of-Sight 3D Reconstruction from Radar Signals](https://mlsanity.com/paper/2605.29098/) (2026)
- [GRADE: Single-Frame Generative Radar Depth Estimation Under Visual Degradation](https://mlsanity.com/paper/2609.10756/) (2026)

## Abstract (arXiv)

This paper introduces PanoRadar, a novel RF imaging system that brings RF resolution close to that of LiDAR, while providing resilience against conditions challenging for optical signals. Our LiDAR-comparable 3D imaging results enable, for the first time, a variety of visual recognition tasks at radio frequency, including surface normal estimation, semantic segmentation, and object detection. PanoRadar utilizes a rotating single-chip mmWave radar, along with a combination of novel signal processing and machine learning algorithms, to create high-resolution 3D images of the surroundings. Our system accurately estimates robot motion, allowing for coherent imaging through a dense grid of synthetic antennas. It also exploits the high azimuth resolution to enhance elevation resolution using learning-based methods. Furthermore, PanoRadar tackles 3D learning via 2D convolutions and addresses challenges due to the unique characteristics of RF signals. Our results demonstrate PanoRadar's robust performance across 12 buildings.