RF4D:Neural Radar Fields for Novel View Synthesis in Outdoor Dynamic Scenes
Not on the map. Why?
Abstract (arXiv)
Neural fields (NFs) have achieved remarkable success in scene reconstruction and novel view synthesis. However, existing NF approaches that rely on RGB or LiDAR inputs often struggle under adverse weather conditions, limiting their robustness in real-world outdoor environments such as autonomous driving. In contrast, millimeter-wave radar is inherently resilient to environmental variations, yet its integration with NFs remains largely underexplored. Moreover, outdoor driving scenes frequently involve dynamic objects, making spatiotemporal modeling crucial for temporally consistent novel view synthesis. To address these challenges, we present RF4D, a radar-based neural field framework tailored for novel view synthesis in outdoor dynamic scenes. RF4D explicitly incorporates temporal information into its representation, enabling more accurate modeling of object motion. A dedicated scene flow module further predicts temporal offsets between adjacent frames, enforcing temporal occupancy coherence during dynamic scene reconstruction. Moreover, we propose a radar-specific power rendering formulation grounded in radar sensing physics, improving both synthesis accuracy and interpretability. Extensive experiments on public radar datasets demonstrate that RF4D substantially outperforms existing methods in radar measurement synthesis and occupancy estimation accuracy, with particularly strong gains in dynamic outdoor environments.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 47 of its 71 references that are in the map. First posted on arXiv 27 May 2025.
Builds on
47 of 71 references.
References · 47
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
- 2022Planning-oriented Autonomous Drivingcited by 1,087
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 905
- 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 751
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 746
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 587
- 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learningcited by 368
35 more
- 2020Neural Scene Graphs for Dynamic Scenescited by 298
- 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
- 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
- 2020Perceive, Predict, and Plan: Safe Motion Planning Through Interpretable Semantic Representationscited by 153
- 2023SUDS: Scalable Urban Dynamic Scenescited by 151
- 2023NeuRAD: Neural Rendering for Autonomous Drivingcited by 150
- 2024MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Secondscited by 141
- 2019The Oxford Radar RobotCar Dataset: A Radar Extension to the Oxford RobotCar Datasetcited by 134
- 2024DriveDreamer4D: World Models Are Effective Data Machines for 4D Driving Scene Representationcited by 123
- 2022ShadowDiffusion: When Degradation Prior Meets Diffusion Model for Shadow Removalcited by 103
- 2024ContextGS: Compact 3D Gaussian Splatting with Anchor Level Context Modelcited by 102
- 2023Neural Fields meet Explicit Geometric Representation for Inverse Rendering of Urban Scenescited by 90
- 2021FoV-NeRF: Foveated Neural Radiance Fields for Virtual Realitycited by 79
- 2022Boreas: A Multi-Season Autonomous Driving Datasetcited by 76
- 2025Geo4D: Leveraging Video Generators for Geometric 4D Scene Reconstructioncited by 67
- 2023NeRF in the Palm of Your Hand: Corrective Augmentation for Robotics via Novel-View Synthesiscited by 57
- 2023LiDAR-NeRF: Novel LiDAR View Synthesis via Neural Radiance Fieldscited by 47
- 2024RadarOcc: Robust 3D Occupancy Prediction with 4D Imaging Radarcited by 33
- 2024LiDAR4D: Dynamic Neural Fields for Novel Space-time View LiDAR Synthesiscited by 27
- 2019Deep Radar Detectorcited by 22
- 2024Diffusion Model is a Good Pose Estimator from 3D RF-Visioncited by 22
- 2023Reconstructing Objects in-the-wild for Realistic Sensor Simulationcited by 21
- 2024DART: Implicit Doppler Tomography for Radar Novel View Synthesiscited by 19
- 2024Radar Fields: Frequency-Space Neural Scene Representations for FMCW Radarcited by 18
- 2018Probably Unknown: Deep Inverse Sensor Modelling In Radarcited by 16
- 2024From Chaos to Clarity: 3DGS in the Darkcited by 15
- 2024RadSimReal: Bridging the Gap Between Synthetic and Real Data in Radar Object Detection With Simulationcited by 14
- 2024Progressive Divide-and-Conquer via Subsampling Decomposition for Accelerated MRIcited by 13
- 2020There and Back Again: Learning to Simulate Radar Data for Real-World Applicationscited by 11
- 2017Deep Stochastic Radar Modelscited by 9
- 2025NeuRadar: Neural Radiance Fields for Automotive Radar Point Cloudscited by 7
- 2024Temporal As a Plugin: Unsupervised Video Denoising with Pre-Trained Image Denoiserscited by 6
- 2021Radar Occupancy Prediction with Lidar Supervision while Preserving Long-Range Sensing and Penetrating Capabilitiescited by 5
- 2025Reconciling Stochastic and Deterministic Strategies for Zero-shot Image Restoration using Diffusion Model in Dualcited by 5
- 2021MaxRay: A Raytracing-based Integrated Sensing and Communication Frameworkcited by 4
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025M4Human: A Large-Scale Multimodal mmWave Radar Benchmark for Human Mesh Reconstructioncited by 7
- 2026mmIR: Frequency-Space Inverse Rendering for 3D Millimeter-Wave Radar ADC Synthesiscited by 1
- 20263D Point Splatting for mmWave Radar Novel View Synthesiscited by 0
- 2026DyRAD: Radar Novel View Synthesis for Dynamic Driving Scenescited by 0
- 2026DyRAD: Radar Novel View Synthesis for Dynamic Driving Scenes30 Sep 2026
- 20263D Point Splatting for mmWave Radar Novel View Synthesis10 Sep 2026
- 2026mmIR: Frequency-Space Inverse Rendering for 3D Millimeter-Wave Radar ADC Synthesis28 Aug 2026
- 2025M4Human: A Large-Scale Multimodal mmWave Radar Benchmark for Human Mesh Reconstruction13 Dec 2025